Skip to content

[Feat]: Add mha benchmark#6

Open
RMLYC wants to merge 10 commits intotile-ai:mainfrom
RMLYC:lyc/add_new_benchmark
Open

[Feat]: Add mha benchmark#6
RMLYC wants to merge 10 commits intotile-ai:mainfrom
RMLYC:lyc/add_new_benchmark

Conversation

@RMLYC
Copy link

@RMLYC RMLYC commented Oct 15, 2025 •
edited
Loading

  1. Add FlashAttention-3 mha kernel (mha_fa3.py)
  2. Add Pytorch mha kernel (FA2) (mha_pytorch.py)
  3. Add mha compare and profile test (test_mha.py)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@RMLYC