Skip to content

Generate GPU L2 size inputs in flash_attention Triton Bench #681

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
wants to merge 1 commit into
base: main
Choose a base branch
from
Open

Generate GPU L2 size inputs in flash_attention Triton Bench #681

wants to merge 1 commit into from
+299 −214

Conversation

@sryap
Copy link
Contributor

@sryap sryap commented Dec 3, 2025

Summary:
Add an option to generate inputs as large as the GPU L2 cache size to
avoid an explicit cache clearing in every iteration

Differential Revision: D85318459

@meta-codesync
Copy link

meta-codesync bot commented Dec 3, 2025

@sryap has exported this pull request. If you are a Meta employee, you can view the originating Diff in D85318459.

@meta-cla meta-cla bot added the cla signed label Dec 3, 2025
facebook-github-bot pushed a commit that referenced this pull request Dec 3, 2025
@sryap @facebook-github-bot
Generate GPU L2 size inputs in flash_attention Triton Bench (#681)
8f08261 
Summary:

Add an option to generate inputs as large as the GPU L2 cache size to
avoid an explicit cache clearing in every iteration

Reviewed By: henrylhtsang

Differential Revision: D85318459
facebook-github-bot pushed a commit that referenced this pull request Dec 3, 2025
@sryap @facebook-github-bot
Generate GPU L2 size inputs in flash_attention Triton Bench (#681)
2d443e1 
Summary:

Add an option to generate inputs as large as the GPU L2 cache size to
avoid an explicit cache clearing in every iteration

Reviewed By: henrylhtsang

Differential Revision: D85318459
facebook-github-bot pushed a commit that referenced this pull request Dec 3, 2025
@sryap @facebook-github-bot
Generate GPU L2 size inputs in flash_attention Triton Bench (#681)
59c9295 
Summary:

Add an option to generate inputs as large as the GPU L2 cache size to
avoid an explicit cache clearing in every iteration

Reviewed By: henrylhtsang

Differential Revision: D85318459
@sryap @facebook-github-bot
Generate GPU L2 size inputs in flash_attention Triton Bench (#681)
560e2b9 
Summary:

Add an option to generate inputs as large as the GPU L2 cache size to
avoid an explicit cache clearing in every iteration

Reviewed By: henrylhtsang

Differential Revision: D85318459
facebook-github-bot pushed a commit that referenced this pull request Dec 4, 2025
@sryap @facebook-github-bot
Generate GPU L2 size inputs in flash_attention Triton Bench (#681)
ff17272 
Summary:

Add an option to generate inputs as large as the GPU L2 cache size to
avoid an explicit cache clearing in every iteration

Reviewed By: henrylhtsang

Differential Revision: D85318459
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@henrylhtsang henrylhtsang henrylhtsang approved these changes

Assignees

No one assigned

Labels

cla signed fb-exported meta-exported

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

4 participants

@sryap @henrylhtsang @facebook-github-bot