Skip to content

adding support for every-n test sampling#992

Open
jhou-jpg wants to merge 1 commit intomainfrom
export-D98962433
Open

adding support for every-n test sampling#992
jhou-jpg wants to merge 1 commit intomainfrom
export-D98962433

Conversation

@jhou-jpg
Copy link
Copy Markdown
Contributor

@jhou-jpg jhou-jpg commented Apr 2, 2026

Summary:
Add /N divisor syntax to --num-inputs for step-based input sampling

Extend --num-inputs to accept a /N format (e.g., /2) that samples every Nth
input shape, enabling faster benchmark runs with representative coverage
across the full shape space without needing to know the total count upfront.

usage: buck2 run mode/opt //pytorch/tritonbench:run -- --op softmax --metrics latency,compile_time --num-inputs /2

this change helps us to test equally spaced shape without needing to know number of shapes

Differential Revision: D98962433

Summary:
Add /N divisor syntax to --num-inputs for step-based input sampling

Extend --num-inputs to accept a /N format (e.g., /2) that samples every Nth
input shape, enabling faster benchmark runs with representative coverage
across the full shape space without needing to know the total count upfront.

usage: buck2 run mode/opt //pytorch/tritonbench:run -- --op softmax --metrics latency,compile_time --num-inputs **/2**

this change helps us to test equally spaced shape without needing to know number of shapes

Differential Revision: D98962433
@jhou-jpg jhou-jpg temporarily deployed to docker-s3-upload April 2, 2026 17:53 — with GitHub Actions Inactive
@jhou-jpg jhou-jpg temporarily deployed to docker-s3-upload April 2, 2026 17:53 — with GitHub Actions Inactive
@meta-cla meta-cla Bot added the cla signed label Apr 2, 2026
@meta-codesync
Copy link
Copy Markdown

meta-codesync Bot commented Apr 2, 2026

@jhou-jpg has exported this pull request. If you are a Meta employee, you can view the originating Diff in D98962433.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants