Skip to content

Add Better Benchmark performance summary dashboard - #8600

Merged
karthickai merged 1 commit into
mainfrom
karthickai/stack/1
Aug 21, 2026
Merged

Add Better Benchmark performance summary dashboard#8600
karthickai merged 1 commit into
mainfrom
karthickai/stack/1

Conversation

@karthickai

@karthickai karthickai commented Aug 20, 2026

Copy link
Copy Markdown
Contributor

Summary

Adds a summary view for Better Benchmark results in PyTorch HUD.

  • Shows overall model and kernel performance using geomean, median, mean, and comparable-record counts.
  • Breaks results down by suite and mode.
  • Shows the largest model and kernel gains/regressions, ranked by absolute latency impact.
  • Displays comparison coverage and exclusion reasons.
  • Links workflow IDs to their GitHub Actions runs.
  • Uses lower-is-better green/red semantics with a neutral threshold for small changes.
  • Adds a dedicated backend query path for Better Benchmark summary data.

The benchmark records are produced by pytorch/pytorch#193991

Test plan

  • yarn tsc --noEmit
  • Prettier check for changed files
  • ESLint for changed files
  • Better Benchmark summary Jest tests
  • Validate parsing of kernel, projected-model, coverage, and exclusion records
  • Validate suite/mode aggregation and mover ranking
  • Validate against uploaded B200 benchmark output

@vercel

vercel Bot commented Aug 20, 2026

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated (UTC)
torchci Ready Ready Preview Aug 21, 2026 9:04pm

Request Review

karthickai added a commit that referenced this pull request Aug 20, 2026
stack-info: PR: #8600, branch: karthickai/stack/1
@meta-cla meta-cla Bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Aug 20, 2026
@karthickai
karthickai requested a review from atalman August 20, 2026 21:59
karthickai added a commit that referenced this pull request Aug 21, 2026
stack-info: PR: #8600, branch: karthickai/stack/1
@karthickai
karthickai marked this pull request as ready for review August 21, 2026 19:45
@karthickai
karthickai marked this pull request as draft August 21, 2026 20:14
karthickai added a commit that referenced this pull request Aug 21, 2026
stack-info: PR: #8600, branch: karthickai/stack/1
@karthickai
karthickai marked this pull request as ready for review August 21, 2026 20:14
@karthickai
karthickai requested a review from eellison August 21, 2026 20:51
stack-info: PR: #8600, branch: karthickai/stack/1
@karthickai
karthickai marked this pull request as draft August 21, 2026 21:01
@karthickai
karthickai marked this pull request as ready for review August 21, 2026 21:01
@karthickai
karthickai merged commit 61a7757 into main Aug 21, 2026
5 checks passed
@karthickai
karthickai deleted the karthickai/stack/1 branch August 21, 2026 22:32
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants