[Perf Regression] 7 config(s) regressed @ a5e3958e

[github-actions]

Performance Regression Detected

Commit: a5e3958e
Run: https://github.com/ROCm/ATOM/actions/runs/33207172096
Date: 2026-08-29T00:47:46.070168+00:00

Regressed Configurations

Model	ISL/OSL	Conc	Tput (cur)	Tput (base)	Δ%	TPOT (cur)	TPOT (base)	Δ%
DeepSeek-V4-Pro TBO	1024/1024	64	2187.3	2223.8	-1.6%	27.53	27.18	1.3%
GLM-5.2-FP8	1024/1024	16	790.3	771.9	2.4%	19.71	20.21	-2.5%
MiniMax-M3-MXFP4 EAGLE3	1024/1024	8	1605.9	1587.1	1.2%	4.65	4.64	0.1%
MiniMax-M3-MXFP4 EAGLE3	1024/1024	64	5528.8	5563.3	-0.6%	10.98	10.88	0.9%
MiniMax-M3-MXFP8	8192/1024	4	478.4	486.4	-1.6%	7.92	7.83	1.1%
gpt-oss-120b	1024/1024	4	837.6	886.4	-5.5%	4.43	4.27	3.7%
gpt-oss-120b	1024/1024	128	8973.9	8944.5	0.3%	13.61	13.79	-1.3%

Performance Summary

# Trace Performance Summary

**File:** `gpt-oss-120b_ts_20260829_005146_915.pt.trace.json.gz`

## Prefill

| # | Label | Duration |
|---|-------|----------|
| 0 | `prefill[bs=1 tok=2 ctx=994]` | 45.05 ms |
| 1 | `prefill[bs=3 tok=2748 ctx=[950, 924, 874]]` | 1319.68 ms |
| 2 | `prefill[bs=1 tok=882 ctx=882]` | 43.78 ms |
| 3 | `prefill[bs=1 tok=827 ctx=827]` | 41.72 ms |
| 4 | `prefill[bs=1 tok=834 ctx=834]` | 40.69 ms |
| 5 | `prefill[bs=1 tok=822 ctx=822]` | 40.40 ms |

**Total prefill:** 1531.32 ms

## Decode

- **Iterations:** 2007
- **Mean:** 304.3 us
- **Min:** 216.1 us
- **Max:** 467.9 us
- **Total:** 610.74 ms

Profiler Traces

Download from workflow artifacts.
Open in Perfetto UI or Chrome chrome://tracing for analysis.

Next Steps

1. Download profiler-analysis-33207172096 artifact
2. Open trace files in Perfetto UI
3. Compare kernel durations against previous traces
4. Identify bottleneck changes