Skip to content

fix: verify published benchmark artifacts - #4

Merged
WaffleBits merged 1 commit into
mainfrom
fix/verify-benchmark-artifacts
Jul 30, 2026
Merged

fix: verify published benchmark artifacts#4
WaffleBits merged 1 commit into
mainfrom
fix/verify-benchmark-artifacts

Conversation

@WaffleBits

@WaffleBits WaffleBits commented Jul 30, 2026

Copy link
Copy Markdown
Owner

Summary

  • add a CPU-only CLI that validates every committed benchmark and roofline artifact
  • recompute raw-sample summaries, speedups, logical bandwidth, and derived roofline cases
  • reject non-finite, sensitive, duplicate, or correctness-failed public evidence
  • repair the chart-script lint failure and run artifact validation in CI

Verification

  • ruff check .
  • pytest (20 passed)
  • triton-kernel-artifacts (8 artifacts, 38 cases)
  • python -m compileall -q src tests
  • wheel and sdist build
  • pip-audit --local (no known vulnerabilities; local package skipped because it is not on PyPI)
  • chart CLI regenerated a non-empty PNG from the committed artifact

Claim boundary

This verifies the internal consistency of already committed RTX 5070 Ti records on CPU. It does not rerun GPU kernels or turn logical-bandwidth projections into hardware-counter measurements.

Add a CPU-only artifact validator that recomputes timing summaries, speedups, bandwidth values, and derived roofline cases from committed raw evidence. Reject non-finite, sensitive, duplicate, or correctness-failed records and restore the public CI gate.
@WaffleBits
WaffleBits merged commit fbb930c into main Jul 30, 2026
1 check passed
@WaffleBits
WaffleBits deleted the fix/verify-benchmark-artifacts branch July 30, 2026 11:12
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant