Skip to content

Add CodSpeed benchmark CI - #17

Merged
rudrakshkarpe merged 2 commits into
mainfrom
codspeed-ci-benchmarks
May 17, 2026
Merged

Add CodSpeed benchmark CI#17
rudrakshkarpe merged 2 commits into
mainfrom
codspeed-ci-benchmarks

Conversation

@rudrakshkarpe

@rudrakshkarpe rudrakshkarpe commented May 17, 2026

Copy link
Copy Markdown
Owner

Summary

  • Add a CodSpeed GitHub Actions workflow for PR and main-branch benchmark runs
  • Add pytest-codspeed as an optional codspeed extra
  • Add deterministic core scoring/report rendering benchmarks and local README instructions

Closes #16

Validation

  • .venv/bin/python -m pytest benchmarks/ --codspeed
  • .venv/bin/python -m ruff check .
  • .venv/bin/python -m pytest
  • .venv/bin/python -m mypy src
  • rm -rf dist && .venv/bin/python -m build && .venv/bin/python -m twine check dist/*

@rudrakshkarpe

rudrakshkarpe commented May 17, 2026

Copy link
Copy Markdown
Owner Author

CodSpeed benchmark tests are executing successfully in GitHub Actions, but the upload is currently blocked by CodSpeed auth:

Failed to retrieve upload data: 401 Unauthorized
Reason: Repository not found or the user does not have access to it.

The workflow now uses the recommended OIDC permissions. The remaining setup step is to import/authorize rudrakshkarpe/dual-llm-bench in the CodSpeed dashboard/GitHub App, then re-run the failed CodSpeed job.

@rudrakshkarpe
rudrakshkarpe merged commit d76cf67 into main May 17, 2026
5 of 6 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Integrate CodSpeed benchmark CI

1 participant