Skip to content

Add cost and latency overhead metrics - #18

Open
rudrakshkarpe wants to merge 6 commits into
mainfrom
feat/cost-latency-metrics
Open

Add cost and latency overhead metrics#18
rudrakshkarpe wants to merge 6 commits into
mainfrom
feat/cost-latency-metrics

Conversation

@rudrakshkarpe

Copy link
Copy Markdown
Owner

Summary

  • Add opt-in LatencyOverhead and CostEfficiency metrics with configurable thresholds
  • Expose performance metric helpers through the Python API and CLI flags
  • Include aggregate metric summaries in JSON reports so performance scores are machine-readable
  • Document how to enable performance scoring and what trace fields are required

Closes #4

Commit Stack

  1. ef08a71 Add performance overhead metrics
  2. 47d4cfe Expose opt-in performance metrics
  3. 133448d Add CLI switches for performance scoring
  4. 65484e1 Document performance metric usage
  5. fe3da29 Include metric summaries in JSON reports
  6. 822ca7c Type report payload helper

Validation

  • .venv/bin/python -m ruff check .
  • .venv/bin/python -m mypy src
  • .venv/bin/python -m pytest
  • .venv/bin/python -m pytest benchmarks/ --codspeed
  • rm -rf dist && .venv/bin/python -m build && .venv/bin/python -m twine check dist/*

@codspeed-hq

codspeed-hq Bot commented May 17, 2026

Copy link
Copy Markdown

Merging this PR will not alter performance

✅ 2 untouched benchmarks


Comparing feat/cost-latency-metrics (822ca7c) with main (d76cf67)

Open in CodSpeed

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Cost and latency overhead metrics

1 participant