Skip to content

Report coverage and artifact-mutation evidence - #507

Merged
Anionix merged 2 commits into
mainfrom
codex/issue-303-coverage-metrics
Jul 24, 2026
Merged

Report coverage and artifact-mutation evidence#507
Anionix merged 2 commits into
mainfrom
codex/issue-303-coverage-metrics

Conversation

@Anionix

@Anionix Anionix commented Jul 24, 2026

Copy link
Copy Markdown
Owner

Summary

  • add a manual, pinned branch-coverage workflow and upload immutable coverage evidence
  • report descriptive generated artifact-mutation completion/failure outcomes without changing rankings or gates
  • exclude named boundary cases by requiring the persisted mutation recipe identity
  • record the time-bounded accepted-risk exit contract in [DFL-AUDIT-121 follow-up] Set coverage gate and source-mutation baseline #506

Contract

  • Lifecycle: DISCOVERED -> ENCODED -> ROUNDTRIP_VERIFIED -> BENCHMARKED -> REPORTED
  • Artifact-mutation evidence is descriptive and non-rankable.
  • Primary sources: coverage.py 7.10.7 branch measurement documentation and the uv run --with contract, linked from README and workflow comments.
  • NO_LEAN: this slice changes Python/reporting/config only and introduces no Lean definitions or proofs.

Verification

Exact head: 7f124d963ceba7f06ff180ac8d23e6e2b1f226d0

  • PYTHONPATH=src /Users/st/Documents/data-format-lab/.venv/bin/pytest tests/test_report.py tests/test_robustness_summary.py -> 12 passed
  • uvx ruff check src/format_bench/report.py src/format_bench/robustness/summary.py tests/test_report.py tests/test_robustness_summary.py -> clean
  • uvx ty check --python /Users/st/Documents/data-format-lab/.venv src/format_bench/report.py src/format_bench/robustness/summary.py -> clean
  • workflow YAML parsed and contains the coverage job
  • fixed-SHA spec review: no findings
  • fixed-SHA standards/code-smell review: no findings

Post-merge: dispatch the manual coverage workflow on the merged main SHA and verify the named artifact before closing #303.

Refs #303
Refs #506

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 7f124d963c

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Comment thread src/format_bench/report.py
@Anionix
Anionix merged commit 5e5305e into main Jul 24, 2026
6 checks passed
@Anionix
Anionix deleted the codex/issue-303-coverage-metrics branch July 24, 2026 08:35
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant