Skip to content

Reject empty coverage evidence - #509

Merged
Anionix merged 1 commit into
mainfrom
codex/bug-508-coverage-source
Jul 24, 2026
Merged

Reject empty coverage evidence#509
Anionix merged 1 commit into
mainfrom
codex/bug-508-coverage-source

Conversation

@Anionix

@Anionix Anionix commented Jul 24, 2026

Copy link
Copy Markdown
Owner

Summary

  • select coverage by the imported format_bench package identity instead of the unmatched repository src path
  • make the report step fail with status 2 when total coverage is below 1%, preventing a 0% empty artifact from passing
  • add a cheap workflow-contract regression test

Trigger and impact

Main run https://github.com/Anionix/data-format-lab/actions/runs/30079480822 passed 598 tests but emitted CoverageWarning: No data was collected and TOTAL ... 0%. Its uploaded artifact therefore could not establish #303 baseline evidence.

Primary contracts

  • coverage.py source selection accepts importable package/module names
  • coverage report --fail-under=MIN exits 2 below MIN
  • coverage.py 7.10.7 and uv one-off dependency links are pinned in workflow comments
  • coverage is descriptive code-quality evidence and never advances benchmark lifecycle or ranking eligibility
  • NO_LEAN: workflow/test-only change; no Lean definitions or proofs

Verification

Exact head: f946e0e318451093a1a0d7c3e00e0427c72c3ce7

  • focused workflow regression: 1 passed
  • Ruff: clean
  • workflow YAML: parsed with coverage job present
  • fixed-SHA spec review: no findings
  • fixed-SHA standards/code-smell review: no findings

Post-merge: dispatch the workflow on the merged main SHA; require nonzero TOTAL and a non-expired exact-SHA artifact before closing #303.

Fixes #508
Refs #303
Refs #506

@Anionix
Anionix merged commit 315cc61 into main Jul 24, 2026
6 checks passed
@Anionix
Anionix deleted the codex/bug-508-coverage-source branch July 24, 2026 08:59
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Bug] Manual coverage workflow publishes a 0% empty report

1 participant