feat(check-reporting): automate PRISMA flow cascade arithmetic verification#33
Merged
Merged
Conversation
Adds scripts/prisma_cascade_check.py: reads round1/round2/round3 screening TSV/CSV artifacts, computes the PRISMA flow cascade from raw decisions, and optionally cross-checks against manuscript prose. Motivation: PRISMA cascade off-by-one prose errors are a high-frequency reviewer red flag (e.g., 151+108+39+1+1+4=304 followed by prose summary "305"). Deterministic recompute from raw artifacts catches these before submission. Synthetic fixture tests cover TSV-only / matching-prose / off-by-one / bad-column. All 4 pass. Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
PR T1-8: check-reporting PRISMA cascade arithmetic auto-verify
Title:
feat(check-reporting): automate PRISMA flow cascade arithmetic verificationSummary
Adds
scripts/prisma_cascade_check.pyto/check-reportingthatcomputes the canonical PRISMA flow chain from raw round-by-round
screening TSV artifacts and cross-checks against manuscript prose claims.
Motivation
PRISMA 2020 flow diagrams chain a cascade of subtractions. Off-by-one
errors in the prose are a high-frequency reviewer red flag and a
recurring root cause of revision rounds. Cross-project precedents
(anonymized):
cascade by 5.
These errors survive manual checks because the cascade is intuitive
("looks roughly right"). The deterministic recompute catches them.
Changes
skills/check-reporting/scripts/prisma_cascade_check.py— new script."X records retrieved for full-text" / "Y studies included in
synthesis" forms
skills/check-reporting/SKILL.md— adds the "PRISMA Cascade ArithmeticAuto-Verify" section with command, behavior, and "treat drift as P0"
guidance.
skills/check-reporting/tests/test_prisma_cascade.sh— 4 cases(TSV-only, matching prose, off-by-one prose, bad column).
Test plan
bash skills/check-reporting/tests/test_prisma_cascade.sh— 4/4 PASSbash scripts/validate_skills.sh/meta-analysisPhase 3f reconciliation gateRelated
🤖 Generated with Claude Code