Skip to content

feat(check-reporting): automate PRISMA flow cascade arithmetic verification#33

Merged
Yoojin-nam merged 1 commit into
mainfrom
feat/tier1-PR8-check-reporting-prisma-cascade
May 23, 2026
Merged

feat(check-reporting): automate PRISMA flow cascade arithmetic verification#33
Yoojin-nam merged 1 commit into
mainfrom
feat/tier1-PR8-check-reporting-prisma-cascade

Conversation

@Yoojin-nam
Copy link
Copy Markdown
Contributor

PR T1-8: check-reporting PRISMA cascade arithmetic auto-verify

Title: feat(check-reporting): automate PRISMA flow cascade arithmetic verification

Summary

Adds scripts/prisma_cascade_check.py to /check-reporting that
computes the canonical PRISMA flow chain from raw round-by-round
screening TSV artifacts and cross-checks against manuscript prose claims.

Motivation

PRISMA 2020 flow diagrams chain a cascade of subtractions. Off-by-one
errors in the prose are a high-frequency reviewer red flag and a
recurring root cause of revision rounds. Cross-project precedents
(anonymized):

  • DTA-MA example: Results prose PRISMA cascade `151 + 108 + 39 + 1 + 1
    • 4 = 304` followed by a prose summary "305" four lines later.
  • Outcome-MA example: Table 2 row total disagreed with computed
    cascade by 5.

These errors survive manual checks because the cascade is intuitive
("looks roughly right"). The deterministic recompute catches them.

Changes

  • skills/check-reporting/scripts/prisma_cascade_check.py — new script.
    • Reads round1/round2/round3 TSV/CSV
    • Configurable decision columns
    • Computes cascade arithmetic (round-to-round excluded counts)
    • Optional manuscript prose grep with best-effort patterns for
      "X records retrieved for full-text" / "Y studies included in
      synthesis" forms
  • skills/check-reporting/SKILL.md — adds the "PRISMA Cascade Arithmetic
    Auto-Verify" section with command, behavior, and "treat drift as P0"
    guidance.
  • skills/check-reporting/tests/test_prisma_cascade.sh — 4 cases
    (TSV-only, matching prose, off-by-one prose, bad column).

Test plan

  • bash skills/check-reporting/tests/test_prisma_cascade.sh — 4/4 PASS
  • bash scripts/validate_skills.sh
  • Integration with /meta-analysis Phase 3f reconciliation gate

Related

  • PR T1-1 (cross_document_n_check.py for the broader N-drift family)
  • PR T1-5 / T1-6 (pool lock + entry gate that produce the TSV inputs)

🤖 Generated with Claude Code

Adds scripts/prisma_cascade_check.py: reads round1/round2/round3
screening TSV/CSV artifacts, computes the PRISMA flow cascade from
raw decisions, and optionally cross-checks against manuscript prose.

Motivation: PRISMA cascade off-by-one prose errors are a high-frequency
reviewer red flag (e.g., 151+108+39+1+1+4=304 followed by prose
summary "305"). Deterministic recompute from raw artifacts catches
these before submission.

Synthetic fixture tests cover TSV-only / matching-prose / off-by-one
/ bad-column. All 4 pass.

Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
@Yoojin-nam Yoojin-nam merged commit 80db846 into main May 23, 2026
1 check passed
@Yoojin-nam Yoojin-nam deleted the feat/tier1-PR8-check-reporting-prisma-cascade branch May 23, 2026 06:55
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant