-
Notifications
You must be signed in to change notification settings - Fork 18
Worker hangs if plan-cluster or review-results never exits #313
Copy link
Copy link
Open
Labels
P2Normal priority bug or improvement with limited blast radius.Normal priority bug or improvement with limited blast radius.clawsweeper:fix-shape-clearClawSweeper found a clear likely implementation shape for this issue.ClawSweeper found a clear likely implementation shape for this issue.clawsweeper:queueable-fixClawSweeper marked this issue as an existing queue_fix_pr work candidate.ClawSweeper marked this issue as an existing queue_fix_pr work candidate.clawsweeper:source-reproClawSweeper found a high-confidence source-level issue reproduction.ClawSweeper found a high-confidence source-level issue reproduction.impact:crash-loopThis issue is about crashes, hangs, restart loops, or process-level availability.This issue is about crashes, hangs, restart loops, or process-level availability.issue-rating: 🦞 diamond lobsterVery strong issue quality with high-confidence source-level or clear reproduction.Very strong issue quality with high-confidence source-level or clear reproduction.no-staleExempts this issue from stale automation.Exempts this issue from stale automation.
Description
Metadata
Metadata
Assignees
Labels
P2Normal priority bug or improvement with limited blast radius.Normal priority bug or improvement with limited blast radius.clawsweeper:fix-shape-clearClawSweeper found a clear likely implementation shape for this issue.ClawSweeper found a clear likely implementation shape for this issue.clawsweeper:queueable-fixClawSweeper marked this issue as an existing queue_fix_pr work candidate.ClawSweeper marked this issue as an existing queue_fix_pr work candidate.clawsweeper:source-reproClawSweeper found a high-confidence source-level issue reproduction.ClawSweeper found a high-confidence source-level issue reproduction.impact:crash-loopThis issue is about crashes, hangs, restart loops, or process-level availability.This issue is about crashes, hangs, restart loops, or process-level availability.issue-rating: 🦞 diamond lobsterVery strong issue quality with high-confidence source-level or clear reproduction.Very strong issue quality with high-confidence source-level or clear reproduction.no-staleExempts this issue from stale automation.Exempts this issue from stale automation.
Type
Fields
Priority
None yet
A wedged
plan-cluster.mjsorreview-results.mjschild can pin a cluster worker forever. Codex already hasCLOWNFISH_CODEX_TIMEOUT_MS. The planner and review-resultsspawnSynccalls inscripts/run-worker.mjshave no deadline.What happens
node scripts/run-worker.mjs <job.md>runsscripts/plan-cluster.mjs(and laterscripts/review-results.mjs) viaspawnSyncwith notimeout.Proposed fix
Give those children the same timeout contract as Codex:
CLOWNFISH_PLANNER_TIMEOUT_MS(default 10 minutes)CLOWNFISH_REVIEW_TIMEOUT_MS(default 10 minutes)ETIMEDOUT, write a blocked result and exit 0 (same as the Codex timeout path)A source test in
test/run-worker-source.test.mjschecks that the timeout wiring is present.Fork branch
This repo limits pull requests to collaborators, so I could not open a PR. The patch is on my fork:
SebTardif:fix/planner-spawn-timeout32f0f1a6Feel free to cherry-pick that commit, or I can open a PR if you add this account as a collaborator.