Skip to content

PRHunt retries have no cumulative wall-clock budget #81

Description

@wolfgang-aura

Impact

PRHunt runs can consume many hours because agent timeouts and review-cycle limits apply per invocation. A coordinator can call resume-review with larger limits, so the same candidate gets more hour-long agent calls. On 2026-09-09, run 20260909T053801Z-e02330 spent about four hours in orchestration, reached five review cycles, and then hit the account usage limit. Another candidate reached nine review cycles and four revisions.

This defeats the bounded-run promise and can exhaust the shared Codex allowance without producing a candidate.

Reproduction

  1. Start an orchestration with the default limits.
  2. Let the reviewer request changes until the run blocks on its cumulative cycle limit.
  3. Call resume-review with a higher --max-review-cycles and --max-revisions value.
  4. Repeat. Each invocation gets a fresh per-agent timeout, and no persisted wall-clock deadline stops the run.

Evidence

  • Environment: Windows, Mailman 6ad0491.
  • 20260909T053801Z-e02330: 38m primary, 34m review, 56m revision, then four more reviewer or revision calls. Five review cycles were recorded before usage exhaustion.
  • 20260909T042707Z-8cf031: four revisions and nine review cycles.
  • mailman orchestrate defaults each agent call to 3600 seconds and has no cumulative run deadline.

Next action

Persist a cumulative orchestration deadline per run, clamp every agent and verification call to its remaining time, and refuse deadline increases unless the operator supplies a recorded override reason. Add regression coverage across resume-review invocations.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions