Skip to content

Fix parallel recovery cap resets and reduce duplicate warnings - #29

Merged
hemanth-asirvatham merged 1 commit into
mainfrom
fix-concurrency-reset-bug
Feb 7, 2026
Merged

Fix parallel recovery cap resets and reduce duplicate warnings#29
hemanth-asirvatham merged 1 commit into
mainfrom
fix-concurrency-reset-bug

Conversation

@hemanth-asirvatham

Copy link
Copy Markdown
Collaborator

Motivation

  • Prevent unintended resets of the worker concurrency cap after error-driven reductions so the system does not jump back to the requested maximum unexpectedly.
  • Avoid duplicate output when logging the first rate-limit/connection errors so only a single message is emitted by default.
  • Make ramping concurrency back up less conservative by lowering the sustained-success threshold so recovery is faster once stability is observed.

Description

  • Updated first-error logging in get_all_responses so _log_rate_limit_once and _log_connection_once only call logger.warning when message_verbose is false, avoiding duplicate prints and warnings.
  • Changed _halt_ramp_up to print when message_verbose is enabled and otherwise issue a single logger.warning, removing duplicate messaging.
  • Prevented throughput tuning from overwriting a previously reduced concurrency_cap by removing the unintended assignment that reset the cap during dynamic tuning.
  • Lowered the sustained-success threshold multiplier used to grow concurrency from 2.5x to 1.5x of the current cap to speed recovery after stable periods.
  • All changes are in src/gabriel/utils/openai_utils.py and focus on parallel recovery/logging behavior.

Testing

  • No automated tests were run for this change.

Codex Task

@hemanth-asirvatham
hemanth-asirvatham merged commit 99126dc into main Feb 7, 2026
1 check failed
@github-actions

github-actions Bot commented Feb 7, 2026

Copy link
Copy Markdown


Thank you for your submission, we really appreciate it. Like many open-source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution. You can sign the CLA by just posting a Pull Request Comment same as the below format.


I have read the CLA Document and I hereby sign the CLA


You can retrigger this bot by commenting recheck in this Pull Request. Posted by the CLA Assistant Lite bot.

@github-actions github-actions Bot locked and limited conversation to collaborators Feb 7, 2026
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant