Skip to content

perf(code): reuse auto classifier model sessions - #5996

Draft
Mason Daugherty (mdrxy) wants to merge 1 commit into
mainfrom
mdrxy/code/auto-classifier-session
Draft

perf(code): reuse auto classifier model sessions#5996
Mason Daugherty (mdrxy) wants to merge 1 commit into
mainfrom
mdrxy/code/auto-classifier-session

Conversation

@mdrxy

Copy link
Copy Markdown
Member

Auto approval reviews now reuse a stable provider cache session within each dcode thread.


Auto classifier calls bypass ConfigurableModelMiddleware, so repeated reviews did not receive dcode's existing OpenAI prompt-cache or Fireworks session-affinity hints. This derives a namespaced opaque classifier key from the trusted approval-mode thread identity and applies the shared provider session settings to both inherited and separately configured classifier models. Sessions remain isolated across threads and explicit model settings remain authoritative.

Tests cover repeated reviews, cross-thread isolation, OpenAI cache keys, and Fireworks cache/session-affinity settings.

Made by Open SWE

Co-authored-by: open-swe[bot] <open-swe@users.noreply.github.com>
@github-actions github-actions Bot added dcode Related to `deepagents-code` internal User is a member of the `langchain-ai` GitHub organization performance Code change that improves performance size: S 50-199 LOC labels Aug 30, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

dcode Related to `deepagents-code` internal User is a member of the `langchain-ai` GitHub organization performance Code change that improves performance size: S 50-199 LOC

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant