Summarization failed for model ...: cannot schedule new futures after interpreter shutdown

[bingyuyap]

Issue

Running r1 in parallel using a Thread Pool is giving below error:

Summarization failed for model deepseek/deepseek-chat: cannot schedule new futures after interpreter shutdown
Summarization failed for model deepseek/deepseek-reasoner: cannot schedule new futures after interpreter shutdown
summarizer unexpectedly failed for all models

Can I remove summarizer function or is there a way to prevent this from happening

Version and model info

aider 0.72.2.dev7+g843720a6
model: deepseek/deepseek-reasoner

[region23]

the same error after commit creating:

Summarization failed for model deepseek/deepseek-chat: cannot schedule new futures after shutdown
Summarization failed for model deepseek/deepseek-chat: cannot schedule new futures after shutdown
Summarization failed for model deepseek/deepseek-reasoner: cannot schedule new futures after shutdown
summarizer unexpectedly failed for all models
Summarization failed for model deepseek/deepseek-reasoner: cannot schedule new futures after shutdown
summarizer unexpectedly failed for all models

[paul-gauthier]

Thanks for trying aider and filing this issue.

I am seeing this occasionally too, since the last version bump of litellm.

[bingyuyap]

@paul-gauthier is this a critical bug? what are the implications

[lee-b]

I'm seeing this too (on the latest version).

Interestingly, it's with llama.cpp's openai API, not deepseek-specific implementation on the aider side, but it is DeepSeek-R1-Distil-Lllama-70B that llama.cpp is running.

Summarization failed for model openai/default: cannot schedule new futures after shutdown
Summarization failed for model openai/default: cannot schedule new futures after shutdown
summarizer unexpectedly failed for all models

Suggest the title should be more general than deepseek-specific.

[gthieleb]

I have this issue repeatidely appearing with the following command:

aider --model ollama_chat/ishumilin/deepseek-r1-coder-tools:8b  --message-file /home/gun/Development/prompt-1pass --architect --load /home/gun/Development/run-1password

Loaded commands:

/web...                                              
/web...                                              
/web...                                              
/run...                                              
/read-only...

The loaded commands take some time, perhaps an initialisation step is not lazy enough...

Same error happens with an ollama or openai weak model:

Summarization failed for model ollama_chat/llama3:8b: cannot schedule new futures after interpreter shutdown

[zwilch]

I am using local llama-server deepseek-r1 14B Model
aider --version
aider 0.74.2

Starting to summarize chat history.
Summarization failed for model openai/deepseek-r1: cannot schedule new futures after shutdown
Summarization failed for model openai/deepseek-r1: cannot schedule new futures after shutdown
summarizer unexpectedly failed for all models
Finished summarizing chat history.

[azriel1rf]

In my situation, this happens after enabling lint: true in .aider.conf.yml and resolved after getting back to disable it.

[NICK-DUAN]

In my situation, this happens after enabling lint: true in .aider.conf.yml and resolved after getting back to disable it.在我的情况下，这发生在启用lint: true in .aider.conf.yml ，并在恢复禁用它后解决。

set lint to false not work for me

[brandon-fryslie]

For me it was caused by lint: true.

I had lint: true in my ~/.aider.conf.yml file, and the repo-specific file did not override it. Neither did using the environment variable AIDER_LINT=False or AIDER_LINT=false. The docs are incomplete for this option, it does not specify that Aider will only lint and exit for this option, although from the context I suspected it did (it's similar to the --test option).

[harleypig]

I'm only seeing this when running aider --commit from the command line. I'm not setting lint, so it should be defaulting to false.

aider --commit
──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────
Using openrouter/anthropic/claude-3.7-sonnet model with API key from environment.
Error: Read-only file /home/harleypig/projects/private_dotfiles/sites/CONVENTIONS.md does not exist. Skipping.
Aider v0.81.1
Main model: openrouter/anthropic/claude-3.7-sonnet with diff edit format, prompt cache, infinite output
Weak model: openrouter/anthropic/claude-3-5-haiku
Git repo: ../.git with 136 files
Repo-map: using 4096 tokens, files refresh
Restored previous conversation history.
Commit 5c4382d refactor: Update Authelia configuration for dev and local environments
Summarization failed for model openrouter/anthropic/claude-3-5-haiku: cannot schedule new futures after shutdown
Summarization failed for model openrouter/anthropic/claude-3.7-sonnet: cannot schedule new futures after shutdown
summarizer unexpectedly failed for all models

It doesn't seem to make a difference if I'm in the top level of the repository or not.