Replies: 3 comments
-
|
I'm not sure continue can call any tools at all on any model; Are you able to get it working on any other model that is self hosted? |
Beta Was this translation helpful? Give feedback.
-
|
GPT OSS is one of the suggested models for the agent/plan mode, that's why I tried. I imagine it ought to be soported if it's here https://docs.continue.dev/customize/models That being said, I gave a try on the other similarly sized model, devstral small 2 which is supposed to be designed for agent usage, and it fared much better. It's not perfect but it can run tools like file reads and so on. |
Beta Was this translation helpful? Give feedback.
-
|
This issue is related to this one #8098. Someone noticed that the extension only includes the available tools on the first call to Ollama (as it is initiated by a user message). Subsequent messages do not contain the tools array. He noticed that if the tools array is included when the message role is set to "tool" the agent stops messing up tool calls. The fix seems too simple, I can't understand how this is still a problem after all this time. |
Beta Was this translation helpful? Give feedback.
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
-
Hi! I configured gpt-oss 20b on my ollama instance like so, this is my entire agent configuration file:
However when I ask in plan or agent mode if gpt-oss can read a specific file, I get the following invalid tool call error:
What does this mean? I can't find anything related to a "tool assistant" in the configuration.
Beta Was this translation helpful? Give feedback.
All reactions