Using Tools

[benmcmurry]

I really want Osaurus to work for me. It's such a great idea. However, I cannot get the tools to work at all. What am I missing? I've installed them and I've tried to tell the model in chat to do things like open application, play playlist, create notes, etc. What's going on?

[JuvGut]

In my experience, tool use only works well with large models. I would love to use it locally, but for now, reliable local tool use seems too good to be true. None of the local models (including the Gemma 4 26B A4B JANG_2L) work reliably. I tried lowering the temperature settings and explicitly calling tools through the system prompt, but without success.

It worked nicely for me with this model: gemini-3.1-pro-preview-customtools - but I don't like paying almost 10 cents per query.

[benmcmurry]

This is unfortunate. Once this is figured out, I'll give Osaurus another try.