Custom API end point (ollama) and API_KEY

[martinschatz-cz]

Hey @haesleinhuepf :)

is it possible/are you planning to have an option to conenct to custom server? For example ollama server with API that is provided by some bigger infrastructure (https://docs.cerit.io/en/docs/web-apps/chat-ai)?

Thanks!
Martin

[martinschatz-cz]

Ah, sorry, you actually have an example. I will show myself out 🤦

[reneleonhardt]

@haesleinhuepf Would local Ollama support be possible when running CI locally with act or tartelet?

[haesleinhuepf]

Hi @reneleonhardt ,

just out of curiousity, which model would you use with ollama? I thought most open-weigt models are not so good when it comes things like git-bob does. But I'm happy to learn!

[reneleonhardt]

From what I can see after good experiences with Qwen3 locally I would try https://ollama.com/library/devstral next.
It's just a bit misleading that the graphs only compare it to outdated models.

But the big advantage of Ollama support would be to try practically any HuggingFace model and compare their performance and quality with the ability to integrate MCP tools into your local workflows without compromising private data.