Ollama integration?

[michaelwechner]

Hi

Are you plannning an Ollama integration?

I am currently using https://github.com/ollama4j/ollama4j which works very well.

Thanks

Michael

[sashirestela]

@michaelwechner Is it OpenAI API compatible? Could you provide any related documentation?

[michaelwechner]

Similar, but not the same, see for example

https://github.com/ollama/ollama/blob/main/docs/api.md#generate-a-chat-completion

versus

https://platform.openai.com/docs/api-reference/chat/create

But the advantage with Ollama / Ollama4j is, that you access many Open Source models with one API

[the-gigi]

I didn't try it, but according to their docs they have some OpenAI compatibility

See https://github.com/ollama/ollama/blob/main/docs/openai.md