Addition of Free LLM

[TommyH-Tran]

Hello, I have been using this since early stages of khoj and do love using the new pipali desktop app, it is sleek, fast, and smooth. I like that I can switch between language models that might suite the task I have at hand. I was wondering if there is any way to add a free language model that is still sufficient. It could increase the consumer base, of the application, however I am not sure how logistically feasible that is.

[debanjum]

Hey @TommyH-Tran, thanks for being an early supporter! Glad you like Pipali so far ❤️

The next release of Pipali will enable using models via any AI provider that exposes an OpenAI Reponses compatible API, including Ollama and OpenRouter (untested). You'd need to set OPENAI_BASE_URL and OPENAI_API_KEY env vars when starting Pipali. Does that work?