OpenAI first response always random language

[Lawkss]

Which version of integration_openai are you using?

3.7.1

Which version of Nextcloud are you using?

32.0.1

Which browser are you using? In case you are using the phone App, specify the Android or iOS version and device please.

Edge

Describe the Bug

Ask the AI chat a question in english.

answers in swedish, russian, spanish, or other language.

Expected Behavior

answer in the language you asked the question in.

To Reproduce

Ask the AI chat a question in english.

[Lawkss]

I use deepseek now and it appears to work fine with that.

[oleksandr-nc]

Yeah, it's heavily depends on the underlying model. We need to think how to improve that

[kyteinsky]

Ask the AI chat a question in english.

I assume it's the "Chat with AI" feature.

The system prompt and the sampling params heavily influence this issue.
Can you try setting the "Extra completion model parameters" to {"temperature":0.3}, see if that improves things?
I'll be transfering this issue to the assistant repo if the above does not solve it since the system prompt part lives there.
Would you mind mentioning the provider and the model you used that the issue happened?

We had issues initially with models only answering in English even if the user question/message was in another language and then sometimes picking up the user's name and assuming the user's native language and answering in that. We fixed those issues but this new one seems to pop up now. As Alexander said, we can think again on how to improve it further.