[Question] Conversation and streaming

[KaKi87]

Hi,

The README doesn't actually provide examples for real-world uses cases, which aren't just 1 request and 1 reply, but whole conversations, and with streaming.

It would be nice to have an example for that use case.

Thanks

[ZoranRavic]

That really is the full example though.

If you had more questions and replies you would just put them into the messages array.

Here's how that would look like

const response = await ollama.chat({
  model: 'llama3.1',
  messages: [
    { role: 'user', content: 'First question?' },
    { role: 'assistant', content: 'First reply' },
    { role: 'user', content: 'Second question?' },
  ],
  stream: true,
})

The chat client doesn't have any internal state, so it's your responsibility to track message history.

[KaKi87]

I see.

Well, coming from the sole knowledge of the user experience of real-world apps, this is indeed not obvious to guess 😅

It would be nice to explain this on the README I think, and maybe show an example of message history tracking with streaming.