support for local llms

[arm2arm]

dear developers,
Do you plan an integration with the local llms interfaces like: ollama, llamacpp or vllm?
thank you beforehand

[borisbolliet]

Hi @arm2arm, thanks! It's on our TDL, yes! currently wrapping up the first version and we will integrate local models further down the line.

[nullnuller]

Hi @arm2arm, thanks! It's on our TDL, yes! currently wrapping up the first version and we will integrate local models further down the line.

Bumping to register interest.