Feature Request execute in parallel

[MichaelFomenko]

is it somehow possible to run it like ollama in parallel.

like OLLAMA_NUM_PARALLEL=8 OLLAMA_MAX_QUEUE=2048

So multiple chats can be executed at the same time or have an Queue?

[b4rtaz]

Currently this is not supported.