litellm.exceptions.APIConnectionError: {"detail":"Not Found"} when trying to call completion #240
techybolek
started this conversation in
General
Replies: 1 comment
-
if it's of any help, I solved this error by replacing "ollama/mistral" with "ollama_chat/mistral" |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
I have installed ollama and downloaded mistral. I've launched ollama with mistral and then started light llm:
litellm --model ollama/mistral
LliteLLM Console output:
INFO: 127.0.0.1:50416 - "POST /api/generate HTTP/1.1" 404 Not Found
Beta Was this translation helpful? Give feedback.
All reactions