How do I make Orca-mini follow instructions #1123
Replies: 3 comments
-
hey there, it using the tool or not will depend a lot on your tasks and the agents definitions, if you can share some of that I might be able to give some advice, but you also get see some good examples in the examples repo, like these ones: https://github.com/joaomdmoura/crewAI-examples/blob/main/instagram_post/tasks.py About Ollama, based on the langchain codebase you can pass a |
Beta Was this translation helpful? Give feedback.
-
Hey @joaomdmoura , thanks for the reply. The Orca issue might just be the model is too dumb to understand the task. It loops on needing to use a tool, and About the |
Beta Was this translation helpful? Give feedback.
-
you can use a model like phi instead , it is good in following instructions . About the |
Beta Was this translation helpful? Give feedback.
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
-
Hello, I'm trying out crewAI with Ollama on CPU. I'd like to perform some tasks using a smaller model (I'm using openhermes) like orca-mini. The issue is it doesn't use the
search_tool
for example.How do i make the model perform the task given, like for example Openhermes do?
Also, i deployed Ollama on a runpod endoint. How can I use that, instead of the local model?
Ollama(model="llama2", base_url ??, api_key ??
Beta Was this translation helpful? Give feedback.
All reactions