-
Notifications
You must be signed in to change notification settings - Fork 21
Add local Ollama setup and testing scripts for native OpenAI API compatibility #173
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Add local Ollama setup and testing scripts for native OpenAI API compatibility #173
Conversation
e1436a4
to
8ca7521
Compare
Signed-off-by: Martin Gaievski <[email protected]>
64df79e
to
55c9375
Compare
Signed-off-by: Martin Gaievski <[email protected]>
55c9375
to
07d5aa3
Compare
Signed-off-by: Martin Gaievski <[email protected]>
ac5ff99
to
b2e7dc0
Compare
Signed-off-by: Martin Gaievski <[email protected]>
fd8bc44
to
71f2fbe
Compare
Signed-off-by: Martin Gaievski <[email protected]>
71f2fbe
to
cfde6b3
Compare
Signed-off-by: Martin Gaievski <[email protected]>
510e09f
to
57ab4f6
Compare
Signed-off-by: Martin Gaievski <[email protected]>
5c37f37
to
33cd659
Compare
Really cool to see Ollama can be used for CI tests. Glad to know Ollama has compatibility with OpenAI Chat - OpenAI compatibility and can bridge with OpenAI schema. Great Idea, Martin |
Signed-off-by: Martin Gaievski <[email protected]>
33cd659
to
dc277e1
Compare
thanks for feedback and for pointers Fen. I pushed commit that implemented direct connection between ml-commons and ollama for CI and local testing. |
4dbbf96
to
cffb40e
Compare
…atibility Signed-off-by: Martin Gaievski <[email protected]>
cffb40e
to
5043c15
Compare
Added capabilities for setting up model that is natively compatible with OpenAI API and hosted locally. That applies to:
Part of this change are slight improvements in LLM judgment logic, I have added multiple formats of possible response to support basic models.
Resolves issue
#181
By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.