File tree 1 file changed +11
-0
lines changed
1 file changed +11
-0
lines changed Original file line number Diff line number Diff line change @@ -113,3 +113,14 @@ To add a custom model, enter the following:
113
113
* The endpoint URL for the model. For example, ` https://my.openai.endpoint.com/v1 `
114
114
* An API key to access the model. An API key is tied to a specific account, but the access is shared within the org if added. (Optional)
115
115
* An auth token to access the model API. An auth token provides API access at the server level. (Optional)
116
+
117
+ ### Example
118
+
119
+ 1 . Setup [ Ollama] ( https://ollama.com/ ) , e.g. ` ollama run llama3.2 `
120
+ 2 . [ Verify your local OpenAI-compatible API is working] ( https://ollama.com/blog/openai-compatibility ) , e.g. ` http://localhost:11434/v1 `
121
+ 3 . Create an externally facing endpoint, e.g. ` https://my.openai.endpoint.com/v1 ` -> ` http://localhost:11434/v1 `
122
+ 4 . Add connection to Label Studio:
123
+ - Name: ` llama3.2 ` (must match the model name in Ollama)
124
+ - Endpoint: ` https://my.openai.endpoint.com/v1 ` (note ` v1 ` suffix is required)
125
+ - API key: ` ollama ` (default)
126
+ - Auth token: empty
You can’t perform that action at this time.
0 commit comments