Skip to content

Commit d98964a

Browse files
niklubnik
and
nik
authored
docs: Add example for Custom endpoint connection (#7145)
Co-authored-by: nik <[email protected]>
1 parent aafe81d commit d98964a

File tree

1 file changed

+11
-0
lines changed

1 file changed

+11
-0
lines changed

docs/source/guide/prompts_keys.md

+11
Original file line numberDiff line numberDiff line change
@@ -113,3 +113,14 @@ To add a custom model, enter the following:
113113
* The endpoint URL for the model. For example, `https://my.openai.endpoint.com/v1`
114114
* An API key to access the model. An API key is tied to a specific account, but the access is shared within the org if added. (Optional)
115115
* An auth token to access the model API. An auth token provides API access at the server level. (Optional)
116+
117+
### Example
118+
119+
1. Setup [Ollama](https://ollama.com/), e.g. `ollama run llama3.2`
120+
2. [Verify your local OpenAI-compatible API is working](https://ollama.com/blog/openai-compatibility), e.g. `http://localhost:11434/v1`
121+
3. Create an externally facing endpoint, e.g. `https://my.openai.endpoint.com/v1` -> `http://localhost:11434/v1`
122+
4. Add connection to Label Studio:
123+
- Name: `llama3.2` (must match the model name in Ollama)
124+
- Endpoint: `https://my.openai.endpoint.com/v1` (note `v1` suffix is required)
125+
- API key: `ollama` (default)
126+
- Auth token: empty

0 commit comments

Comments
 (0)