You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
- Navigate to <http://localhost:4000/ui> in your browser.
279
-
- login using the username `admin` password $GLOBAL_SECRET (set above).
280
-
- go to Teams -> Create New Team.
281
-
- Name it whatever you want.
282
-
- Get the team id (e.g. `e0a62105-9c6c-4167-b5be-16674a99d502`), and add it to site-values.yaml:
283
-
284
-
```yaml
285
-
litellm:
286
-
teamId: "<TEAM_ID>"
287
-
```
258
+
#### Configure LiteLLM Models
288
259
289
-
You'll also need to set your model list for LiteLLM, using the LLM secrets you set above:
260
+
You'll need to set your model list for LiteLLM, using the LLM secrets you set above:
290
261
291
262
```yaml
292
-
litellm:
293
-
teamId: "<TEAM_ID>"
294
-
295
263
litellm-helm:
296
264
proxy_config:
297
265
model_list:
@@ -301,25 +269,38 @@ litellm-helm:
301
269
api_key: os.environ/ANTHROPIC_API_KEY
302
270
```
303
271
304
-
Finally you will need to set the default LLM model to use in your site-values.yaml. Find the "env:" section below in your site-values.yaml and uncomment the LITELLM_DEFAULT_MODEL. Set "your-model" to one of the models you configured:
272
+
You will also need to set the default LLM model to use in your site-values.yaml. Find the "env:" section in your site-values.yaml and uncomment the LITELLM_DEFAULT_MODEL. Set "your-model" to one of the models you configured:
305
273
306
274
```yaml
307
275
env:
308
-
# This var will cause the openhands deploy to create the LLM team name if it doesn't exist already
309
-
LITE_LLM_TEAM_NAME: openhands
310
276
# replace <your-model> with your LLM model and uncomment this variable
0 commit comments