Skip to content

Commit 63a390f

Browse files
committed
docs: fix LM Studio model ID format and add setup guidance
Use full model ID (openai/qwen/qwen3.5-35b-a3b) matching what LM Studio reports via /v1/models. Add curl step to find exact model ID and context_window config to match LM Studio's context length.
1 parent e96a91b commit 63a390f

5 files changed

Lines changed: 11 additions & 9 deletions

File tree

README.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -145,7 +145,7 @@ Stored at `<config_dir>/config.toml`:
145145

146146
```toml
147147
[agent]
148-
default_model = "openai/qwen3.5-35b-a3b"
148+
default_model = "openai/qwen/qwen3.5-35b-a3b"
149149

150150
[providers.openai]
151151
api_key = "lm-studio"

config.example.toml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -17,7 +17,7 @@
1717
# Format: "provider/model-id" (OpenClaw-compatible)
1818
#
1919
# LM Studio (local, no API key needed):
20-
# - "openai/qwen3.5-35b-a3b", "openai/llama-4-scout", etc.
20+
# - "openai/qwen/qwen3.5-35b-a3b", "openai/llama-4-scout", etc.
2121
# (requires LM Studio running at http://127.0.0.1:1234)
2222
#
2323
# Ollama (local, no API key needed):

website/docs/configuration.md

Lines changed: 7 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -318,21 +318,23 @@ export OPENAI_API_KEY="sk-..."
318318
[LM Studio](https://lmstudio.ai/) runs open-weight models locally and exposes an OpenAI-compatible API. No API keys, no cloud — everything stays on your machine.
319319

320320
1. Download and install [LM Studio](https://lmstudio.ai/).
321-
2. In LM Studio, download a model (e.g., Qwen 3.5, Llama 4, Gemma 3, Phi-4) and start the local server. Note the model name shown in the server tab.
322-
3. Edit `~/.config/localgpt/config.toml`:
321+
2. In LM Studio, download a model (e.g., Qwen 3.5, Llama 4, Gemma 3, Phi-4) and start the local server.
322+
3. Find the exact model ID — run `curl http://127.0.0.1:1234/v1/models` and look for the `"id"` field (e.g., `qwen/qwen3.5-35b-a3b`). The model name must match exactly.
323+
4. Edit `~/.config/localgpt/config.toml`:
323324

324325
```toml
325326
[agent]
326-
default_model = "openai/qwen3.5-35b-a3b" # use the model name from LM Studio
327+
default_model = "openai/qwen/qwen3.5-35b-a3b" # use the exact model ID from step 3
328+
context_window = 32768 # match the context length set in LM Studio
327329

328330
[providers.openai]
329331
api_key = "lm-studio"
330332
base_url = "http://127.0.0.1:1234/v1"
331333
```
332334

333-
4. Run `localgpt chat` — all requests go to LM Studio on your machine.
335+
5. Run `localgpt chat` — all requests go to LM Studio on your machine.
334336

335-
LM Studio's default port is `1234`. If you changed it, update the `base_url` accordingly. Tool calling works with models that support it (e.g., Qwen 3.5, Llama 4).
337+
LM Studio's default port is `1234`. If you changed it, update the `base_url` accordingly. Set the context length in LM Studio's model load settings to match `context_window`. Tool calling works with models that support it (e.g., Qwen 3.5, Llama 4).
336338

337339
### Ollama (Local)
338340

website/docs/intro.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -61,7 +61,7 @@ LocalGPT automatically detects the provider based on model name prefix:
6161

6262
| Prefix | Provider | Examples |
6363
|--------|----------|----------|
64-
| `openai/*` | LM Studio / OpenAI | openai/qwen3.5-35b-a3b, openai/gpt-4o |
64+
| `openai/*` | LM Studio / OpenAI | openai/qwen/qwen3.5-35b-a3b, openai/gpt-4o |
6565
| Other | Ollama (local) | llama3, mistral, codellama |
6666
| `claude-cli/*` | Claude CLI | claude-cli/opus, claude-cli/sonnet |
6767
| `anthropic/*` | Anthropic API | anthropic/claude-opus-4-5, anthropic/claude-sonnet-4-5 |

website/docs/quick-start.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -17,7 +17,7 @@ Run models entirely on your machine with [LM Studio](https://lmstudio.ai):
1717
```bash
1818
# Install LM Studio from https://lmstudio.ai
1919
# Download a model and start the local server, then:
20-
localgpt config set agent.default_model "openai/qwen3.5-35b-a3b"
20+
localgpt config set agent.default_model "openai/qwen/qwen3.5-35b-a3b"
2121
localgpt config set providers.openai.api_key "lm-studio"
2222
localgpt config set providers.openai.base_url "http://127.0.0.1:1234/v1"
2323
```

0 commit comments

Comments
 (0)