Skip to content

Commit 14d293d

Browse files
Alexey Panfilovclaude
andcommitted
config: use qwen3:0.6b as local model (supports tools), gemma3:1b as classifier
qwen3.5:4b doesn't fit in 8GB VPS RAM. qwen3:0.6b is the smallest model with tool calling support that fits. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
1 parent 4b463e5 commit 14d293d

1 file changed

Lines changed: 3 additions & 6 deletions

File tree

config/config.yaml

Lines changed: 3 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -69,20 +69,17 @@ models:
6969
max_tokens: 8192
7070
base_url: https://dashscope-intl.aliyuncs.com/compatible-mode/v1
7171

72-
# Ollama (local) — classifier and optional primary model.
73-
# Runs natively on host, accessed via host.docker.internal.
72+
# Ollama — classifier model (gemma3:1b). No tools needed for classification.
7473
ollama:
7574
model: gemma3:1b
7675
base_url: http://host.docker.internal:11434
7776
max_tokens: 64
7877

79-
# Ollama local — larger local model, can be used as primary via /model.
80-
# qwen3.5:4b supports tools and vision.
78+
# Ollama local — local model for simple tasks. Supports tools.
8179
ollama-local:
82-
model: qwen3.5:4b
80+
model: qwen3:0.6b
8381
base_url: http://host.docker.internal:11434
8482
max_tokens: 4096
85-
vision: true
8683

8784
# Claude via bridge (host service wrapping `claude -p` CLI).
8885
# Requires claude-bridge running on host:9900.

0 commit comments

Comments
 (0)