Skip to content

Commit c286546

Browse files
committed
update
1 parent c3768fd commit c286546

1 file changed

Lines changed: 12 additions & 0 deletions

File tree

docs/user_guide/quick_start.md

Lines changed: 12 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -88,6 +88,18 @@ To allow the API to be accessible from other machines, add the argument `--host
8888
parallax chat --host 0.0.0.0
8989
```
9090

91+
### Downloading from ModelScope
92+
93+
Parallax downloads models from Hugging Face by default. To download from ModelScope instead, set `USE_MODELSCOPE` before starting any Parallax process that resolves or loads the model:
94+
95+
```sh
96+
USE_MODELSCOPE=1 parallax run -m Qwen/Qwen3-0.6B -n 2
97+
USE_MODELSCOPE=1 parallax join -s {scheduler-address}
98+
USE_MODELSCOPE=1 parallax serve --model-path Qwen/Qwen3-0.6B
99+
```
100+
101+
Use a model ID that exists on ModelScope. To switch back to Hugging Face, run the same commands without `USE_MODELSCOPE`.
102+
91103
### Without frontend
92104
#### Step 1: Launch scheduler
93105
First launch our scheduler on the main node.

0 commit comments

Comments
 (0)