Skip to content

Commit 7b6b8a1

Browse files
committed
misc
1 parent bdab3a7 commit 7b6b8a1

File tree

1 file changed

+3
-0
lines changed

1 file changed

+3
-0
lines changed

README.md

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -80,6 +80,9 @@ pip install 'checkpoint-engine[p2p]'
8080
Prepare an H800 or H20 machine with 8 GPUs with vLLM. Be sure to include [/collective_rpc API endpoint](https://github.com/vllm-project/vllm/commit/f7cf5b512ee41f36613deb2471a44de5f304f70d) commit (available in main branch) since checkpoint-engine will use this endpoint to update weights. vLLM version `v0.10.2` is fully tested and recommended.
8181

8282
```Bash
83+
mkdir -p /opt/vLLM && cd /opt/vLLM
84+
uv venv --python 3.12 --seed
85+
source .venv/bin/activate
8386
uv pip install vllm==0.10.2
8487
```
8588

0 commit comments

Comments
 (0)