Skip to content

Commit 92b3fc2

Browse files
authored
Update README.md fix the AITER name (#193)
1 parent 7999503 commit 92b3fc2

File tree

1 file changed

+1
-1
lines changed
  • blogs/software-tools-optimization/vllm-moe-guide

1 file changed

+1
-1
lines changed

blogs/software-tools-optimization/vllm-moe-guide/README.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -699,7 +699,7 @@ vLLM allows combining multiple strategies to efficiently distribute models acros
699699
1. `--pipeline-parallel-size 2 --enable-expert-parallel` → EP **does NOT activate** (TP=1, DP=1 per stage)
700700
2. `--pipeline-parallel-size 2 --tensor-parallel-size 4 --enable-expert-parallel` → EP activates (TP=4 per stage)
701701

702-
2. **PP \+ EP requires AITER (Advanced Inter-node Tensor-parallelism Engine Runtime)**
702+
2. **PP \+ EP requires AITER**
703703
1. AITER provides stability for complex communication patterns with PP
704704
2. Enable with: `VLLM_ROCM_USE_AITER=1`
705705
3. Without AITER: May experience instability or failures with large MoE models

0 commit comments

Comments
 (0)