pipeline-parallel-size and Deepseek R1 0528

[xhejtman]

Hello,

I would like to run Deepseek R1 0528 on 5x B200 GPU. It should be enough to fit the model, however, with number 5, tensor-parallel-size cannot be used. So I tried pipeline-parallel-size but in this case, sglang will not start due to insufficient memory, it looks like it want to load everything to a single GPU.

Should it work with pipeline-parallel-size?