Skip to content

Commit 1519acf

Browse files
Fridge003Kangyan-Zhou
authored andcommitted
[Hotfix] Fix router gemm on sm103 (#22134)
1 parent c1927e1 commit 1519acf

1 file changed

Lines changed: 1 addition & 1 deletion

File tree

python/sglang/srt/models/deepseek_v2.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -326,7 +326,7 @@ def forward(
326326
and (self.weight.shape[0] == 256 or self.weight.shape[0] == 384)
327327
and _device_sm >= 90
328328
):
329-
if _device_sm >= 100 and self.weight.shape[0] == 256:
329+
if _device_sm == 100 and self.weight.shape[0] == 256:
330330
# router gemm output float32
331331
logits = torch.empty(
332332
hidden_states.shape[0],

0 commit comments

Comments
 (0)