Skip to content

Commit b7ccf41

Browse files
committed
fix cpu op
1 parent f201d79 commit b7ccf41

File tree

1 file changed

+0
-2
lines changed

1 file changed

+0
-2
lines changed

vllm/_custom_ops.py

-2
Original file line numberDiff line numberDiff line change
@@ -189,8 +189,6 @@ def fused_add_rms_norm(input: torch.Tensor, residual: torch.Tensor,
189189
ops = torch.ops._C_cpu if input.device.type == "cpu" else torch.ops._C
190190
ops.fused_add_rms_norm(input, residual, weight, epsilon)
191191

192-
torch.ops._C.fused_add_rms_norm(input, residual, weight, epsilon)
193-
194192

195193
def advance_step_flashattn(num_seqs: int, num_queries: int, block_size: int,
196194
input_tokens: torch.Tensor,

0 commit comments

Comments
 (0)