Skip to content

Commit 56f7034

Browse files
committed
update glm4_moe
1 parent 94c5108 commit 56f7034

1 file changed

Lines changed: 1 addition & 4 deletions

File tree

fastdeploy/model_executor/models/glm4_moe.py

Lines changed: 1 addition & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -358,10 +358,7 @@ def forward(
358358
# Fully Connected
359359
hidden_states, residual = self.post_attention_layernorm(hidden_states, residual, proxy_rmsnorm=proxy_rmsnorm)
360360

361-
if isinstance(self.mlp, Glm4Moe):
362-
hidden_states = self.mlp(hidden_states, forward_meta)
363-
else:
364-
hidden_states = self.mlp(hidden_states, forward_meta)
361+
hidden_states = self.mlp(hidden_states, forward_meta)
365362

366363
return hidden_states, residual
367364

0 commit comments

Comments
 (0)