Skip to content

Commit 89ba376

Browse files
cleanup
1 parent 4e22bd7 commit 89ba376

File tree

1 file changed

+0
-1
lines changed

1 file changed

+0
-1
lines changed

primus/core/projection/module_profilers/moe_mlp.py

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -52,7 +52,6 @@ def estimated_activation_memory(self, batch_size: int, seq_len: int) -> int:
5252
# Second Gemm
5353
total += num_tokens * self.config.model_config.moe_ffn_hidden_size * 2 # bf16
5454

55-
denom = self.config.model_config.hidden_size * batch_size * seq_len * 2
5655
return total
5756

5857

0 commit comments

Comments
 (0)