Skip to content
This repository was archived by the owner on Jul 15, 2025. It is now read-only.

Commit b30c851

Browse files
committed
removing extra size
1 parent 6e09bc5 commit b30c851

File tree

1 file changed

+0
-1
lines changed

1 file changed

+0
-1
lines changed

megablocks/layers/dmoe.py

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -316,7 +316,6 @@ def forward(self, x):
316316
# NOTE: If we're going to cast the activations to lower precision
317317
# do it before we permute the tokens to save bandwidth.
318318
x = common.cast_if_autocast_enabled(x)
319-
sl, bs, hs = x.size()
320319

321320
# Compute the expert scores and assignments.
322321
scores, expert_weights, top_experts = self.router(x)

0 commit comments

Comments
 (0)