Skip to content

Commit e167b3a

Browse files
authored
update batch_p2p_comm (#111)
1 parent 5b27c58 commit e167b3a

1 file changed

Lines changed: 2 additions & 1 deletion

File tree

src/mcore_bridge/config/model_config.py

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -303,7 +303,8 @@ def __post_init__(self):
303303
if self.add_bias_linear:
304304
self.add_qkv_bias = True
305305
self.actual_vocab_size = self.padded_vocab_size
306-
self.batch_p2p_comm = not self.overlap_p2p_comm
306+
if self.overlap_p2p_comm:
307+
self.batch_p2p_comm = False
307308
if self.swiglu:
308309
self.activation_func = F.silu
309310
self.gated_linear_unit = True

0 commit comments

Comments
 (0)