Skip to content

Commit 8e2a8a3

Browse files
authored
Tiny fix fsdp distributed update weight error (#567)
1 parent af51fcf commit 8e2a8a3

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

slime/backends/fsdp_utils/update_weight_utils.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -297,7 +297,7 @@ def update_weights(self) -> None:
297297
class UpdateWeightFromDistributed:
298298
"""Broadcast weights via a temporary NCCL group to rollout engines."""
299299

300-
def __init__(self, args: Namespace, model: torch.nn.Module) -> None:
300+
def __init__(self, args: Namespace, model: torch.nn.Module, weights) -> None:
301301
self.args = args
302302
self.model = model
303303
self.weights = weights # CPU parameter storage

0 commit comments

Comments
 (0)