Skip to content

Commit 35cb6f7

Browse files
authored
[algo] fix: avoid FSDP _is_root assertion when collecting LoRA weights (#650)
1 parent 8a57c6c commit 35cb6f7

1 file changed

Lines changed: 1 addition & 0 deletions

File tree

verl/workers/sharding_manager/fsdp_vllm.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -121,6 +121,7 @@ def _collect_lora_weights(self) -> dict:
121121
else:
122122
lora_weights[key] = lora_weight.detach().cpu()
123123

124+
submodule._is_root = False
124125
if self.use_param_offload:
125126
offload_fsdp_submodule(submodule)
126127

0 commit comments

Comments
 (0)