Skip to content

Fix sharding rank mismatch for LoRA weights and optimizer states in grpo_gemma.ipynb notebook #4231

Fix sharding rank mismatch for LoRA weights and optimizer states in grpo_gemma.ipynb notebook

Fix sharding rank mismatch for LoRA weights and optimizer states in grpo_gemma.ipynb notebook #4231