Fix sharding rank mismatch for LoRA weights and optimizer states in qlora_gemma.ipynb notebook
#4275
| Job | Run time |
|---|---|
| 14s | |
| 1m 18s | |
| 12m 55s | |
| 0s | |
| 3s | |
| 14m 30s |
qlora_gemma.ipynb notebook
#4275
| Job | Run time |
|---|---|
| 14s | |
| 1m 18s | |
| 12m 55s | |
| 0s | |
| 3s | |
| 14m 30s |