**Is your feature request related to a problem? Please describe.** We'd like to incorporate the latest research on LoRA. **Describe the solution you'd like** Look at this paper and implement what makes sense: https://arxiv.org/abs/2410.09692
Is your feature request related to a problem? Please describe.
We'd like to incorporate the latest research on LoRA.
Describe the solution you'd like
Look at this paper and implement what makes sense: https://arxiv.org/abs/2410.09692