Feat:
-
LoRA is currently supported
Import dependencies
from deeplotx import LoRA
Assumed that the
modelhas been loadedmodel = ... # Maybe an LLM or some other deep neural network models lora_model = LoRA.apply_to(model, target_modules=['q_proj'], rank=16, alpha=32, dropout_rate=.05)
Full Changelog: 0.9.10...0.9.15