Skip to content

0.9.15

Latest

Choose a tag to compare

@vortezwohl vortezwohl released this 10 Oct 07:23
· 1 commit to main since this release

Feat:

  • LoRA is currently supported

    Import dependencies

    from deeplotx import LoRA

    Assumed that the model has been loaded

    model = ...  # Maybe an LLM or some other deep neural network models
    lora_model = LoRA.apply_to(model, target_modules=['q_proj'], rank=16, alpha=32, dropout_rate=.05)

Full Changelog: 0.9.10...0.9.15