low-rank-adaptation

Here are 45 public repositories matching this topic...

liuqidong07 / MOELoRA-peft

[SIGIR'24] The official implementation code of MOELoRA.

multi-task peft multitask-learning mixture-of-experts large-language-models chatglm low-rank-adaptation parameter-efficient-fine-tuning peft-fine-tuning-llm

Updated Jul 22, 2024
Python

serp-ai / LLaMA-8bit-LoRA

Sponsor

Star

Repository for Chat LLaMA - training a LoRA for the LLaMA (1 or 2) models on HuggingFace with 8-bit or 4-bit quantization. Research only.

lora large-language-models llm large-language-model chatllama chat-llama low-rank-adaptation

Updated Aug 25, 2023
Python

Chongjie-Si / Subspace-Tuning

Star

A generalized framework for subspace tuning methods in parameter efficient fine-tuning.

adapter natural-language-processing glue llama lora pretrained-models natural-language-generation natural-language-understanding commonsense-reasoning soft-prompt-tuning low-rank-adaptation llama2-7b parameter-efficient-fine-tuning subject-driven-generation llama3-8b subspace-tuning lora-dash

Updated Feb 7, 2025
Python

hkproj / pytorch-lora

Star

LORA: Low-Rank Adaptation of Large Language Models implemented using PyTorch

pytorch lora paper-implementations low-rank-adaptation

Updated Jul 24, 2023
Jupyter Notebook

scale-lab / MTLoRA

Star

The official implementation for MTLoRA: A Low-Rank Adaptation Approach for Efficient Multi-Task Learning (CVPR '24)

pascal lora semantic-segmentation mtl multi-task-learning scene-understanding dense-prediction pascal-context vision-transformer swin-transformer low-rank-adaptation

Updated Mar 9, 2025
Python

jaisidhsingh / LoRA-CLIP

Star

Easy wrapper for inserting LoRA layers in CLIP.

lora multimodal multimodal-deep-learning image-text-matching parameter-efficient-tuning vision-language-pretraining low-rank-adaptation

Updated Jun 16, 2024
Python

garyfanhku / Galore-pytorch

Star

GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection

pytorch lora low-rank-approximation peft large-language-models llm low-rank-adaptation finetuning-llms galore

Updated Mar 7, 2024
Python

alinourian / Fine-tuning-Mistral-7b-QA

Star

Fine tuning Mistral-7b with PEFT(Parameter Efficient Fine-Tuning) and LoRA(Low-Rank Adaptation) on Puffin Dataset(multi-turn conversations between GPT-4 and real humans)

lora fine-tuning peft puffin multi-turn-dialogue wandb hugging-face gpt-4 large-language-models llm low-rank-adaptation parameter-efficient-fine-tuning mistral-7b

Updated Nov 23, 2023
Jupyter Notebook

dvgodoy / LLM-visuals

Star

Over 60 figures and diagrams of LLMs, quantization, low-rank adapters (LoRA), and chat templates FREE TO USE in your blog posts, slides, presentations, or papers.

supervised-learning data-types lora quantization fine-tuning sft chat-template hugging-face bf16 llm llms low-rank-adaptation fine-tuning-llm

Updated Feb 18, 2025

rochitasundar / Generative-AI-with-Large-Language-Models

Star

This repository contains the lab work for Coursera course on "Generative AI with Large Language Models".

reinforcement-learning transformer kl-divergence proximal-policy-optimization large-language-models prompt-engineering flan-t5 instruction-finetuning low-rank-adaptation reward-model parameter-efficient-fine-tuning llm-evaluation

Updated Dec 1, 2023
Jupyter Notebook

cityuhkai / SBoRA

Star

natural-language-processing low-rank-adaptation parameter-efficient-fine-tuning

Updated Sep 9, 2024
Python

zelaki / awesome-LoRA

Star

A curated list of Parameter Efficient Fine-tuning papers with a TL;DR

lora diffusion peft low-rank-adaptation finetuning-llms

Updated Sep 19, 2024

Amelie-Schreiber / esm2_loras

Star

Trying to train LoRAs for ESM-2

lora esm low-rank-adaptation

Updated Aug 6, 2023
Jupyter Notebook

samadpls / SentimentFineTuning

Star

Efficient fine-tuned large language model (LLM) for the task of sentiment analysis using the IMDB dataset.

opensource sentiment-analysis transformer finetuning huggingface llm low-rank-adaptation

Updated Jun 3, 2024
Python

VaradhKaushik / AI-Character-Forge

Star

Advanced AI-driven tool for generating unique video game characters using Stable Diffusion, DreamBooth, and LoRa adaptations. Enhances creativity with customizable, high-quality character designs, tailored specifically for game developers and artists.

machine-learning deep-learning neural-network artificial-intelligence digital-art image-generation lora game-art video-game-development creative-ai ai-art character-design stable-diffusion dreambooth low-rank-adaptation

Updated May 18, 2024
Jupyter Notebook

monk1337 / NanoPeft

Star

The simplest repository & Neat implementation of different Lora methods for training/fine-tuning Transformer-based models (i.e., BERT, GPTs). [ Research purpose ]

llama lora quantization mistral peft huggingface llm low-rank-adaptation qlora

Updated Apr 2, 2024
Jupyter Notebook

kreasof-ai / Homunculus-Project

Sponsor

Star

Long term project about a custom AI architecture. Consist of cutting-edge technique in machine learning such as Flash-Attention, Group-Query-Attention, ZeRO-Infinity, BitNet, etc.