Adding LLM support with peft +quantization (4bit and 8 bit)#1631

Open

rajithkrishnegowda wants to merge 37 commits intosecurefederatedai:developfrom

rajithkrishnegowda:rajith-llm-quanti

Commits on Apr 24, 2025

Commits on Apr 25, 2025

Commits on Apr 30, 2025

Merge branch 'securefederatedai:develop' into develop
rajithkrishnegowda
authored

Commits on May 8, 2025

Commits on May 15, 2025

Add files via upload
rajithkrishnegowda
authored

Commits on May 16, 2025

Merge branch 'securefederatedai:develop' into develop
rajithkrishnegowda
authored
adding phi-4 with 4 bit quantization
Rajith
committed
removing unwanted files
Rajith
committed
reverting local changes
Rajith
committed
added 4bit and 8bit
Rajith
committed
removed older code
Rajith
committed

Commits on May 21, 2025

resolving comments
Rajith
committed
removed nvidia-smi cell
Rajith
committed
fix code format
Rajith
committed
renamed file name
Rajith
committed