Turn a pre-trained GPT into a chatbot that sounds like Joey from the TV show Friends.
This project shows how to use commodity GPUs (e.g. RTX A4000s), quantization (e.g. 4bit models) and PEFT training techniques (LoRA) to turn a base GPT model into a chatbot that sounds like Joey from the TV show Friends.
- Base GPT Model: Mistral 7B V1
- quantization method: 4bit normal float
- PEFT technique: LoRA
- Packages: see requirements.txt