local-chatgpt with Gemma 3

Local ChatGPT

This project leverages Google DeepMind's latest Gemma 3 and Chainlit to create a 100% locally running mini-ChatGPT.

Installation and setup

Setup Ollama:

# setup ollama on linux 
curl -fsSL https://ollama.com/install.sh | sh
# pull the DeepSeek-R1 model
ollama pull gemma3:4b

Install Dependencies: Ensure you have Python 3.11 or later installed.

pip install pydantic==2.10.1 chainlit ollama

Run the app:

Run the chainlit app as follows:

chainlit run app.py -w

Demo Video

Click below to watch the demo video of the AI Assistant in action:

Watch the video

---

📬 Stay Updated with Our Newsletter!

Get a FREE Data Science eBook 📖 with 150+ essential lessons in Data Science when you subscribe to our newsletter! Stay in the loop with the latest tutorials, insights, and exclusive resources. Subscribe now!

---

Contribution

Contributions are welcome! Please fork the repository and submit a pull request with your improvements.