A personal AI-powered chat application that lets you have conversations with your own ChatGPT history data using RAG (Retrieval-Augmented Generation).
This app allows you to:
- Upload your ChatGPT conversation history
- Chat with an AI that has context from your past conversations
- Keep your personal data private (runs locally with Ollama)
- Use your chat history as a "second brain" for recalling past thoughts and conversations
- Local AI: Uses Ollama for privacy-focused local LLM inference
- RAG System: Retrieves relevant context from your chat history before responding
- Vector Search: ChromaDB for efficient similarity search through your conversations
- Web Interface: Clean Gradio UI for easy chatting
- Smart Ranking: Uses cross-encoder reranking for better context relevance
- Frontend: Gradio
- LLM: Ollama (Gemma2 3B)
- Vector DB: ChromaDB
- Embeddings: HuggingFace all-MiniLM-L6-v2
- Framework: LlamaIndex
- Install dependencies:
uv install - Start Ollama and pull the model:
ollama pull gemma2:3b - Process your ChatGPT data using the Jupyter notebook
- Run the app:
uv run app.py
See setup.md for detailed setup instructions.