An end-to-end Retrieval-Augmented Generation (RAG) application that allows users to have interactive conversations with any website. By providing a URL, the application scrapes the content, indexes it, and allows for context-aware Q&A using OpenAI's powerful language models.
- URL-Based Chat: Enter any website URL to instantly start a conversation with its content.
- Contextual Memory: Maintains chat history to provide accurate responses based on the full conversation flow.
- RAG Pipeline: Utilizes LangChain for document loading, text splitting, and retrieval.
- Vector Search: Uses Chroma DB and OpenAI Embeddings for high-performance semantic search.
- Frontend: Streamlit
- LLM: OpenAI GPT-4o-mini
- Embeddings: OpenAI
text-embedding-3-small - Orchestration: LangChain
- Database: Chroma DB (Vector Store)
- Python 3.9+
- OpenAI API Key
- Clone the repository:
git clone https://github.com/Anuroop128/chat-with-websites.git cd chat-with-websites - Install dependencies:
pip install -r requirements.txt
- Create a
.envfile and add your OpenAI API Key:OPENAI_API_KEY=your_openai_api_key_here
- Run the app:
streamlit run src/app.py