Talk with Multiple LLM ChatBot

Build using

• MindsDB
• Python
• Streamlit
• json-server
• Ollama
• Mistral

Demo video

Features

• Create and edit chatbot

• Manage Chatbots

• Select and chat with chabot

  

• Chatbot respond with context

---

Project setup

Ollama mistral setup

• Install Ollama Link
• Download Mistral model after installing ollama by running ollama run mistral

Mindsdb setup

• Run docker compose up if you want to run mindsdb with gpu or docker run --name mindsdb_container -p 47334:47334 -p 47335:47335 mindsdb/mindsdb to run mindsdb with cpu
• Follow the instruction to install dependencies if needed Link
• Open mindsdb editor and run the command from mdb.sql one by one
• Make sure ollama is running

Project setup

• create virtual environment python3 -m venv .ven
• Activate virtual environment source .venv/bin/activate
• Install requirements files pip install -r requirements.txt
• Install json-server npm install -g json-server
• Run json-server with db.json json-server db.json --watch
• Run streamlit using streamlit run Home.py