Private AI Chat Assistant: Pure Browser, Zero Backend

Download and run local LLMs within your browser.

preview.webm

Live site: https://private-ai-chat.vercel.app

Blog post: https://dev.to/dchif/run-your-offline-ai-chat-assistant-pure-browser-zero-backend-1e48

Running locally

1. Install dependencies

npm install

2. Start web app

npm run dev

3. Navigate to http://localhost:5173/

Credits

• Wllama
• SmolLm - HuggingFace
• Llama 3.2 - Meta