Hi! I am JINJI: your helpful cat companion and friendly feline AI assistant!
I’m designed as a locally hosted interface that connects to local LLMs, so you can use me without needing an internet connection.
- Fun browsing experience: A browser-based interactive session.
- Offline playtime! Everything runs locally!
- Play with different LLM models that are installed on your machine. Choose a model you'd prefer to use for whatever task you need.
- Frontend: HTML, CSS, JavaScript
- Backend: Python (FastAPI, Uvicorn)
- LLM Runtime: Ollama
- Architecture: Local-first, offline AI system
I run entirely on your local machine:
- The frontend provides a browser-based chat interface
- The FastAPI backend handles requests and model communication
- Ollama serves locally installed LLMs
- No external APIs or internet connection required
This design ensures:
- Full privacy
- Low latency
- Offline usability
- Ollama https://ollama.com/ (because who needs to fetch when you can download models?)
- Python 3.x+ – Make sure it's up-to-date so we don't accidentally step on any toes.
- All my favorite toys and tools listed in requirements.txt.
- Clone this kitty's play area:
git clone <your-repo-url>
cd <repo-directory>- Install Python dependencies:
pip install -r requirements.txt- Ensure Ollama is installed and models are downloaded:
ollama pull <model-name>I work great with phi4-mini:3.8b
You can run me using the provided Python launcher:
python3 run.pyI'll take care of all the setup so you don't have to worry about me stepping on your toes (figuratively speaking):
- Start Ollama if it is not already running.
- Launch the FastAPI backend (uvicorn) serving the frontend.
- Cleanly terminate Ollama if it was started by the script on shutdown.
After the server is running, open your browser at:
JINJI is released under the MIT License. You are free to use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies of this project under the terms of that license.
- DOMPurify (v3.3.3) — © Cure53 and other contributors, released under the Apache License 2.0 and Mozilla Public License 2.0. Used for safe sanitization of HTML/Markdown.
- marked (v15.0.12) — © 2011–2025 Christopher Jeffrey, MIT Licensed. GitHub repo. Used for parsing Markdown.
- Highlight.js (v11.9.0) — © Igor Sysoev and other contributors, BSD-3-Clause Licensed. GitHub repo. Used for syntax highlighting in code blocks.
- Atom One Dark Theme (for Highlight.js) — © Alexander Gugel, BSD-3-Clause Licensed. GitHub repo. Used as the code block styling theme.
⚠️ Note: This project is intended for learning and personal use. It is not associated with any official company or product.
