AI Watch Buddy | AI 视频搭子

An AI companion that watches video together with you with proactive reactions and highly accurate video understanding.

Created by @t41372, @ylxmf2005, @pika-from-akachi, and @Charlie8802 within ~36 hours at AdventureX 2025

⚠️ This is an hackathon prototype as of now. The code quality, latency, and other optimization will be improved later on.

What's interesting about this project? 🤖✨

• Truly watches video, not just audio transcripts!
  🖥️ The AI processes actual video frames (1 fps by default, adjustable) and listens to audio using embeddings, allowing it to understand both visual motion and non-verbal sounds.
• Proactive, conversational companion
  💬 The AI doesn't just wait for your input—it speaks up whenever it has something to say!
• Full control over playback
  ⏯️ The AI can pause, resume, or rewatch any part of the video by manipulating the progress bar, just like a real viewer.
• Adorably interactive
  🐾 It's cute! And it has a Live2D avatar that makes facial expression whenever it wants to!

Demo

2025-07-27.03-05-21_30MB.mp4

Install & Run locally

Enter api keys into .env file. No need to care too much about openai api keys.

Install python dependencies and run the project with uv

uv run main.py

Visit http://localhost:8000 for the user interface