Hi this is the code from this viral demo.
Please read ball.json. That's where the magic is. ball.py is mostly just an OpenCV visualizer.
To make this a real time product you'll need to:
- Smartly send frames to Gemini (Gemini Video can only handle 1 FPS)
- Use Gemini API to return content.
- Render it.
This would make a killer iOS app.
Good luck.