Skip to content

README.md

Latest commit

 

History

History
70 lines (52 loc) · 1.91 KB

README.md

File metadata and controls

70 lines (52 loc) · 1.91 KB
Raw

PetHero 🐾

Autonomous cat-care robot — Hugging Face Desk Hero Hackathon, Berlin 2026

Camera sees cat → AI classifies food → backend enforces rules → robot arm acts → app monitors live.

Demo

Architecture

 📷 Robot Camera
      │  JPEG frames (UDP :5007)
      ▼
 ┌─────────────────────────────────────┐
 │         FastAPI Backend             │
 │                                     │
 │  video_bridge ──► /ws/feed ──► 📱  │
 │                                     │
 │  POST /enforce                      │
 │    ├─ Which cat? (pet_id / vision)  │
 │    ├─ Food allowed? (rules)         │
 │    ├─ Fed recently? (interval)      │
 │    └─ ✅ {"cmd":"feed"} ──UDP──►   │
 │         ❌ {"cmd":"protect"} ──►   │
 └──────────────────┬──────────────────┘
                    │ WebSocket
                    ▼
              📱 iOS App
         live feed · config · controls

 🤖 Robot Arm ◄──UDP :5006── Backend

Stack
Vision ResNet18 (food classification)
Backend FastAPI · Railway · SQLite
Transport UDP (robot commands + video) · WebSocket (app)
App Expo · React Native · iOS
Safety Rule-based enforcement — no LLM in the critical path

Run

# Backend
cd backend && pip install -r requirements.txt
uvicorn app.main:app --host 0.0.0.0 --port 8000

# App
cd app && npm install && npx expo run:ios

# Robot
cd scripts/pick_place
python step3_candy_vision.py && python step4_pick_place.py

Local wifi demo guide → backend/docs/LOCAL-SETUP.md