Virtual Hand Clone

In this project I created a digital 3D clone of my hands with a single webcam. To track the hands, I use mediapipe with OpenCV and Python. The identified hand landmark coordinates are then packaged and sent via UDP to Godot, where the virtual hands are then visualized.

⚡ Quickstart

1. Clone the repo
2. Open the python folder and (optionally) create a virtual environment.
3. Install the dependencies from the requirements file with pip install -r requirements.txt
4. Run the python script python hand_detection.py
5. Open the Godot project in the godot folder in the Godot Game Engine.
6. Run the project.

🗞️ Tutorial

Real-Time Hand Tracking in Godot — Creating Virtual 3D Clones of my Hands

🏗️ Architecture

🖥️ Versions

• Python 3.12.4
• OpenCV 4.10.0.84
• Mediapipe 0.10.14
• Godot v4.2.2

🎬 Demos

Single Hand Tracking