"Experience gaming like never before with Gesture Genius — your hands are the new controller!"
Gesture Genius is an innovative AI-powered gaming control software that replaces traditional gaming controllers with real-time hand gesture recognition. Instead of using keyboards, joysticks, or expensive controllers, users can control games using simple hand movements captured through a webcam.
The project focuses on creating a natural, touch-free, and immersive gaming experience by allowing players to interact with games through intuitive gestures. It mainly targets car racing games, where steering, acceleration, braking, and other controls can be performed using finger and hand movements.
Gesture Genius promotes accessibility, affordability, and futuristic interaction, making gaming more engaging and interactive for everyone.
- Uses webcam input to detect hand movements.
- Tracks finger positions and hand orientation.
- Converts gestures into game control commands instantly.
- Eliminates the need for expensive hardware controllers.
- Works with standard webcams available on most devices.
- Uses advanced machine learning and computer vision techniques.
- Accurately detects gestures using hand tracking models.
- Steering controlled using hand direction.
- Acceleration and braking controlled through specific gestures.
- Smooth and responsive gesture mapping.
- Requires only a webcam and software.
- Makes gaming accessible for users who cannot afford controllers.
- Clean and interactive UI.
- Provides real-time visual feedback.
- Easy to set up and use.
- Python – Core programming language
- OpenCV – Webcam input and image processing
- MediaPipe – Hand tracking and gesture detection
- PyAutoGUI – Mapping gestures to keyboard/game controls
- Machine Learning Models – Gesture classification
- Frontend Technologies – HTML, CSS, JavaScript (Optional UI)
- The system captures video input from the webcam.
- MediaPipe detects and tracks hand landmarks.
- Gesture recognition algorithms analyze finger positions.
- Detected gestures are mapped to game controls.
- Commands are sent to the game in real time.
| Gesture | Game Control |
|---|---|
| Move Hand Left | Steer Left |
| Move Hand Right | Steer Right |
| Open Palm | Accelerate |
| Closed Fist | Brake |