narcissus29/motion-fighter-control — explained in plain English
Analysis updated 2026-05-18
Play a fighting game like TEKKEN 7 using hand gestures instead of a keyboard
Remap gesture to key bindings to control any other keyboard controlled game
Use a phone running a webcam app as the camera source for gesture tracking
| narcissus29/motion-fighter-control | 0-bingwu-0/live-interpreter | 0cm-labs/tokenizer-benchmark | |
|---|---|---|---|
| Stars | 2 | 2 | 2 |
| Language | Python | Python | Python |
| Setup difficulty | moderate | moderate | moderate |
| Complexity | 2/5 | 2/5 | 2/5 |
| Audience | general | general | researcher |
Figures from each repo's GitHub metadata at analysis time.
Needs a webcam and Python 3.9+, the camera overlay only works over windowed or borderless games.
This project lets you play keyboard controlled games using hand gestures captured by your webcam, instead of a physical controller or keyboard. It watches your hands through a camera using a hand tracking library called MediaPipe, then turns specific gestures into key presses. Making a fist with your left hand sends a left punch key, a fist with your right hand sends a right punch key, an open palm on either hand sends a kick key on that side, and moving both hands to the left or right sends direction keys for dashing or moving that way. The tool comes preconfigured for the fighting game TEKKEN 7, but the gesture to key mapping is stored in a simple JSON configuration file, so you can point it at any game that accepts keyboard input, not just fighting games. You install it with Python 3.9 or newer and a short pip install command, then run one script, or double click a Windows batch file to start it. A small camera window floats on top of your game window and shows your hands along with the gestures it detects, so you can see what the program is reading in real time. Setup includes automatic camera detection: if you have one webcam it is selected for you, and if you have several you get a list to choose from. This also works with phone camera apps used as webcams, such as Camo or DroidCam. Key sending starts disabled by default and only turns on after a short countdown, or when you press a key to arm it manually, which is meant as a safety measure so nothing gets typed before you are ready. You can remap which keys correspond to which gestures, adjust gesture sensitivity thresholds, and toggle features like double tap dashing for non fighting games. The camera overlay window only sits on top of games running in borderless or windowed display mode, not exclusive fullscreen. The project is released under the MIT license, meaning it is free to use, modify, and share.
A webcam tool that lets you control keyboard games with hand gestures, like fists for punches and open palms for kicks.
Mainly Python. The stack also includes Python, MediaPipe, pydirectinput.
Free to use, modify, and share for any purpose under the MIT license.
Setup difficulty is rated moderate, with roughly 30min to a first successful run.
Mainly general.
This repo across BitVibe Labs
Don't trust strangers blindly. Verify against the repo.