
Left hand
I
A browser hand gesture synthesizer: Gesture Synth turns webcam-tracked hands into live synth chords, filter motion, and expressive play.
Now playing
C4
M1 · beat 1 · 1 beat

Left hand
I

Right hand
Major
Gesture Synth
GestureSynth is a browser music game for camera-tracked performance. The left hand selects chord degrees and major or minor context, while the right hand shapes chord quality, octave, volume, and filter tone. The play page adds key selection, synth tone controls, and a live scale guide after you start camera tracking.
Select scale degrees with finger combinations, then use hand tilt to choose major or minor context.
Shape chord quality with finger count while hand position controls octave, volume, and filter tone.
Choose the musical key and synth tone, then follow the live scale guide after camera tracking starts.
Start simple
The fastest way to understand Gesture Synth is not to memorize every gesture at once. Start with one left-hand degree and one right-hand quality until a stable chord sounds. Then practice a short I-IV-V-I loop while keeping the right hand unchanged. This separates harmony selection from voicing and makes it much easier to see which hand caused a missed transition.
After the degree sequence is reliable, add major and minor wrist context, then experiment with inversions and seventh chords. Volume and filter movement come last. Treating expression as a separate layer keeps the camera-tracking problem small enough to diagnose while you are still learning the instrument.
Gesture Synth is designed around chord progressions rather than note-for-note score playback. A chord chart can be converted to Roman numerals such as I-V-vi-IV, then performed in any supported key with the same degree sequence. This makes the hand vocabulary reusable instead of forcing you to learn a different physical gesture for every chord name.
If the camera recognizes one hand inconsistently, fix framing and lighting before changing musical settings. Keep wrists and fingertips inside the frame, leave space between both hands, and hold a candidate gesture briefly. The dedicated troubleshooting and compatibility guides separate camera permission, landmark recognition, browser audio, and gesture-classification problems so you can test one cause at a time.
The browser-first design also keeps setup lightweight: there is no account to create, no plug-in to install, and no MIDI device required for the core experience. A webcam supplies the motion input and the browser generates the sound. That makes Gesture Synth useful as a quick practice instrument, a way to explore harmony through movement, or a technical demo of how hand-landmark tracking can become a musical interface without sending the live camera feed to an application server.
The documentation follows the same principle: each guide answers one concrete question, from camera permissions to chord mapping, so you can move from setup to practice without searching through unrelated product pages.
Gesture Synth is a browser music game for playing synth chords and shaping filter, volume, octave, and tone with webcam-based hand gestures.
You can explore the homepage preview without camera access. The full Gesture Synth game is designed around webcam-based hand tracking and asks for camera permission only after you start playing.
The left hand selects scale degrees such as I, II, III, IV, and V, while the right hand shapes chord quality, octave, volume, and tone.
The homepage requests no camera permission. The full game requests webcam access only after a user action and processes hand tracking locally in the browser.
The homepage never requests camera or microphone permission. The full game asks for webcam access only after a user action and keeps hand tracking local to the browser.
Read the privacy policy