Help & Documentation
Frequently Asked Questions
Everything you need to know about playing JamGroovin — from your first gesture to running a live jam session.
▶
Getting Started
What do I need to play?+
Just a device with a webcam and a modern browser (Chrome or Edge recommended). No downloads, no plugins, no special hardware. Your body is the instrument.
How do I start playing?+
Sign up for a free account, hit "Launch Studio", and allow camera access when prompted. Our tracking system will detect your body in real time — you can start playing immediately.
Does it work on mobile?+
Yes — JamGroovin is fully responsive. The studio works on modern iOS and Android browsers. For best performance use Chrome on Android or Safari 17+ on iOS.
Do I need to know music theory?+
No. Explorer Mode maps your gestures to notes that always sound good together. Advanced players can choose any scale, key, and octave from the FX Panel.
What browsers are supported?+
Chrome 110+, Edge 110+, and Firefox 120+ work best. Safari 17+ is supported. Older browsers may lack Web Audio or on-device tracking support.
Is my camera footage stored or shared?+
Never. All body tracking runs 100% locally in your browser using on-device tracking. No video frames are sent to any server.
◈
Gestures & Body Zones
How does gesture detection work?+
Our body tracking system follows 33 body landmarks, 21 hand landmarks per hand, and 468 face mesh points — all in real time at 30fps. JamGroovin maps these landmark positions to musical parameters like pitch, velocity, and filter cutoff.
What does each body zone control?+
Default mapping — you can reassign any zone in the Zone Panel:
- Left hand — sustained melody (wrist X = pitch, Y = filter brightness)
- Right hand — triggered notes per fingertip (5 independent voices)
- Left arm — Ethereal sweep
- Right arm — Laser trigger on fast sweep
- Torso / body — Pad sustained chord, lean forward to activate
- Left foot — Kick drum
- Right foot — Hi-hat
- Head nod — Choir accent note
How do I trigger a note with my hand?+
Move your fingertip into a new key zone. Notes fire on entry only — resting your hand in place will not retrigger the note. Each of your 5 fingertips is tracked independently so you can play chords.
Why does my foot trigger feel laggy?+
Ensure good lighting and step clearly into the camera frame. The foot zone detection uses ankle/heel landmarks so the lower half of your body must be visible. On slower machines, reduce the camera resolution in Settings.
Can I change which instrument each zone plays?+
Yes — open the Zone Panel (left sidebar) and use the dropdown next to each zone to assign any instrument, including drums. Changes apply instantly with no restart needed.
What is Mirror Mode?+
Mirror Mode flips the camera feed so it looks like a mirror. Hand landmark coordinates are also flipped internally so left/right zones remain correct. Toggle it from the TopBar or hamburger menu.
♪
Instruments & Sounds
What instruments are available?+
Sustained (hold while gesture active): Angel, Ethereal, Synth, Pad, Choir, Bass.
Triggered (fire on gesture entry): Crystal, Piano, Bell, Pluck, Marimba, Laser, Waves.
Percussion: Kick, Hi-hat, Snare — assignable to any zone.
Triggered (fire on gesture entry): Crystal, Piano, Bell, Pluck, Marimba, Laser, Waves.
Percussion: Kick, Hi-hat, Snare — assignable to any zone.
What are sustained vs triggered instruments?+
Sustained instruments play as long as you hold a gesture — raise your hand, hold the pose, note sustains. Lower your hand and it fades out over 0.55s. Triggered instruments fire a single note on entry and decay naturally.
Are the sounds synthesised or sampled?+
Both. Angel, Synth, Pad, Bass, Crystal, Bell, and Pluck are Web Audio synthesis. Choir, Ethereal, Laser, and Waves use real multi-samples sourced from the FluidR3 GM soundfont, stored locally in /public/audio/ for zero-latency offline playback.
How do I change the key or scale?+
Use the Key and Scale dropdowns in the TopBar (desktop) or hamburger menu (mobile). Supported scales include Major, Minor, Pentatonic, Blues, Dorian, Phrygian, Lydian, Mixolydian, Locrian, and Chromatic.
What does the Octave slider do?+
Sets the base octave (2–7) for all note calculations. Octave 4 is middle C. Higher octaves produce brighter tones; lower octaves give deeper, bass-register sounds.
◉
Virtual Instruments (Camera Mode)
What are Virtual Instruments?+
Virtual Instruments project a silhouette overlay onto your camera feed — drums, guitar, keyboard, or DJ controller. You physically interact with the overlay using your hands and body.
How do Virtual Drums work?+
Coloured drum pad zones are overlaid on your camera. Move your wrist into a zone to trigger that drum (kick, snare, hi-hat, tom, cymbal). Wrist-only detection means one physical hit = one sound, no multi-hit rebound.
How does the Virtual Guitar work?+
The screen is split: left strip (0–22% width) = chord selection. Move your left index finger up or down to pick one of 5 diatonic chords. Right area = strum zone — move your right hand up or down (like a real strum) to sound the chord. Supports Electric, Acoustic, and Classical tones.
How does the Virtual Keyboard work?+
A piano keyboard spans the bottom of the overlay. Each fingertip maps independently to a key — touch the key zone to play the note. All 5 fingers on both hands are tracked simultaneously (10 independent note voices). Entry-only detection means holding a key doesn't retrigger it.
How do I use the DJ Deck?+
Select DJ Deck from the Virtual dropdown. On the launch screen press Launch DJ Deck. Two full decks appear:
- Choose a genre pattern (House, Techno, DnB, Hip-Hop, Breaks, Afrobeat) per deck
- Hit PLAY on each deck — they loop independently
- Drag the crossfader to blend between decks
- Adjust 3-band EQ knobs (drag up/down, double-click to reset)
- Use pitch and volume faders per deck
- Your wrist position (left+right average) controls the crossfader via gesture
What genres does the DJ Deck support?+
House (128 BPM), Techno (138), Drum & Bass (174), Hip-Hop (90), Breaks (115), Afrobeat (105). Each pattern is rendered offline via WebAudio OfflineAudioContext and loops seamlessly.
◎
FX, Audio & BPM
What FX are available?+
Reverb (convolver, 2.5s impulse), Delay (BPM-synced, 0.26 feedback), Lowpass Filter (200Hz–15kHz), Distortion (waveshaper soft-clip). All apply globally to all instruments in the chain.
How do the quick presets work?+
Warm, Bright, Deep, and Gritty are one-tap macro presets that set reverb, delay, filter, and distortion to tuned combinations. You can further adjust any slider after applying a preset.
Where is the BPM control?+
In the FX Panel (right sidebar), below the Quick Presets section. Use the slider (40–220) or tap one of the speed buttons (80 / 100 / 120 / 140) to jump directly.
What is 8D Spatial Audio?+
It places a sound anywhere in a sphere around your head — above, below, behind, near or far — instead of just left and right. JamGroovin drives the Web Audio HRTF panner for direction, then adds the cues your ears actually use to judge distance: early reflections, floor and ceiling bounce, air absorption (distant sounds lose their top end) and a room level that rises as the source moves away. Enable the toggle in the FX Panel and pick a movement path.
What are the 8D movement paths?+
- Orbit — golden-ratio elevation; never repeats exactly
- Horizontal — classic left/right XZ sweep
- Vertical — sound sweeps over and under your head (YZ plane)
- Diagonal ↗↙ — rises while sweeping left to right
- Diagonal ↘↖ — the mirror of the above, falling as it sweeps
- Figure-8 — horizontal figure-eight + vertical wave
- Behind — sound drifts mostly behind your head with slow elevation
- Chaos — three incommensurable sine frequencies — fully unpredictable motion
All eight move on all three axes. Use headphones. Radius (1–8 m) sets how far the sound travels; Speed (1–20) sets how fast.
Why does 8D audio require headphones?+
HRTF (Head-Related Transfer Function) works by applying tiny frequency-dependent delays and filtering to each ear channel separately. Speakers mix both channels in the air before they reach your ears, which destroys that cue. On speakers you will hear the movement as ordinary left/right panning; the height, depth and behind-you cues need headphones.
Is 8D audio the same as binaural, or as Dolby Atmos?+
"8D audio" isn't a real format — it's a name that spread on YouTube for music panned in circles around your head. The technology underneath it is binaural: HRTF filtering that recreates how your head and ears colour sound arriving from a given direction. So 8D is a style, binaural is the method. Atmos is different again — an object-based cinema format that needs a compatible speaker layout or decoder. JamGroovin renders binaural HRTF live in your browser, so any pair of headphones works with no decoder and no special file.
▣
Beat Sequencer
What is the Beat Sequencer?+
A 16-step drum sequencer in the bottom bar with three tracks: Kick (amber), Hi-hat (teal), and Snare (purple). Steps are grouped into 4 bars. Toggle individual steps by clicking them, then hit Play.
How do I change BPM for the sequencer?+
The sequencer uses the global BPM set in the FX Panel. Step interval = (60 000 ms / BPM) / 4 (16th-note resolution).
What beat presets are available?+
Choose from the dropdown in the bottom bar:
- 4 on Floor — classic dance: kick every beat, snare on 2+4
- Jungle — syncopated kick, fast rolling hihat
- Modern Techno — four-on-floor kick, 16th hihat, off-beat snare
- Rock — classic backbeat, 8th-note hihat
- Slow Burn — sparse kick on 1+9, snare on 5+13
- Clear — all steps off
Can I combine the beat sequencer with virtual instruments?+
Yes — the beat sequencer runs independently alongside all virtual instruments and gesture zones. Start the sequencer then switch to Virtual Drums or Guitar and play over the top.
◆
Jam Sessions & Band Mode
How do I start a jam session?+
In the studio, click the JAM button in the TopBar. Choose "Create Room". Toggle public or private, add an optional room name, and share the 4-character room code with friends.
What is the difference between public and private sessions?+
Public sessions are listed on the JamGroovin homepage in real time — anyone can see them and join. Private sessions are invite-only; you share the room code directly with people you want to play with.
Do I need to be logged in to join a jam?+
Yes — login is required to join any jam session, public or private. Browsing public rooms on the homepage is open to everyone.
How does in-session chat work?+
Open the JAM modal while in a room. The Chat tab shows a scrollable message history (last 50 messages). Type your message and hit Enter or press Send. Messages appear instantly for all players in the room.
How many players can join a room?+
Band plan: up to 8 players. Studio plan: up to 20 players. All players hear each other via the shared socket sync — each person plays their own instrument locally and the session is synchronised in real time.
What plan do I need to create a public jam?+
Starter plan or higher required to create a jam room. Public or private is your choice at creation time. Free users can join existing public sessions.
◎
Microphone & Voice
How do I use the microphone?+
Select "Mic" from the Virtual dropdown in the TopBar. Allow microphone access when prompted. Click again to cycle through modes.
What mic modes are available?+
- Clean — your raw voice passed through to output
- Robot — vocoder-style pitch-lock effect for a robotic vocal
Selecting Mic from the dropdown cycles: Off → Clean → Robot → Off.
Can I use the mic alongside virtual instruments?+
Yes — the mic mode runs independently. You can have the Virtual Keyboard or Guitar active while your mic is on Clean or Robot.
⬡
AI Conductor
What does the AI Conductor do?+
The AI Conductor polls every 4 seconds, analyses what all players are doing (notes, tempo, density), and sends a musical snapshot to a Python API backed by our AI partner. The AI makes real-time musical decisions and applies them automatically.
What kinds of decisions can the conductor make?+
- SCALE_SHIFT — switches everyone to a more harmonically fitting scale
- KEY_CHANGE — modulates the global key
- TEMPO_NUDGE — gently adjusts BPM
- INSTRUMENT_SWAP — suggests a better instrument for a zone
- DYNAMIC_SHIFT — adjusts overall volume/density
- HARMONIC_RESCUE — corrects clashing harmony in real time
- ARRANGEMENT_HINT — gives a text cue to the players
Can I lock the conductor out?+
Yes — use the Lock toggle next to the AI Conductor button. When locked, the conductor continues to analyse but will not apply any changes.
Which plan includes the AI Conductor?+
Pro plan: scale + dynamic decisions. Band and Studio plans: full authority (all 7 decision types).
⏺
Recording
How do I record my performance?+
Click the Record button in the TopBar. The recording captures everything in the master audio chain — all instruments, FX, 8D audio, and the DJ mix. Click again to stop and download the file.
What format are recordings saved in?+
WebM audio (Opus codec) — plays in all modern browsers and media players. Convert to MP3 or WAV with any free tool like Audacity or CloudConvert.
How many recordings can I save?+
Free: no recording access. Pro: 10 recordings per month. Band and Studio: unlimited recordings.
🎚
Track Studio
Which plan do I need for Track Studio?+
Track Studio itself is open to every plan, including Free — you can record, import MP3 and MIDI, arrange, edit, use per-track 8D and fades, and export a WAV of the mix. What your plan changes is how big a song can get and which clean-up tools you have:
- Tracks per song — Free 2, Starter 4, Pro 8, Band 16, Studio unlimited
- Songs saved per month — Free 5, Starter 5, Pro 5, Band 20, Studio unlimited
- MIDI export and the AI Fix tools (Quantize, Smooth, Remove duplicates) — Pro and above
Note that 8D in the live FX Panel — the whole performance moving around your head as you play — is a Pro feature. The per-track 8D inside Track Studio is a separate control and is currently open to everyone.
What is Track Studio?+
Track Studio is JamGroovin's built-in multi-track recorder and editor — like a mini DAW right inside your browser. You can record gesture performances as tracks, import MP3/WAV audio files and MIDI files, arrange everything on a timeline, edit individual notes, and play everything back together. No extra software needed.
How do I record a track?+
Open the Track Studio panel at the bottom of the studio (click the ◆ Track Studio chevron). Pick an instrument from the dropdown, then hit REC. Play your gestures — every note you trigger is captured in real time. Hit STOP when done. You'll see your notes appear as dots on the track timeline.
How do I import an MP3 or audio file?+
Click the 🎧 Add Audio button in the Track Studio header. Select any MP3, WAV, OGG, or M4A file from your device. JamGroovin decodes it in your browser and adds it as an audio track — you'll see the waveform drawn on the timeline. Then you can record gesture tracks on top of it and play everything back together. Tip: import a favourite backing loop, then jam your instruments over it!
How do I import a MIDI file?+
Click the 🎵 MIDI ↑ button in the Track Studio header and choose a .mid or .midi file. JamGroovin's inline MIDI parser reads all tracks, creates one Track Studio track per MIDI channel, and assigns piano as the default instrument. You can then change each track's instrument using the dropdown in its controls row.
How do I move a track earlier or later in the song?+
Every track has ◀ start ▶ shift buttons in its controls row. Each click moves the track 0.25 seconds earlier or later. The offset indicator between the buttons shows the current start time (e.g. "+2.0s" means the track starts 2 seconds into the song). For audio tracks you can also drag the coloured handle on the left edge of the waveform to reposition it directly on the timeline.
How do I edit notes — move them, delete them, or cut a region?+
- Move a note: click and drag any dot on the timeline left or right.
- Delete a note: Shift+click a dot to remove it instantly.
- Cut a region: click ✂ Edit Region in the header, then click-drag on the timeline to highlight a time range. Click ✂ Cut to delete all notes in that range.
What does "Copy to New Track" do?+
After selecting a region with the ✂ Edit Region tool, clicking ⊕ Copy creates a brand new track containing only the notes from that highlighted section — with their timing reset to start at zero. Useful for extracting a motif or riff from a longer recording to loop or reuse.
How do I split a track into two?+
Use the ✂ Edit Region tool to drag a selection that starts where you want to split. Then click ⊣⊢ Split. The original track becomes everything before the split point, and a new track is created with everything from the split point onwards. Both tracks keep all their settings (instrument, volume, 8D etc.).
What are the AI Fix tools (Quantize, Smooth, Remove duplicates)?+
Available on Pro plan and above via the AI ✦ button on each track:
- Quantize 1/16 — snaps all note timings to the nearest 16th-note beat grid, tightening up sloppy timing.
- Smooth velocities — blends note volumes toward the track average, evening out accidental loud/soft hits.
- Remove duplicates — deletes any note that falls within 30ms of another on the same beat, cleaning up double-trigger accidents.
Can I use 8D spatial audio on individual tracks?+
Yes, and it's the full 8D engine, not a stereo wobble — every track gets its own HRTF orbit with genuine height and depth. Per track you can set:
- L / 8D↻ / 8D↺ / R — hard-pan left or right, or orbit clockwise or counter-clockwise. Two tracks can orbit in opposite directions at once.
- Speed and Depth — how fast it circles and how far away it sits. Depth changes tone, not just volume: distant sources lose top end and pick up room.
- 8D◄ / 360° / 8D► — lock the orbit to one ear while still moving near/far and up/down, or use the full sphere.
Each spatial track gets its own room, so tracks at different depths really do sit at different distances rather than sharing one wash.
Can a track change its 8D setting partway through the song?+
Yes — that's what the automation strip is for. Open it on a track, pick what you want to drop (Normal / 8D / L / R), then click the strip at the point in time where it should change. Drag a marker to retime it, click it to delete. A track can sit dry and centred through a verse, then start orbiting at the drop, then lock to one ear for the outro.
How do I fade a track in or out?+
Fades live on the same automation strip, so you choose where they happen rather than only at the track's two ends. Pick Fade In or Fade Out, set how long the ramp should take in the "over N s" box, then click the strip where it should start. You can drop as many as you like — a track can swell in, duck away under a vocal, and come back. The volume holds steady between ramps, and fades are included in the WAV export exactly as you hear them.
How do I save, reopen or delete a song?+
- Save Track layout — asks for a name and stores the arrangement (tracks, positions, trims, volumes, fades, 8D settings, BPM) to your account. Free saves 5 songs a month, Starter 5, Pro 5, Band 20, Studio unlimited.
- Load — lists your saved songs and reopens one. Each row has a bin icon to delete it from your library permanently.
- New — closes the current song and gives you an empty layout. It asks first if you have unsaved tracks.
I imported an MP3 — will it still be there when I reopen the song?+
On the same browser, yes. Saved songs are stored as an arrangement, not as audio — uploading everyone's MP3s isn't something we do — so JamGroovin keeps a copy of the files you import in your browser's own storage and re-attaches them to the right tracks automatically when you reopen the song.
If you open the song on a different computer, or you've cleared your browser storage, those tracks come back silent with an amber Re-link button. Click it, pick the file, and it drops straight back into that track — keeping its position, trim, volume, fades and 8D settings. Use Re-link rather than importing again, or you'll end up with a duplicate track.
How do I export the actual audio?+
- Save Audio — renders the real mix to a lossless .wav: every track, including imported MP3s, with volumes, fades, pans and all the 8D movement baked in. Songs made only of audio tracks render faster than realtime; songs containing gesture-recorded instrument tracks render in realtime instead.
- MIDI ↓ — a standard .mid file for any DAW (GarageBand, Ableton, Logic). Notes and timing only: imported audio tracks, volume, fades and 8D are not in a MIDI file. Requires Pro.
There is no MP3 export yet — WAV files of a long song are large, so expect a big download.
🪄
AR Face Filters
What AR filters are available?+
Three filters accessible from the 🪄 button in the top toolbar (camera must be active):
- Elton Glasses (🕶️) — huge rainbow-cycling circular frames sized to your real face, with tinted lenses, sparkle stars on the rims, a nose bridge, and side arms.
- Notes from Fingers (🎵) — colourful ♩♪♫♬ symbols float upward from your fingertips at ~8 per second while hands are detected.
- Notes from Mouth (🎤) — a stream of musical notes fans out from your mouth with a warm amber glow pulsing at the source.
How does the face tracking work for the AR effects?+
JamGroovin uses MediaPipe's 468-point face mesh. Eye positions, jaw width, and mouth position are derived from specific face mesh landmarks for accurate placement. The glasses and glow effects are sized from your real measured jaw width, not a fixed size — so they scale correctly whether you're close to or far from the camera.
Do AR filters affect recording or sharing?+
Yes — the overlay canvas that draws AR effects is composited into the recording. If you record while an AR filter is active, the effect appears in the downloaded clip.
Can I use AR filters alongside virtual backgrounds?+
Yes. AR filters draw on the overlay layer, while virtual backgrounds (galaxy, stage, etc.) replace your real background independently. Both can be active simultaneously.
◈
Account & Plans
What does the free plan include?+
Solo play with all instruments, beat sequencer, all virtual instruments (drums, guitar, keyboard, DJ), gesture detection, FX panel, and 8D audio. Band mode and recording require a paid plan.
Can I try paid features before subscribing?+
You can use the demo accounts to explore all plan levels — see the homepage footer or ask support for the credentials.
How do I change my plan?+
Go to Settings → Subscription. Upgrades take effect immediately. Downgrades apply at the end of your current billing period.
Is there a student or educator discount?+
Yes — email us with your institution email for 50% off Pro or Band plans. Studio plan classroom features are available to accredited music educators.
Ready to play?
No hardware needed. Just a webcam and a browser.