Y·B← All projects
Hand tracking · HCI

A mouse you control with your hand

Point with your index finger to aim, and pinch your thumb and finger together to click. There are two versions:

This pageWeb version: pop the orbs

Runs in your browser. Point to move a cursor inside the box below and pinch to pop orbs. Browsers can't move your real mouse pointer, so it stays inside the page.

My MacDesktop version: drives the real cursor

A Python app that controls the actual macOS pointer: click, drag, scroll, right-click, pinch-to-zoom and an on-screen keyboard, all by hand.

▶
Demo clip of the Mac version, coming soon
popped 0best 0
no hand
Hold one hand up about an arm's length from the camera.
The pointing area centres on wherever your hand rests.
☝️ PointRaise your index finger to move the cursor.
🤏 PinchTouch your thumb to your index finger to click. The cursor freezes as you get close, so clicks land where you aim.
✊ FistPause the cursor so you can move your hand without it following. A fist never clicks.