Hand-Tracking AR Experience

A browser-based augmented reality experience enabling touchless interaction through real-time hand gesture recognition, rendered without native app dependencies.

Most AR experiences require a native app, external hardware, or heavy SDKs. The goal was to prove that expressive, gesture-driven 3D interaction could run directly inside a browser tab on a modern laptop.

MediaPipe's hand-landmark model was paired with a Three.js scene, webcam frames streamed through WebRTC, 21 hand keypoints mapped onto a WebGL overlay, and the render loop tuned so pose updates did not block painting.

• ·Real-time hand landmark detection
• ·21 keypoints mapped to a WebGL overlay
• ·Webcam frames streamed via WebRTC
• ·Render loop tuned so pose updates do not block painting

Gesture-driven 3D interaction running in a browser tab, no install, no native app.