Neon Rail

The problem

The project explores how webcam movement can become responsive game input without sending video away from the player’s device. Camera input also needs to work for seated players and avoid reacting to noisy pose-tracking data.

The product response

Neon Rail combines a Three.js game with MediaPipe pose tracking in a Web Worker. It supports full-body and head-only camera controls, plus keyboard input; pose processing happens on-device, and the game makes no network requests after loading.

The project turns a familiar endless-runner loop into a physical interaction: jog to run, lean to change lanes, raise your hands to jump, or squat to slide.

Camera control is optional. Pose processing stays on the device, while keyboard controls work without downloading the camera models.

Scope and technology

Neon Rail is a three-lane browser game built with Three.js. Players can use a keyboard or enable webcam controls to run, change lanes, jump, and slide using body movement. Camera tracking runs locally in a Web Worker, and the game makes no network requests after it loads. It also includes a head-only control mode for seated play.

• Status: In Progress
• Engagement: BuiltbyGSV Lab
• Technology: Three.js, MediaPipe, JavaScript, Web Workers
• Year: 2026

Next steps

More accessibility options Additional control calibration New track themes Expanded device testing