TypeSight.app

—

Green: key matched to a detection in this frame. Magenta: key projected from the tracked pose (for example under a hand). Solid outlines are usable keys; dashed outlines are too uncertain to use. Red: detector boxes not assigned to any key. Hands: the same YOLO pass detects keys and the hand, then its hand box goes directly to MediaPipe's landmark-only model; the skeleton is cyan for left and amber for right, with fingertips T/I/M/R/P. The orange box is YOLO's detection and the dashed outline is its 1.5× landmark crop. Keep the camera still for the first few seconds while the keyboard layout is learned. Add ?backend=wasm to compare the CPU backend, ?handPipeline=separate for the previous second-YOLO path, or ?handPipeline=tasks for the original MediaPipe detector/tracker fallback.