Reading sign language from a webcam, 30 frames a second

Project

Sign Language Detection

Year

2026

A webcam sees a hand; the system has about 33 milliseconds to say what it means. MediaPipe extracts 21 landmarks per hand, then a feature layer turns those raw coordinates into 48 geometric descriptors — fingertip-to-wrist distances, inter-finger angles, hand orientation — so the classifier learns gesture shape rather than where the hand happened to sit in frame.

A random forest over those features hits 92-96% accuracy at roughly 1-2ms per inference. The harder problem was stability: frame-by-frame prediction flickers badly during fast movement, so a 5-frame majority vote smooths the output and suppresses the confident-but-wrong predictions that appear mid-gesture. Built end to end from scratch — no pretrained gesture model.

Scope of Work

Python
OpenCV
MediaPipe
scikit-learn
NumPy

See more of my work

Create a free website with Framer, the website builder loved by startups, designers and agencies.