README.md

metadata

title: Hand Visibility Detector
emoji: 🤚
colorFrom: pink
colorTo: gray
sdk: gradio
sdk_version: 6.15.1
app_file: app.py
short_description: Per-keypoint hand visibility estimation
python_version: '3.10'
startup_duration_timeout: 30m
models:
  - ryhara/hand-visibility-detector

🤚 Hand Visibility Detector

Per-keypoint visibility estimation for hands. Detect hands, estimate 3D pose (WiLoR-mini), and predict per-keypoint visibility.

Green keypoints = visible, Red keypoints = occluded.

How it works

1. Hand detection: A YOLO model detects hand bounding boxes.
2. 3D pose estimation: WiLoR-mini estimates 3D hand pose (MANO model).
3. Visibility estimation: A lightweight head on top of the WiLoR ViT backbone predicts per-keypoint visibility (21 keypoints).

Model

• ryhara/hand-visibility-detector — visibility head checkpoint
• warmshao/WiLoR-mini — hand detection and 3D pose model

Reference

• Paper: Hand Visibility Detector: Per-Keypoint Visibility Estimation for Hands
• GitHub: ryhara/hand_visibility_detector