README.md

---
title: Hand Visibility Detector
emoji: 🤚
colorFrom: pink
colorTo: gray
sdk: gradio
sdk_version: 6.15.1
app_file: app.py
short_description: Per-keypoint hand visibility estimation
python_version: "3.10"
startup_duration_timeout: 30m
models:
  - ryhara/hand-visibility-detector
---

# 🤚 Hand Visibility Detector

Per-keypoint visibility estimation for hands. Detect hands, estimate 3D pose (WiLoR-mini), and predict per-keypoint visibility.

**Green** keypoints = visible, **Red** keypoints = occluded.

## How it works

1. **Hand detection**: A YOLO model detects hand bounding boxes.
2. **3D pose estimation**: WiLoR-mini estimates 3D hand pose (MANO model).
3. **Visibility estimation**: A lightweight head on top of the WiLoR ViT backbone predicts per-keypoint visibility (21 keypoints).

## Model

- [ryhara/hand-visibility-detector](https://huggingface.co/ryhara/hand-visibility-detector) — visibility head checkpoint
- [warmshao/WiLoR-mini](https://huggingface.co/warmshao/WiLoR-mini) — hand detection and 3D pose model

## Reference

- Paper: [Hand Visibility Detector: Per-Keypoint Visibility Estimation for Hands](https://arxiv.org/abs/2608.11574)
- GitHub: [ryhara/hand_visibility_detector](https://github.com/ryhara/hand_visibility_detector)