| --- |
| license: apache-2.0 |
| tags: |
| - hand-pose |
| - keypoint-detection |
| - egocentric |
| --- |
| |
| # 2dhandpose |
|
|
| 2D hand keypoint estimation weights for egocentric video, trained by [Build AI](https://build.ai). |
|
|
| - `model.safetensors` — 0.43B-parameter ViT pose backbone (Sapiens-compatible architecture) with a 42-channel heatmap head. |
| - Input: monocular RGB frames. Output: one heatmap per hand keypoint. |
|
|
| ## Keypoint order (42 channels) |
|
|
| Channels 0–20 are the right hand, 21–41 the left hand. Within each hand: five fingers |
| (thumb, index, middle, ring, pinky), each as 4 points ordered fingertip → base (MCP), |
| followed by the wrist. |
|
|
| | channel | keypoint | |
| |---|---| |
| | 0–3 | right thumb, tip → MCP | |
| | 4–7 | right index, tip → MCP | |
| | 8–11 | right middle, tip → MCP | |
| | 12–15 | right ring, tip → MCP | |
| | 16–19 | right pinky, tip → MCP | |
| | 20 | right wrist | |
| | 21–24 | left thumb, tip → MCP | |
| | 25–28 | left index, tip → MCP | |
| | 29–32 | left middle, tip → MCP | |
| | 33–36 | left ring, tip → MCP | |
| | 37–40 | left pinky, tip → MCP | |
| | 41 | left wrist | |
|
|
| Skeleton: within each finger connect the 4 points in order; connect the wrist to each |
| finger's MCP (channels 3, 7, 11, 15, 19 for right; 24, 28, 32, 36, 40 for left). |
|
|
| ## Loading |
|
|
| The state dict follows the open-source [Sapiens](https://github.com/facebookresearch/sapiens) |
| pose layout (`backbone.*` ViT + `decode_head.*` deconv/conv heatmap head) with |
| `num_keypoints = 42`; any loader compatible with that code can consume it directly. |
|
|
