File size: 2,746 Bytes
2497a76 6851bf5 2497a76 6851bf5 4dac1bb 6851bf5 b09e745 992e61a decaa9d 6851bf5 992e61a 6851bf5 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 | ---
title: CaryX
emoji: ✋
colorFrom: indigo
colorTo: gray
sdk: static
pinned: false
---
<p align="center">
<picture>
<source media="(prefers-color-scheme: dark)" srcset="https://huggingface.co/spaces/CaryxAI/README/resolve/main/caryx-banner-dark-1500x500.png">
<source media="(prefers-color-scheme: light)" srcset="https://huggingface.co/spaces/CaryxAI/README/resolve/main/caryx-banner-light-1500x500.png">
<img alt="CaryX, real world data for physical AI" src="https://huggingface.co/spaces/CaryxAI/README/resolve/main/caryx-banner-light-1500x500.png" style="max-width:100%;" width="900">
</picture>
</p>
<p align="center">
<b>Densely labeled egocentric recordings of real human work, captured across homes and workplaces.</b>
</p>
<p align="center">
<a href="https://caryx.ai/data"><b>Browse the data in your browser</b></a>
· <a href="https://caryx.ai">caryx.ai</a>
· <a href="mailto:founders@caryx.ai">founders@caryx.ai</a>
</p>
---
## What is in every frame
We record and annotate our own footage, so a frame carries more than pixels.
| | |
|---|---|
| **RGB** | first person video of real work, not staged demonstrations |
| **Metric depth** | iPhone Pro LiDAR, in metres, not relative |
| **Camera pose** | 6-DoF per frame, from ARKit tracking |
| **Hand pose** | MANO joints for both hands |
| **Contact** | per hand and per object, with a validity flag on every value |
| **Segmentation** | hand and object masks |
| **Language** | dense sub step labels, time aligned |
Everything ships as [LeRobot v3.0](https://github.com/huggingface/lerobot), so it loads in
one line with no conversion step.
## Datasets
- **[everyday-manipulation-3d](https://huggingface.co/datasets/CaryxAI/everyday-manipulation-3d)**: the labeled corpus. 32 episodes packaged as LeRobot v3.0, every frame carrying metric depth, camera pose, MANO hand pose, per hand object contact, masks and time aligned language. CC BY NC SA 4.0, research use.
- **[everyday-manipulation-3d-raw](https://huggingface.co/datasets/CaryxAI/everyday-manipulation-3d-raw)**: 1,513 clips of everyday two handed manipulation, 10.28 hours, with synchronised RGB, metric LiDAR depth, ARKit camera pose and per frame intrinsics. CC BY 4.0, commercial use allowed with attribution.
- **[caryx-viewer-assets](https://huggingface.co/datasets/CaryxAI/caryx-viewer-assets)**: browser streaming previews behind the viewer at [caryx.ai/data](https://caryx.ai/data).
The annotated release, adding hand pose, contact and segmentation on top of
these clips, is in review. More collections are in production.
## Work with us
Custom collections, larger corpora, and commercial licensing:
**[founders@caryx.ai](mailto:founders@caryx.ai)**
|