53.3 GB
15,801 files
Updated 29 days ago
Name
Size
files
README.md2.6 kB
xet
meta.json6.59 MB
xet
README.md

kestrel dataset, public part

Video clips and precomputed RGB features. Every clip is named by a random UUID; meta.json at the bucket root lists them all.

files/<uuid>/video.mp4   source video (remuxed without re-encoding; container metadata removed)
files/<uuid>/rgb.npz     RGB features (numpy .npz, T = frames), absent for some clips
meta.json                clip index

rgb.npz arrays

name shape / dtype meaning
visual (T,3,1280) float32 SAM DINOv3-H+ pooled features of the body, left-hand, right-hand crops (zero when not visible)
face_rgb (T,128,128,3) uint8 RGB face crop
geometry (T,4,4) float32 per part [cx/width, cy/height, square_size/max(width,height), width/height]
visible (T,4) bool crop detected, columns = body, left_hand, right_hand, face
source_boxes (T,4,3) float32 per part square crop box [cx, cy, size] in source pixels
keypoints (T,17,3) float32 COCO-17 2D pose [x, y, confidence] (YOLO pose)
timestamps (T,) float32 decoded presentation time, seconds
frame_indices (T,) int64 frame index
fps () float32 frame rate

Left/right are the person's anatomical left/right (COCO wrists 9/10).

Videos

Each video.mp4 is a stream copy of the source: audio/video packets are unchanged, while file-level and stream-level metadata tags, chapters and user-data boxes were removed (leftover box space is a zero-filled free box). Frame counts, timing and resolution are unaffected.

meta.json

{"schema_version": 1, "dataset_version": "v1", "count": N,
 "valid_types": ["body", "left_hand", "right_hand", "face"],
 "target_types": ["pose", "expression", "camera", "identity", "scale"],
 "items": [{"uuid", "private_uuid", "split", "frames", "fps", "width", "height",
            "valid_frames": {"body": n, "left_hand": n, "right_hand": n, "face": n} | null,
            "target_valid_frames": {"pose": n, ...} | null,
            "files": {"video": path, "rgb": path | null}, "bytes": {"video": n, "rgb": n},
            "sha256": {"video": hex, "rgb": hex}}]}
  • split: train / val / test.
  • frames: number of video frames.
  • valid_frames[part]: frames where rgb.npz visible[:, part] is true; null when the clip has no rgb.npz.
  • target_valid_frames[type]: frames with at least one valid channel of that 3D body-model target type in the (non-public) training targets; null when the clip has no targets. Counts only.
  • private_uuid: identifier of the clip's non-public companion files; nothing under it is in this bucket.
Total size
53.3 GB
Files
15,801
Last updated
Oct 10
Pre-warmed CDN
US EU US EU

Contributors