Simplify release examples and trim README content

README.md

@@ -1,7 +1,6 @@
 ---
 library_name: transformers
 pipeline_tag: image-text-to-text
-base_model: Qwen/Qwen3-VL-30B-A3B-Instruct
 tags:
   - robotics
   - video-understanding
@@ -13,20 +12,13 @@ tags:
 
 VLAC-Cut is a video-language progress estimation model for robotic manipulation. Given a task description and a video, it predicts time-progress keypoints that can be aligned into a progress curve.
 
-This release contains the inference-ready model weights, tokenizer and processor files, three bundled demo episodes, reference prediction outputs, and minimal local inference utilities.
-
-## Model
-
-- Base model: `Qwen/Qwen3-VL-30B-A3B-Instruct`
-- Architecture: `Qwen3VLMoeForConditionalGeneration`
-- Recommended VLAC model type in local evaluation scripts: `qwen3_moe_vl`
-- Bundled quick start defaults to the `chunk_all` prompt and `2 Hz` video sampling
+This release contains the inference-ready model weights, tokenizer and processor files, three example videos, reference prediction outputs, and minimal local inference utilities.
 
 ## Highlights
 
 - Progress estimation for long-horizon manipulation videos
 - Rollback and regression recognition in non-expert trajectories
-- Bundled demos for both expert and non-expert episodes
+- Example videos from both expert and non-expert trajectories
 
 ## Use with Transformers
 
@@ -71,6 +63,6 @@ python quick_start/render_prediction_video.py \
   --input-jsonl quick_start/outputs/video.jsonl
 ```
 
-Bundled videos under `examples/` can be used with the same interface by passing the video path and prompt text directly.
+Videos under `examples/` can be used with the same interface by passing the video path and prompt text directly.
 
 More detailed usage is provided in `quick_start/README.md`.

examples/example_01/metadata.json

@@ -1,316 +0,0 @@
-{
-  "example_id": "example_01",
-  "bucket": "test_nonexpert_seen",
-  "global_episode_id": "ARX-data/human-data-1204-2cameras/20251130-162433-bad-purple cube-shaped building block/videos/chunk-000/observation.images.front/episode_000007",
-  "main_path": "ARX-data/human-data-1204-2cameras/20251130-162433-bad-purple cube-shaped building block/videos/chunk-000/observation.images.front/episode_000007",
-  "task_instruction": "抓取紫色方块使其从方形洞口落入积木桶中",
-  "task_description": "抓取紫色方块使其从方形洞口落入积木桶中：\n爪夹开始移动：0%\n爪夹接近紫色方块：20%\n爪夹抓紧紫色方块：40%\n爪夹抓紧紫色方块接近方形洞口：60%\n爪夹将紫色方块对准方形洞口：80%\n紫色方块从方形洞口落入积木桶中，爪夹移开：100%",
-  "fps": 30.0,
-  "is_expert": false,
-  "num_frames": 258,
-  "final_gt_progress": -10.0,
-  "video_path": "examples/example_01/episode.mp4",
-  "benchmark_progress_type": "dense_kinematic_progress",
-  "benchmark_dense_progress": [
-    0.0,
-    0.0,
-    0.0,
-    0.0,
-    0.0,
-    0.0,
-    0.0,
-    0.0,
-    0.0,
-    0.0,
-    0.0,
-    0.0,
-    0.0,
-    0.0,
-    0.0,
-    0.0,
-    0.0,
-    0.0,
-    0.0,
-    0.0,
-    0.0,
-    0.0,
-    0.0,
-    0.0,
-    0.0,
-    0.0,
-    0.0,
-    0.0,
-    0.0,
-    0.0,
-    0.0,
-    0.0,
-    0.0,
-    0.0,
-    0.0,
-    0.0,
-    0.0,
-    0.0,
-    0.0,
-    0.0,
-    0.0,
-    0.0,
-    0.0,
-    0.0,
-    0.0,
-    0.0,
-    0.0,
-    0.0,
-    0.0,
-    0.0,
-    0.2,
-    0.4,
-    0.6,
-    0.8,
-    1.0,
-    1.2,
-    1.4,
-    1.6,
-    1.8,
-    2.0,
-    2.2,
-    2.4,
-    2.6,
-    2.8,
-    3.0,
-    3.2,
-    3.4,
-    3.6,
-    3.8,
-    4.0,
-    4.2,
-    4.4,
-    4.6,
-    4.8,
-    5.0,
-    5.4,
-    5.8,
-    6.2,
-    6.5,
-    6.9,
-    7.3,
-    7.7,
-    8.1,
-    8.5,
-    8.8,
-    9.2,
-    9.6,
-    10.0,
-    10.1,
-    10.2,
-    10.3,
-    10.4,
-    10.5,
-    10.6,
-    10.7,
-    10.9,
-    11.0,
-    11.1,
-    11.2,
-    11.3,
-    11.4,
-    11.5,
-    11.6,
-    11.7,
-    11.8,
-    11.9,
-    12.0,
-    12.1,
-    12.2,
-    12.3,
-    12.4,
-    12.6,
-    12.7,
-    12.8,
-    12.9,
-    13.0,
-    13.1,
-    13.2,
-    13.3,
-    13.4,
-    13.5,
-    13.6,
-    13.7,
-    13.8,
-    13.9,
-    14.0,
-    14.1,
-    14.3,
-    14.4,
-    14.5,
-    14.6,
-    14.7,
-    14.8,
-    14.9,
-    15.0,
-    14.9,
-    14.9,
-    14.8,
-    14.8,
-    14.7,
-    14.7,
-    14.6,
-    14.6,
-    14.5,
-    14.5,
-    14.4,
-    14.4,
-    14.3,
-    14.3,
-    14.2,
-    14.2,
-    14.1,
-    14.1,
-    14.0,
-    14.0,
-    13.9,
-    13.9,
-    13.8,
-    13.8,
-    13.7,
-    13.7,
-    13.6,
-    13.6,
-    13.5,
-    13.5,
-    13.4,
-    13.4,
-    13.3,
-    13.3,
-    13.2,
-    13.2,
-    13.1,
-    13.1,
-    13.0,
-    10.8,
-    8.7,
-    6.5,
-    4.4,
-    2.2,
-    0.1,
-    -2.1,
-    -4.2,
-    -6.4,
-    -8.5,
-    -10.7,
-    -12.8,
-    -15.0,
-    -15.4,
-    -15.9,
-    -16.3,
-    -16.8,
-    -17.2,
-    -17.6,
-    -18.1,
-    -18.5,
-    -19.0,
-    -19.4,
-    -19.9,
-    -20.3,
-    -20.7,
-    -21.2,
-    -21.6,
-    -22.1,
-    -22.5,
-    -22.9,
-    -23.4,
-    -23.8,
-    -24.3,
-    -24.7,
-    -25.1,
-    -25.6,
-    -26.0,
-    -26.5,
-    -26.9,
-    -27.4,
-    -27.8,
-    -28.2,
-    -28.7,
-    -29.1,
-    -29.6,
-    -30.0,
-    -29.5,
-    -28.9,
-    -28.4,
-    -27.9,
-    -27.4,
-    -26.8,
-    -26.3,
-    -25.8,
-    -25.3,
-    -24.7,
-    -24.2,
-    -23.7,
-    -23.2,
-    -22.6,
-    -22.1,
-    -21.6,
-    -21.1,
-    -20.5,
-    -20.0,
-    -19.4,
-    -18.9,
-    -18.3,
-    -17.8,
-    -17.2,
-    -16.7,
-    -16.1,
-    -15.6,
-    -15.0,
-    -14.4,
-    -13.9,
-    -13.3,
-    -12.8,
-    -12.2,
-    -11.7,
-    -11.1,
-    -10.6,
-    -10.0
-  ],
-  "benchmark_semantic_anchors": [
-    {
-      "frame": 49,
-      "progress": 0.0
-    },
-    {
-      "frame": 74,
-      "progress": 5.0
-    },
-    {
-      "frame": 87,
-      "progress": 10.0
-    },
-    {
-      "frame": 134,
-      "progress": 15.0
-    },
-    {
-      "frame": 173,
-      "progress": 13.0
-    },
-    {
-      "frame": 186,
-      "progress": -15.0
-    },
-    {
-      "frame": 220,
-      "progress": -30.0
-    },
-    {
-      "frame": 239,
-      "progress": -20.0
-    },
-    {
-      "frame": 257,
-      "progress": -10.0
-    }
-  ],
-  "benchmark_progress_source": {
-    "bucket": "test_nonexpert_seen",
-    "global_episode_id": "ARX-data/human-data-1204-2cameras/20251130-162433-bad-purple cube-shaped building block/videos/chunk-000/observation.images.front/episode_000007"
-  }
-}

examples/example_02/metadata.json

@@ -1,335 +0,0 @@
-{
-  "example_id": "example_02",
-  "bucket": "test_nonexpert_unseen",
-  "global_episode_id": "ARX-data/human-data-1204-2cameras/20251128-183101-bad-onion-express-box/videos/chunk-000/observation.images.front/episode_000000",
-  "main_path": "ARX-data/human-data-1204-2cameras/20251128-183101-bad-onion-express-box/videos/chunk-000/observation.images.front/episode_000000",
-  "task_instruction": "把洋葱放进快递箱里。",
-  "task_description": "把洋葱放进快递箱里。\n开始移动:0%\n爪夹靠近洋葱:20%\n爪夹抓取洋葱:40%\n爪夹抓住洋葱接近快递箱:60%\n爪夹将洋葱放入快递箱:80%\n爪夹松开,洋葱落入快递箱:100%",
-  "fps": 30.0,
-  "is_expert": false,
-  "num_frames": 289,
-  "final_gt_progress": -10.0,
-  "video_path": "examples/example_02/episode.mp4",
-  "benchmark_progress_type": "dense_kinematic_progress",
-  "benchmark_dense_progress": [
-    0.0,
-    0.1,
-    0.3,
-    0.4,
-    0.6,
-    0.7,
-    0.9,
-    1.0,
-    1.1,
-    1.3,
-    1.4,
-    1.6,
-    1.7,
-    1.9,
-    2.0,
-    2.1,
-    2.3,
-    2.4,
-    2.6,
-    2.7,
-    2.9,
-    3.0,
-    3.1,
-    3.3,
-    3.4,
-    3.6,
-    3.7,
-    3.9,
-    4.0,
-    4.1,
-    4.3,
-    4.4,
-    4.6,
-    4.7,
-    4.9,
-    5.0,
-    5.1,
-    5.3,
-    5.4,
-    5.6,
-    5.7,
-    5.9,
-    6.0,
-    6.1,
-    6.3,
-    6.4,
-    6.6,
-    6.7,
-    6.9,
-    7.0,
-    7.1,
-    7.3,
-    7.4,
-    7.6,
-    7.7,
-    7.9,
-    8.0,
-    8.1,
-    8.3,
-    8.4,
-    8.6,
-    8.7,
-    8.9,
-    9.0,
-    9.1,
-    9.3,
-    9.4,
-    9.6,
-    9.7,
-    9.9,
-    10.0,
-    10.1,
-    10.3,
-    10.4,
-    10.5,
-    10.7,
-    10.8,
-    10.9,
-    11.1,
-    11.2,
-    11.3,
-    11.5,
-    11.6,
-    11.7,
-    11.9,
-    12.0,
-    12.1,
-    12.3,
-    12.4,
-    12.5,
-    12.7,
-    12.8,
-    12.9,
-    13.1,
-    13.2,
-    13.3,
-    13.5,
-    13.6,
-    13.7,
-    13.9,
-    14.0,
-    14.1,
-    14.3,
-    14.4,
-    14.5,
-    14.7,
-    14.8,
-    14.9,
-    15.1,
-    15.2,
-    15.3,
-    15.5,
-    15.6,
-    15.7,
-    15.9,
-    16.0,
-    16.1,
-    16.3,
-    16.4,
-    16.5,
-    16.7,
-    16.8,
-    16.9,
-    17.1,
-    17.2,
-    17.3,
-    17.5,
-    17.6,
-    17.7,
-    17.9,
-    18.0,
-    17.6,
-    17.2,
-    16.8,
-    16.4,
-    16.0,
-    15.6,
-    15.2,
-    14.8,
-    14.3,
-    13.9,
-    13.5,
-    13.1,
-    12.7,
-    12.3,
-    11.9,
-    11.5,
-    11.1,
-    10.7,
-    10.3,
-    9.9,
-    9.5,
-    9.1,
-    8.7,
-    8.2,
-    7.8,
-    7.4,
-    7.0,
-    6.6,
-    6.2,
-    5.8,
-    5.4,
-    5.0,
-    4.9,
-    4.7,
-    4.6,
-    4.5,
-    4.4,
-    4.2,
-    4.1,
-    4.0,
-    3.8,
-    3.7,
-    3.6,
-    3.5,
-    3.3,
-    3.2,
-    3.1,
-    2.9,
-    2.8,
-    2.7,
-    2.6,
-    2.4,
-    2.3,
-    2.2,
-    2.1,
-    1.9,
-    1.8,
-    1.7,
-    1.5,
-    1.4,
-    1.3,
-    1.2,
-    1.0,
-    0.9,
-    0.8,
-    0.6,
-    0.5,
-    0.4,
-    0.3,
-    0.1,
-    0.0,
-    -0.1,
-    -0.3,
-    -0.4,
-    -0.5,
-    -0.6,
-    -0.8,
-    -0.9,
-    -1.0,
-    -1.2,
-    -1.3,
-    -1.4,
-    -1.5,
-    -1.7,
-    -1.8,
-    -1.9,
-    -2.1,
-    -2.2,
-    -2.3,
-    -2.4,
-    -2.6,
-    -2.7,
-    -2.8,
-    -2.9,
-    -3.1,
-    -3.2,
-    -3.3,
-    -3.5,
-    -3.6,
-    -3.7,
-    -3.8,
-    -4.0,
-    -4.1,
-    -4.2,
-    -4.4,
-    -4.5,
-    -4.6,
-    -4.7,
-    -4.9,
-    -5.0,
-    -5.2,
-    -5.3,
-    -5.5,
-    -5.6,
-    -5.8,
-    -5.9,
-    -6.1,
-    -6.2,
-    -6.4,
-    -6.6,
-    -6.7,
-    -6.9,
-    -7.0,
-    -7.2,
-    -7.3,
-    -7.5,
-    -7.7,
-    -7.8,
-    -8.0,
-    -8.1,
-    -8.3,
-    -8.4,
-    -8.6,
-    -8.8,
-    -8.9,
-    -9.1,
-    -9.2,
-    -9.4,
-    -9.5,
-    -9.7,
-    -9.8,
-    -10.0,
-    -10.0,
-    -10.0,
-    -10.0,
-    -10.0,
-    -10.0,
-    -10.0,
-    -10.0,
-    -10.0,
-    -10.0,
-    -10.0,
-    -10.0,
-    -10.0,
-    -10.0,
-    -10.0,
-    -10.0,
-    -10.0
-  ],
-  "benchmark_semantic_anchors": [
-    {
-      "frame": 0,
-      "progress": 0.0
-    },
-    {
-      "frame": 70,
-      "progress": 10.0
-    },
-    {
-      "frame": 130,
-      "progress": 18.0
-    },
-    {
-      "frame": 162,
-      "progress": 5.0
-    },
-    {
-      "frame": 240,
-      "progress": -5.0
-    },
-    {
-      "frame": 272,
-      "progress": -10.0
-    }
-  ],
-  "benchmark_progress_source": {
-    "bucket": "test_nonexpert_unseen",
-    "global_episode_id": "ARX-data/human-data-1204-2cameras/20251128-183101-bad-onion-express-box/videos/chunk-000/observation.images.front/episode_000000"
-  }
-}

examples/example_03/metadata.json

@@ -1,20 +0,0 @@
-{
-  "example_id": "example_03",
-  "bucket": "test_expert_seen",
-  "global_episode_id": "ARX-data/human-data-0114/20260112-yuanshuaijun/20260111-204118-put-triangular-beaker-onto-tripod-good2/videos/chunk-000/observation.images.front/episode_000002",
-  "main_path": "ARX-data/human-data-0114/20260112-yuanshuaijun/20260111-204118-put-triangular-beaker-onto-tripod-good2/videos/chunk-000/observation.images.front/episode_000002",
-  "task_instruction": "将三角烧杯放在三脚架上。",
-  "task_description": "将三角烧杯放在三脚架上。\n爪夹准备移动：0%\n爪夹开始移动：10%\n爪夹靠近三角烧杯：20%\n爪夹抓取三角烧杯：40%\n爪夹合拢并靠近三脚架：60%\n爪夹移动到三脚架的正上方：80%\n爪夹松开，三角烧杯落在三脚架上：100%",
-  "fps": 30.0,
-  "is_expert": true,
-  "num_frames": 172,
-  "final_gt_progress": 100.0,
-  "video_path": "examples/example_03/episode.mp4",
-  "benchmark_progress_type": "dense_kinematic_progress",
-  "benchmark_dense_progress": [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 1.2, 2.5, 3.8, 5.0, 6.2, 7.5, 8.8, 10.0, 10.7, 11.4, 12.1, 12.9, 13.6, 14.3, 15.0, 15.7, 16.4, 17.1, 17.9, 18.6, 19.3, 20.0, 20.5, 21.0, 21.5, 22.0, 22.5, 23.0, 23.5, 24.0, 24.5, 25.0, 25.5, 26.0, 26.5, 27.0, 27.5, 28.0, 28.5, 29.0, 29.5, 30.0, 30.6, 31.1, 31.7, 32.2, 32.8, 33.3, 33.9, 34.4, 35.0, 35.6, 36.1, 36.7, 37.2, 37.8, 38.3, 38.9, 39.4, 40.0, 40.5, 41.0, 41.4, 41.9, 42.4, 42.9, 43.3, 43.8, 44.3, 44.8, 45.2, 45.7, 46.2, 46.7, 47.1, 47.6, 48.1, 48.6, 49.0, 49.5, 50.0, 50.4, 50.8, 51.2, 51.7, 52.1, 52.5, 52.9, 53.3, 53.8, 54.2, 54.6, 55.0, 55.4, 55.8, 56.2, 56.7, 57.1, 57.5, 57.9, 58.3, 58.8, 59.2, 59.6, 60.0, 61.1, 62.1, 63.2, 64.2, 65.3, 66.3, 67.4, 68.4, 69.5, 70.5, 71.6, 72.6, 73.7, 74.7, 75.8, 76.8, 77.9, 78.9, 80.0, 80.7, 81.5, 82.2, 83.0, 83.7, 84.4, 85.2, 85.9, 86.7, 87.4, 88.1, 88.9, 89.6, 90.4, 91.1, 91.9, 92.6, 93.3, 94.1, 94.8, 95.6, 96.3, 97.0, 97.8, 98.5, 99.3, 100.0, 100.0, 100.0, 100.0, 100.0, 100.0, 100.0, 100.0, 100.0, 100.0, 100.0, 100.0, 100.0],
-  "benchmark_semantic_anchors": [{"frame": 8, "progress": 0.0}, {"frame": 16, "progress": 10.0}, {"frame": 30, "progress": 20.0}, {"frame": 50, "progress": 30.0}, {"frame": 68, "progress": 40.0}, {"frame": 89, "progress": 50.0}, {"frame": 113, "progress": 60.0}, {"frame": 132, "progress": 80.0}, {"frame": 159, "progress": 100.0}],
-  "benchmark_progress_source": {
-    "bucket": "test_expert_seen",
-    "global_episode_id": "ARX-data/human-data-0114/20260112-yuanshuaijun/20260111-204118-put-triangular-beaker-onto-tripod-good2/videos/chunk-000/observation.images.front/episode_000002"
-  }
-}

examples/examples_manifest.json

@@ -1,25 +0,0 @@
-{
-  "examples": [
-    {
-      "example_id": "example_01",
-      "bucket": "test_nonexpert_seen",
-      "task_instruction": "抓取紫色方块使其从方形洞口落入积木桶中",
-      "video_path": "examples/example_01/episode.mp4",
-      "metadata_path": "examples/example_01/metadata.json"
-    },
-    {
-      "example_id": "example_02",
-      "bucket": "test_nonexpert_unseen",
-      "task_instruction": "把洋葱放进快递箱里。",
-      "video_path": "examples/example_02/episode.mp4",
-      "metadata_path": "examples/example_02/metadata.json"
-    },
-    {
-      "example_id": "example_03",
-      "bucket": "test_expert_seen",
-      "task_instruction": "将三角烧杯放在三脚架上。",
-      "video_path": "examples/example_03/episode.mp4",
-      "metadata_path": "examples/example_03/metadata.json"
-    }
-  ]
-}

examples/reference_outputs/example_01.jsonl

@@ -1 +1 @@
-{"example_id": "example_01", "bucket": "test_nonexpert_seen", "global_episode_id": "ARX-data/human-data-1204-2cameras/20251130-162433-bad-purple cube-shaped building block/videos/chunk-000/observation.images.front/episode_000007", "task_instruction": "抓取紫色方块使其从方形洞口落入积木桶中", "task_description": "抓取紫色方块使其从方形洞口落入积木桶中：\n爪夹开始移动：0%\n爪夹接近紫色方块：20%\n爪夹抓紧紫色方块：40%\n爪夹抓紧紫色方块接近方形洞口：60%\n爪夹将紫色方块对准方形洞口：80%\n紫色方块从方形洞口落入积木桶中，爪夹移开：100%", "prompt_variant": "chunk_all", "input_sample_hz": 2.0, "input_frame_indices_2hz": [0, 15, 30, 45, 60, 75, 90, 105, 120, 135, 150, 165, 180, 195, 210, 225, 240, 255], "input_timestamps_sec_2hz": [0.0, 0.5, 1.0, 1.5, 2.0, 2.5, 3.0, 3.5, 4.0, 4.5, 5.0, 5.5, 6.0, 6.5, 7.0, 7.5, 8.0, 8.5], "input_frame_count_2hz": 18, "decoded_video_stats": {"decoded_frame_count": 258.0, "decoded_avg_fps": 30.0}, "prompt": "任务描述和具体规划: 抓取紫色方块使其从方形洞口落入积木桶中\n爪夹开始移动：0%\n爪夹接近紫色方块：20%\n爪夹抓紧紫色方块：40%\n爪夹抓紧紫色方块接近方形洞口：60%\n爪夹将紫色方块对准方形洞口：80%\n紫色方块从方形洞口落入积木桶中，爪夹移开：100%\n\n请根据任务描述和具体规划，找到并逐点生成视频中的关键动作点和相应的进度标注。输出格式要求：每个关键点一行，格式为：\n时间: X.Xs, 进度: Y%\n\n请严格按照上述格式输出，不要输出额外说明。", "response": "时间: 1.3s, 进度: 0%\n时间: 2.7s, 进度: 10%\n时间: 3.7s, 进度: 15%\n时间: 5.5s, 进度: 10%\n时间: 6.3s, 进度: -15%\n时间: 7.1s, 进度: -25%\n时间: 8.0s, 进度: -15%", "pred_curve_parse_ok": true, "pred_curve_point_times_sec": [1.3, 2.7, 3.7, 5.5, 6.3, 7.1, 8.0], "pred_curve_point_progress": [0.0, 10.0, 15.0, 10.0, -15.0, -25.0, -15.0], "video_path": "examples/example_01/episode.mp4", "preview_video_path": "examples/reference_outputs/example_01_pred_progress.mp4"}
+{"task_instruction": "抓取紫色方块使其从方形洞口落入积木桶中", "task_plan": "爪夹开始移动：0%\n爪夹接近紫色方块：20%\n爪夹抓紧紫色方块：40%\n爪夹抓紧紫色方块接近方形洞口：60%\n爪夹将紫色方块对准方形洞口：80%\n紫色方块从方形洞口落入积木桶中，爪夹移开：100%", "video_path": "examples/example_01/episode.mp4", "prompt_source": "task_instruction_plus_plan", "prompt_variant": "chunk_all", "input_sample_hz": 2.0, "input_frame_indices": [0, 15, 30, 45, 60, 75, 90, 105, 120, 135, 150, 165, 180, 195, 210, 225, 240, 255], "input_timestamps_sec": [0.0, 0.5, 1.0, 1.5, 2.0, 2.5, 3.0, 3.5, 4.0, 4.5, 5.0, 5.5, 6.0, 6.5, 7.0, 7.5, 8.0, 8.5], "input_frame_count": 18, "decoded_video_stats": {"decoded_frame_count": 258.0, "decoded_avg_fps": 30.0, "decoded_duration_sec": 8.566667}, "prompt": "任务描述和具体规划: 抓取紫色方块使其从方形洞口落入积木桶中\n爪夹开始移动：0%\n爪夹接近紫色方块：20%\n爪夹抓紧紫色方块：40%\n爪夹抓紧紫色方块接近方形洞口：60%\n爪夹将紫色方块对准方形洞口：80%\n紫色方块从方形洞口落入积木桶中，爪夹移开：100%\n\n请根据任务描述和具体规划，找到并逐点生成视频中的关键动作点和相应的进度标注。输出格式要求：每个关键点一行，格式为：\n时间: X.Xs, 进度: Y%\n\n请严格按照上述格式输出，不要输出额外说明。", "response": "时间: 1.3s, 进度: 0%\n时间: 2.7s, 进度: 10%\n时间: 3.7s, 进度: 15%\n时间: 5.5s, 进度: 10%\n时间: 6.3s, 进度: -15%\n时间: 7.1s, 进度: -25%\n时间: 8.0s, 进度: -15%", "pred_curve_parse_ok": true, "pred_curve_point_times_sec": [1.3, 2.7, 3.7, 5.5, 6.3, 7.1, 8.0], "pred_curve_point_progress": [0.0, 10.0, 15.0, 10.0, -15.0, -25.0, -15.0], "preview_video_path": "examples/reference_outputs/example_01_pred_progress.mp4"}

examples/reference_outputs/example_02.jsonl

@@ -1 +1 @@
-{"example_id": "example_02", "bucket": "test_nonexpert_unseen", "global_episode_id": "ARX-data/human-data-1204-2cameras/20251128-183101-bad-onion-express-box/videos/chunk-000/observation.images.front/episode_000000", "task_instruction": "把洋葱放进快递箱里。", "task_description": "把洋葱放进快递箱里。\n开始移动:0%\n爪夹靠近洋葱:20%\n爪夹抓取洋葱:40%\n爪夹抓住洋葱接近快递箱:60%\n爪夹将洋葱放入快递箱:80%\n爪夹松开,洋葱落入快递箱:100%", "prompt_variant": "chunk_all", "input_sample_hz": 2.0, "input_frame_indices_2hz": [0, 15, 30, 45, 60, 75, 90, 105, 120, 135, 150, 165, 180, 195, 210, 225, 240, 255, 270, 285], "input_timestamps_sec_2hz": [0.0, 0.5, 1.0, 1.5, 2.0, 2.5, 3.0, 3.5, 4.0, 4.5, 5.0, 5.5, 6.0, 6.5, 7.0, 7.5, 8.0, 8.5, 9.0, 9.5], "input_frame_count_2hz": 20, "decoded_video_stats": {"decoded_frame_count": 289.0, "decoded_avg_fps": 30.0}, "prompt": "任务描述和具体规划: 把洋葱放进快递箱里。\n开始移动:0%\n爪夹靠近洋葱:20%\n爪夹抓取洋葱:40%\n爪夹抓住洋葱接近快递箱:60%\n爪夹将洋葱放入快递箱:80%\n爪夹松开,洋葱落入快递箱:100%\n\n请根据任务描述和具体规划，找到并逐点生成视频中的关键动作点和相应的进度标注。输出格式要求：每个关键点一行，格式为：\n时间: X.Xs, 进度: Y%\n\n请严格按照上述格式输出，不要输出额外说明。", "response": "时间: 0.0s, 进度: 0%\n时间: 2.3s, 进度: 5%\n时间: 3.3s, 进度: 8%\n时间: 4.3s, 进度: 10%\n时间: 5.1s, 进度: -5%\n时间: 6.1s, 进度: -8%\n时间: 7.1s, 进度: -2%\n时间: 8.3s, 进度: 2%\n时间: 9.5s, 进度: 4%", "pred_curve_parse_ok": true, "pred_curve_point_times_sec": [0.0, 2.3, 3.3, 4.3, 5.1, 6.1, 7.1, 8.3, 9.5], "pred_curve_point_progress": [0.0, 5.0, 8.0, 10.0, -5.0, -8.0, -2.0, 2.0, 4.0], "video_path": "examples/example_02/episode.mp4", "preview_video_path": "examples/reference_outputs/example_02_pred_progress.mp4"}
+{"task_instruction": "把洋葱放进快递箱里。", "task_plan": "开始移动:0%\n爪夹靠近洋葱:20%\n爪夹抓取洋葱:40%\n爪夹抓住洋葱接近快递箱:60%\n爪夹将洋葱放入快递箱:80%\n爪夹松开,洋葱落入快递箱:100%", "video_path": "examples/example_02/episode.mp4", "prompt_source": "task_instruction_plus_plan", "prompt_variant": "chunk_all", "input_sample_hz": 2.0, "input_frame_indices": [0, 15, 30, 45, 60, 75, 90, 105, 120, 135, 150, 165, 180, 195, 210, 225, 240, 255, 270, 285], "input_timestamps_sec": [0.0, 0.5, 1.0, 1.5, 2.0, 2.5, 3.0, 3.5, 4.0, 4.5, 5.0, 5.5, 6.0, 6.5, 7.0, 7.5, 8.0, 8.5, 9.0, 9.5], "input_frame_count": 20, "decoded_video_stats": {"decoded_frame_count": 289.0, "decoded_avg_fps": 30.0, "decoded_duration_sec": 9.6}, "prompt": "任务描述和具体规划: 把洋葱放进快递箱里。\n开始移动:0%\n爪夹靠近洋葱:20%\n爪夹抓取洋葱:40%\n爪夹抓住洋葱接近快递箱:60%\n爪夹将洋葱放入快递箱:80%\n爪夹松开,洋葱落入快递箱:100%\n\n请根据任务描述和具体规划，找到并逐点生成视频中的关键动作点和相应的进度标注。输出格式要求：每个关键点一行，格式为：\n时间: X.Xs, 进度: Y%\n\n请严格按照上述格式输出，不要输出额外说明。", "response": "时间: 0.0s, 进度: 0%\n时间: 2.3s, 进度: 5%\n时间: 3.3s, 进度: 8%\n时间: 4.3s, 进度: 10%\n时间: 5.1s, 进度: -5%\n时间: 6.1s, 进度: -8%\n时间: 7.1s, 进度: -2%\n时间: 8.3s, 进度: 2%\n时间: 9.5s, 进度: 4%", "pred_curve_parse_ok": true, "pred_curve_point_times_sec": [0.0, 2.3, 3.3, 4.3, 5.1, 6.1, 7.1, 8.3, 9.5], "pred_curve_point_progress": [0.0, 5.0, 8.0, 10.0, -5.0, -8.0, -2.0, 2.0, 4.0], "preview_video_path": "examples/reference_outputs/example_02_pred_progress.mp4"}

examples/reference_outputs/example_03.jsonl

@@ -1 +1 @@
-{"example_id": "example_03", "bucket": "test_expert_seen", "global_episode_id": "ARX-data/human-data-0114/20260112-yuanshuaijun/20260111-204118-put-triangular-beaker-onto-tripod-good2/videos/chunk-000/observation.images.front/episode_000002", "task_instruction": "将三角烧杯放在三脚架上。", "task_description": "将三角烧杯放在三脚架上。\n爪夹准备移动：0%\n爪夹开始移动：10%\n爪夹靠近三角烧杯：20%\n爪夹抓取三角烧杯：40%\n爪夹合拢并靠近三脚架：60%\n爪夹移动到三脚架的正上方：80%\n爪夹松开，三角烧杯落在三脚架上：100%", "prompt_variant": "chunk_all", "input_sample_hz": 2.0, "input_frame_indices_2hz": [0, 15, 30, 45, 60, 75, 90, 105, 120, 135, 150, 165], "input_timestamps_sec_2hz": [0.0, 0.5, 1.0, 1.5, 2.0, 2.5, 3.0, 3.5, 4.0, 4.5, 5.0, 5.5], "input_frame_count_2hz": 12, "decoded_video_stats": {"decoded_frame_count": 172.0, "decoded_avg_fps": 30.0}, "prompt": "任务描述和具体规划: 将三角烧杯放在三脚架上。\n爪夹准备移动：0%\n爪夹开始移动：10%\n爪夹靠近三角烧杯：20%\n爪夹抓取三角烧杯：40%\n爪夹合拢并靠近三脚架：60%\n爪夹移动到三脚架的正上方：80%\n爪夹松开，三角烧杯落在三脚架上：100%\n\n请根据任务描述和具体规划，找到并逐点生成视频中的关键动作点和相应的进度标注。输出格式要求：每个关键点一行，格式为：\n时间: X.Xs, 进度: Y%\n\n请严格按照上述格式输出，不要输出额外说明。", "response": "时间: 0.1s, 进度: 0%\n时间: 0.6s, 进度: 10%\n时间: 1.1s, 进度: 20%\n时间: 1.6s, 进度: 30%\n时间: 2.3s, 进度: 40%\n时间: 3.4s, 进度: 60%\n时间: 4.1s, 进度: 80%\n时间: 5.3s, 进度: 100%", "pred_curve_parse_ok": true, "pred_curve_point_times_sec": [0.1, 0.6, 1.1, 1.6, 2.3, 3.4, 4.1, 5.3], "pred_curve_point_progress": [0.0, 10.0, 20.0, 30.0, 40.0, 60.0, 80.0, 100.0], "video_path": "examples/example_03/episode.mp4", "preview_video_path": "examples/reference_outputs/example_03_pred_progress.mp4"}
+{"task_instruction": "将三角烧杯放在三脚架上。", "task_plan": "爪夹准备移动：0%\n爪夹开始移动：10%\n爪夹靠近三角烧杯：20%\n爪夹抓取三角烧杯：40%\n爪夹合拢并靠近三脚架：60%\n爪夹移动到三脚架的正上方：80%\n爪夹松开，三角烧杯落在三脚架上：100%", "video_path": "examples/example_03/episode.mp4", "prompt_source": "task_instruction_plus_plan", "prompt_variant": "chunk_all", "input_sample_hz": 2.0, "input_frame_indices": [0, 15, 30, 45, 60, 75, 90, 105, 120, 135, 150, 165], "input_timestamps_sec": [0.0, 0.5, 1.0, 1.5, 2.0, 2.5, 3.0, 3.5, 4.0, 4.5, 5.0, 5.5], "input_frame_count": 12, "decoded_video_stats": {"decoded_frame_count": 172.0, "decoded_avg_fps": 30.0, "decoded_duration_sec": 5.7}, "prompt": "任务描述和具体规划: 将三角烧杯放在三脚架上。\n爪夹准备移动：0%\n爪夹开始移动：10%\n爪夹靠近三角烧杯：20%\n爪夹抓取三角烧杯：40%\n爪夹合拢并靠近三脚架：60%\n爪夹移动到三脚架的正上方：80%\n爪夹松开，三角烧杯落在三脚架上：100%\n\n请根据任务描述和具体规划，找到并逐点生成视频中的关键动作点和相应的进度标注。输出格式要求：每个关键点一行，格式为：\n时间: X.Xs, 进度: Y%\n\n请严格按照上述格式输出，不要输出额外说明。", "response": "时间: 0.1s, 进度: 0%\n时间: 0.6s, 进度: 10%\n时间: 1.1s, 进度: 20%\n时间: 1.6s, 进度: 30%\n时间: 2.3s, 进度: 40%\n时间: 3.4s, 进度: 60%\n时间: 4.1s, 进度: 80%\n时间: 5.3s, 进度: 100%", "pred_curve_parse_ok": true, "pred_curve_point_times_sec": [0.1, 0.6, 1.1, 1.6, 2.3, 3.4, 4.1, 5.3], "pred_curve_point_progress": [0.0, 10.0, 20.0, 30.0, 40.0, 60.0, 80.0, 100.0], "preview_video_path": "examples/reference_outputs/example_03_pred_progress.mp4"}

quick_start/README.md

@@ -2,8 +2,8 @@
 
 This quick start has two steps:
 
-1. Run progress inference on a video and write one JSONL output.
-2. Render a prediction-only preview video from that JSONL output.
+1. Run progress inference on a video. Optionally save one JSONL output.
+2. Render a prediction-only preview video from a saved JSONL output.
 
 ## Requirements
 
@@ -48,7 +48,7 @@ python quick_start/render_prediction_video.py \
   --output-video quick_start/outputs/video_pred_progress.mp4
 ```
 
-## Bundled Examples
+## Example Commands
 
 `example_01`