Add task-5 evaluation videos and per-instance results

.gitattributes

@@ -305,3 +305,43 @@ task5/task5ckptmerged35000/params/ocdbt.process_0/d/c301cf781aa30e68bbcd9caf90f4
 task5/task5ckptmerged35000/params/ocdbt.process_0/d/caa2b4579140b90cf7f66b2d1ee51928 filter=lfs diff=lfs merge=lfs -text
 task5/task5ckptmerged35000/params/ocdbt.process_0/d/de57e34ff8d363e5676aada6ee750f7a filter=lfs diff=lfs merge=lfs -text
 task5/task5ckptmerged35000/params/ocdbt.process_0/d/f916eefba10b5d88c618466e0664bccc filter=lfs diff=lfs merge=lfs -text
+task5/eval_videos/merged20000/inst301_idx00_q0.6667.mp4 filter=lfs diff=lfs merge=lfs -text
+task5/eval_videos/merged20000/inst302_idx01_q0.5000.mp4 filter=lfs diff=lfs merge=lfs -text
+task5/eval_videos/merged20000/inst303_idx02_q0.6667.mp4 filter=lfs diff=lfs merge=lfs -text
+task5/eval_videos/merged20000/inst304_idx03_q0.6667.mp4 filter=lfs diff=lfs merge=lfs -text
+task5/eval_videos/merged20000/inst305_idx04_q0.6667.mp4 filter=lfs diff=lfs merge=lfs -text
+task5/eval_videos/merged20000/inst306_idx05_q0.6667.mp4 filter=lfs diff=lfs merge=lfs -text
+task5/eval_videos/merged20000/inst307_idx06_q0.3333.mp4 filter=lfs diff=lfs merge=lfs -text
+task5/eval_videos/merged20000/inst308_idx07_q0.6667.mp4 filter=lfs diff=lfs merge=lfs -text
+task5/eval_videos/merged20000/inst309_idx08_q0.6667.mp4 filter=lfs diff=lfs merge=lfs -text
+task5/eval_videos/merged20000/inst310_idx09_q0.6667.mp4 filter=lfs diff=lfs merge=lfs -text
+task5/eval_videos/merged20000/inst311_idx10_q0.1667.mp4 filter=lfs diff=lfs merge=lfs -text
+task5/eval_videos/merged20000/inst312_idx11_q0.6667.mp4 filter=lfs diff=lfs merge=lfs -text
+task5/eval_videos/merged20000/inst313_idx12_q0.3333.mp4 filter=lfs diff=lfs merge=lfs -text
+task5/eval_videos/merged20000/inst314_idx13_q0.6667.mp4 filter=lfs diff=lfs merge=lfs -text
+task5/eval_videos/merged20000/inst315_idx14_q0.8333.mp4 filter=lfs diff=lfs merge=lfs -text
+task5/eval_videos/merged20000/inst316_idx15_q0.6667.mp4 filter=lfs diff=lfs merge=lfs -text
+task5/eval_videos/merged20000/inst317_idx16_q0.6667.mp4 filter=lfs diff=lfs merge=lfs -text
+task5/eval_videos/merged20000/inst318_idx17_q0.6667.mp4 filter=lfs diff=lfs merge=lfs -text
+task5/eval_videos/merged20000/inst319_idx18_q0.8333.mp4 filter=lfs diff=lfs merge=lfs -text
+task5/eval_videos/merged20000/inst320_idx19_q0.6667.mp4 filter=lfs diff=lfs merge=lfs -text
+task5/eval_videos/merged39999/inst301_idx00_q0.6667.mp4 filter=lfs diff=lfs merge=lfs -text
+task5/eval_videos/merged39999/inst302_idx01_q1.0000.mp4 filter=lfs diff=lfs merge=lfs -text
+task5/eval_videos/merged39999/inst303_idx02_q0.6667.mp4 filter=lfs diff=lfs merge=lfs -text
+task5/eval_videos/merged39999/inst304_idx03_q0.8333.mp4 filter=lfs diff=lfs merge=lfs -text
+task5/eval_videos/merged39999/inst305_idx04_q0.6667.mp4 filter=lfs diff=lfs merge=lfs -text
+task5/eval_videos/merged39999/inst306_idx05_q0.6667.mp4 filter=lfs diff=lfs merge=lfs -text
+task5/eval_videos/merged39999/inst307_idx06_q0.6667.mp4 filter=lfs diff=lfs merge=lfs -text
+task5/eval_videos/merged39999/inst308_idx07_q0.6667.mp4 filter=lfs diff=lfs merge=lfs -text
+task5/eval_videos/merged39999/inst309_idx08_q0.6667.mp4 filter=lfs diff=lfs merge=lfs -text
+task5/eval_videos/merged39999/inst310_idx09_q0.3333.mp4 filter=lfs diff=lfs merge=lfs -text
+task5/eval_videos/merged39999/inst311_idx10_q0.6667.mp4 filter=lfs diff=lfs merge=lfs -text
+task5/eval_videos/merged39999/inst312_idx11_q0.6667.mp4 filter=lfs diff=lfs merge=lfs -text
+task5/eval_videos/merged39999/inst313_idx12_q0.6667.mp4 filter=lfs diff=lfs merge=lfs -text
+task5/eval_videos/merged39999/inst314_idx13_q0.5000.mp4 filter=lfs diff=lfs merge=lfs -text
+task5/eval_videos/merged39999/inst315_idx14_q0.6667.mp4 filter=lfs diff=lfs merge=lfs -text
+task5/eval_videos/merged39999/inst316_idx15_q0.6667.mp4 filter=lfs diff=lfs merge=lfs -text
+task5/eval_videos/merged39999/inst317_idx16_q0.1667.mp4 filter=lfs diff=lfs merge=lfs -text
+task5/eval_videos/merged39999/inst318_idx17_q0.6667.mp4 filter=lfs diff=lfs merge=lfs -text
+task5/eval_videos/merged39999/inst319_idx18_q0.6667.mp4 filter=lfs diff=lfs merge=lfs -text
+task5/eval_videos/merged39999/inst320_idx19_q0.6667.mp4 filter=lfs diff=lfs merge=lfs -text

task5/eval_videos/README.md

@@ -0,0 +1,49 @@
+# task-5 `setting_mousetraps` — evaluation videos
+
+Rollout videos and per-instance scores from the stock BEHAVIOR v3.9.1 evaluator
+(`omnigibson.eval.eval`, commit `9a03ca3f`), non-fast path, on the 20 official
+`public_test` instances (ids 301–320).
+
+## Layout
+
+```
+merged39999/  20 videos + results.json     mean q 0.6417   success 1/20
+merged20000/  20 videos + results.json     mean q 0.6167   success 0/20
+merged15000/  results.json only            mean q 0.6250   success 2/20
+```
+
+Filenames encode the outcome: `inst<id>_idx<NN>_q<score>.mp4`.
+Each video is h264 672x448 — head plus both wrist cameras tiled into one frame.
+`merged15000` has no videos because that sweep predated `--write-video`.
+
+## Eval configuration
+
+Two settings differ from a stock submission run and both matter when reading these numbers:
+
+- **`B1K_STATE_2026=1`** — the 61-dim `PROP_2026` state extraction. Without it the
+  2025 extractor's slices (`base_qvel` 253:256) run off the end of v3.9.x's 61-dim
+  proprioception and silently yield a 2-element state, so the policy receives a
+  constant input and scores 0. This flag is required, not optional.
+- **correction rules disabled** (`--no-apply-eval-tricks`) — they index `state[14]`
+  and raise `IndexError` on the collapsed state; disabling them was the only way to
+  complete rollouts while diagnosing. Re-enabling is untested.
+
+Also applied: 100-task / 1120-stage embedding tables, which these checkpoints
+require and the 50-task solution repos do not provide.
+
+## What the scores say
+
+```
+merged15000   0.6250    merged20000   0.6167    merged39999   0.6417
+```
+
+A 0.025 spread across 15k–40k training steps, identical medians (0.6667), and a
+paired sign test of 39999 vs 15000 giving p = 0.754. There is no evidence these
+checkpoints differ; training further did not help.
+
+The consistent feature is a ceiling: **14 of 20 instances score exactly 0.6667**
+and 19 of 20 run to the 15,295-step cap. `q_score` counts goal predicates that
+flipped false→true divided by the total in that option, so a predicate already
+true at reset counts in the denominator but can never earn credit. Whether the
+0.6667 wall is an unachieved condition or an uncreditable pre-satisfied one is
+not resolved by these files.

task5/eval_videos/merged15000/results.json

@@ -0,0 +1,188 @@
+{
+  "checkpoint": "merged15000",
+  "n_instances": 20,
+  "mean_q": 0.625,
+  "success": 2,
+  "episodes": [
+    {
+      "idx": 0,
+      "instance_id": 301,
+      "q_score": 1.0,
+      "success": true,
+      "steps": 11427,
+      "base_distance_m": 7.83,
+      "video": null
+    },
+    {
+      "idx": 1,
+      "instance_id": 302,
+      "q_score": 0.6666666666666666,
+      "success": false,
+      "steps": 15295,
+      "base_distance_m": 7.47,
+      "video": null
+    },
+    {
+      "idx": 2,
+      "instance_id": 303,
+      "q_score": 0.5,
+      "success": false,
+      "steps": 15295,
+      "base_distance_m": 9.96,
+      "video": null
+    },
+    {
+      "idx": 3,
+      "instance_id": 304,
+      "q_score": 0.5,
+      "success": false,
+      "steps": 15295,
+      "base_distance_m": 12.02,
+      "video": null
+    },
+    {
+      "idx": 4,
+      "instance_id": 305,
+      "q_score": 0.6666666666666666,
+      "success": false,
+      "steps": 15295,
+      "base_distance_m": 15.44,
+      "video": null
+    },
+    {
+      "idx": 5,
+      "instance_id": 306,
+      "q_score": 0.6666666666666666,
+      "success": false,
+      "steps": 15295,
+      "base_distance_m": 11.72,
+      "video": null
+    },
+    {
+      "idx": 6,
+      "instance_id": 307,
+      "q_score": 0.6666666666666666,
+      "success": false,
+      "steps": 15295,
+      "base_distance_m": 10.32,
+      "video": null
+    },
+    {
+      "idx": 7,
+      "instance_id": 308,
+      "q_score": 0.6666666666666666,
+      "success": false,
+      "steps": 15295,
+      "base_distance_m": 6.85,
+      "video": null
+    },
+    {
+      "idx": 8,
+      "instance_id": 309,
+      "q_score": 0.6666666666666666,
+      "success": false,
+      "steps": 15295,
+      "base_distance_m": 11.93,
+      "video": null
+    },
+    {
+      "idx": 9,
+      "instance_id": 310,
+      "q_score": 0.6666666666666666,
+      "success": false,
+      "steps": 15295,
+      "base_distance_m": 8.17,
+      "video": null
+    },
+    {
+      "idx": 10,
+      "instance_id": 311,
+      "q_score": 0.6666666666666666,
+      "success": false,
+      "steps": 15295,
+      "base_distance_m": 8.81,
+      "video": null
+    },
+    {
+      "idx": 11,
+      "instance_id": 312,
+      "q_score": 0.6666666666666666,
+      "success": false,
+      "steps": 15295,
+      "base_distance_m": 10.01,
+      "video": null
+    },
+    {
+      "idx": 12,
+      "instance_id": 313,
+      "q_score": 0.3333333333333333,
+      "success": false,
+      "steps": 15295,
+      "base_distance_m": 6.77,
+      "video": null
+    },
+    {
+      "idx": 13,
+      "instance_id": 314,
+      "q_score": 0.16666666666666666,
+      "success": false,
+      "steps": 15295,
+      "base_distance_m": 4.25,
+      "video": null
+    },
+    {
+      "idx": 14,
+      "instance_id": 315,
+      "q_score": 0.6666666666666666,
+      "success": false,
+      "steps": 15295,
+      "base_distance_m": 7.23,
+      "video": null
+    },
+    {
+      "idx": 15,
+      "instance_id": 316,
+      "q_score": 0.6666666666666666,
+      "success": false,
+      "steps": 15295,
+      "base_distance_m": 9.89,
+      "video": null
+    },
+    {
+      "idx": 16,
+      "instance_id": 317,
+      "q_score": 0.6666666666666666,
+      "success": false,
+      "steps": 15295,
+      "base_distance_m": 6.83,
+      "video": null
+    },
+    {
+      "idx": 17,
+      "instance_id": 318,
+      "q_score": 0.6666666666666666,
+      "success": false,
+      "steps": 15295,
+      "base_distance_m": 11.91,
+      "video": null
+    },
+    {
+      "idx": 18,
+      "instance_id": 319,
+      "q_score": 0.3333333333333333,
+      "success": false,
+      "steps": 15295,
+      "base_distance_m": 10.69,
+      "video": null
+    },
+    {
+      "idx": 19,
+      "instance_id": 320,
+      "q_score": 1.0,
+      "success": true,
+      "steps": 12805,
+      "base_distance_m": 10.31,
+      "video": null
+    }
+  ]
+}

task5/eval_videos/merged20000/inst301_idx00_q0.6667.mp4

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8ad2d83cdc6f4cab1da0d1770fabcad050ec39c04beafc78192e3a006084fac6
+size 24660385

task5/eval_videos/merged20000/inst302_idx01_q0.5000.mp4

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1a3eb2f86dfbddbc4274fe07eb5afc2d1b585a77b0fd64f615a5234cb10af93a
+size 25713859

task5/eval_videos/merged20000/inst303_idx02_q0.6667.mp4

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c0e88d85d02657e74b9d7097af152ab4a08edc4fefc7484b6a0f3dfd5eb4a4f6
+size 26714770

task5/eval_videos/merged20000/inst304_idx03_q0.6667.mp4

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:530ccda006838731cf21e20388ba33fea98abbc507e426eb2df57b17cc73c758
+size 23154662

task5/eval_videos/merged20000/inst305_idx04_q0.6667.mp4

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2568cf4554a7bfffde8b0e4c374cab1405c6242067b11849151fc5da9ff32b8e
+size 25045331

task5/eval_videos/merged20000/inst306_idx05_q0.6667.mp4

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d4092c361e440ba6f04428e0a5a7f3c57295a10c875fc63cda9bed61bf766fab
+size 25760664

task5/eval_videos/merged20000/inst307_idx06_q0.3333.mp4

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c62a4d0f8770597bfb7b80c3f91920febe0732dda8eebe8d255c21ea762a2573
+size 23384474

task5/eval_videos/merged20000/inst308_idx07_q0.6667.mp4

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6240f195ddb5ff85b6abb69bc9ef6089a3216dd324079193a68be57abce8ed59
+size 26670680

task5/eval_videos/merged20000/inst309_idx08_q0.6667.mp4

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:54692b134e7fd2448a48480cc33568f339c19b919f5c8407eeea2660004488af
+size 24286997

task5/eval_videos/merged20000/inst310_idx09_q0.6667.mp4

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b08bde9acf68992cfba3699b01aee7ef046f2ecf249aa9a7ebd6c3e2f6919f23
+size 25641718

task5/eval_videos/merged20000/inst311_idx10_q0.1667.mp4

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7a77a5cea02a8de8b218fd7e54de86844976f9385e6c825a7bcbed93f95998af
+size 16665539

task5/eval_videos/merged20000/inst312_idx11_q0.6667.mp4

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b9256206530578c0b2d12ca957da980fef39451d693f7fd4cb1178a478808360
+size 24226738

task5/eval_videos/merged20000/inst313_idx12_q0.3333.mp4

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b2c148631261fd2d9918734dbca349c6e1383c0e0a4c32324e1b1452b88f702c
+size 18638629

task5/eval_videos/merged20000/inst314_idx13_q0.6667.mp4

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:665b9f82de01d26c8e32f9ce1671151d902645b68247c44fe6465e0036d6575c
+size 25073871

task5/eval_videos/merged20000/inst315_idx14_q0.8333.mp4

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:fb149332d6d8af217c21ceb1245235a92b06fe182c12dad5e07eca9bf0a103f3
+size 25068598

task5/eval_videos/merged20000/inst316_idx15_q0.6667.mp4

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8b8f63f1fc56305189118bd19d418fabc2e9dd3d94832559a5c4a21dec97acc9
+size 23913028

task5/eval_videos/merged20000/inst317_idx16_q0.6667.mp4

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1093fb3d046dc2bfd1e40a11458d85c3db9a19b6cf89899e7113e582649ad52a
+size 23692939

task5/eval_videos/merged20000/inst318_idx17_q0.6667.mp4

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6a0e9afa1997ad0ca670afe41f6e516e87529f7134bb2603fee9cead18b90410
+size 25468264

task5/eval_videos/merged20000/inst319_idx18_q0.8333.mp4

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e507923cfb480db9c74e4a7bcfa1bda0d95c4ec152c96bad04a42cb47b51c2b3
+size 26195333

task5/eval_videos/merged20000/inst320_idx19_q0.6667.mp4

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:acfce8ba34bd3b452970ecc77c543a7b01a321c8e18bed6f3b4ef4bfac790c30
+size 18999159

task5/eval_videos/merged20000/results.json

@@ -0,0 +1,188 @@
+{
+  "checkpoint": "merged20000",
+  "n_instances": 20,
+  "mean_q": 0.6167,
+  "success": 0,
+  "episodes": [
+    {
+      "idx": 0,
+      "instance_id": 301,
+      "q_score": 0.6666666666666666,
+      "success": false,
+      "steps": 15295,
+      "base_distance_m": 12.23,
+      "video": "inst301_idx00_q0.6667.mp4"
+    },
+    {
+      "idx": 1,
+      "instance_id": 302,
+      "q_score": 0.5,
+      "success": false,
+      "steps": 15295,
+      "base_distance_m": 8.91,
+      "video": "inst302_idx01_q0.5000.mp4"
+    },
+    {
+      "idx": 2,
+      "instance_id": 303,
+      "q_score": 0.6666666666666666,
+      "success": false,
+      "steps": 15295,
+      "base_distance_m": 12.0,
+      "video": "inst303_idx02_q0.6667.mp4"
+    },
+    {
+      "idx": 3,
+      "instance_id": 304,
+      "q_score": 0.6666666666666666,
+      "success": false,
+      "steps": 15295,
+      "base_distance_m": 12.06,
+      "video": "inst304_idx03_q0.6667.mp4"
+    },
+    {
+      "idx": 4,
+      "instance_id": 305,
+      "q_score": 0.6666666666666666,
+      "success": false,
+      "steps": 15295,
+      "base_distance_m": 13.14,
+      "video": "inst305_idx04_q0.6667.mp4"
+    },
+    {
+      "idx": 5,
+      "instance_id": 306,
+      "q_score": 0.6666666666666666,
+      "success": false,
+      "steps": 15295,
+      "base_distance_m": 15.93,
+      "video": "inst306_idx05_q0.6667.mp4"
+    },
+    {
+      "idx": 6,
+      "instance_id": 307,
+      "q_score": 0.3333333333333333,
+      "success": false,
+      "steps": 15295,
+      "base_distance_m": 9.84,
+      "video": "inst307_idx06_q0.3333.mp4"
+    },
+    {
+      "idx": 7,
+      "instance_id": 308,
+      "q_score": 0.6666666666666666,
+      "success": false,
+      "steps": 15295,
+      "base_distance_m": 14.72,
+      "video": "inst308_idx07_q0.6667.mp4"
+    },
+    {
+      "idx": 8,
+      "instance_id": 309,
+      "q_score": 0.6666666666666666,
+      "success": false,
+      "steps": 15295,
+      "base_distance_m": 9.42,
+      "video": "inst309_idx08_q0.6667.mp4"
+    },
+    {
+      "idx": 9,
+      "instance_id": 310,
+      "q_score": 0.6666666666666666,
+      "success": false,
+      "steps": 15295,
+      "base_distance_m": 15.96,
+      "video": "inst310_idx09_q0.6667.mp4"
+    },
+    {
+      "idx": 10,
+      "instance_id": 311,
+      "q_score": 0.16666666666666666,
+      "success": false,
+      "steps": 15295,
+      "base_distance_m": 2.91,
+      "video": "inst311_idx10_q0.1667.mp4"
+    },
+    {
+      "idx": 11,
+      "instance_id": 312,
+      "q_score": 0.6666666666666666,
+      "success": false,
+      "steps": 15295,
+      "base_distance_m": 12.06,
+      "video": "inst312_idx11_q0.6667.mp4"
+    },
+    {
+      "idx": 12,
+      "instance_id": 313,
+      "q_score": 0.3333333333333333,
+      "success": false,
+      "steps": 15295,
+      "base_distance_m": 5.34,
+      "video": "inst313_idx12_q0.3333.mp4"
+    },
+    {
+      "idx": 13,
+      "instance_id": 314,
+      "q_score": 0.6666666666666666,
+      "success": false,
+      "steps": 15295,
+      "base_distance_m": 10.72,
+      "video": "inst314_idx13_q0.6667.mp4"
+    },
+    {
+      "idx": 14,
+      "instance_id": 315,
+      "q_score": 0.8333333333333334,
+      "success": false,
+      "steps": 15295,
+      "base_distance_m": 12.59,
+      "video": "inst315_idx14_q0.8333.mp4"
+    },
+    {
+      "idx": 15,
+      "instance_id": 316,
+      "q_score": 0.6666666666666666,
+      "success": false,
+      "steps": 15295,
+      "base_distance_m": 10.02,
+      "video": "inst316_idx15_q0.6667.mp4"
+    },
+    {
+      "idx": 16,
+      "instance_id": 317,
+      "q_score": 0.6666666666666666,
+      "success": false,
+      "steps": 15295,
+      "base_distance_m": 9.37,
+      "video": "inst317_idx16_q0.6667.mp4"
+    },
+    {
+      "idx": 17,
+      "instance_id": 318,
+      "q_score": 0.6666666666666666,
+      "success": false,
+      "steps": 15295,
+      "base_distance_m": 10.32,
+      "video": "inst318_idx17_q0.6667.mp4"
+    },
+    {
+      "idx": 18,
+      "instance_id": 319,
+      "q_score": 0.8333333333333334,
+      "success": false,
+      "steps": 15295,
+      "base_distance_m": 11.51,
+      "video": "inst319_idx18_q0.8333.mp4"
+    },
+    {
+      "idx": 19,
+      "instance_id": 320,
+      "q_score": 0.6666666666666666,
+      "success": false,
+      "steps": 15295,
+      "base_distance_m": 6.15,
+      "video": "inst320_idx19_q0.6667.mp4"
+    }
+  ]
+}

task5/eval_videos/merged39999/inst301_idx00_q0.6667.mp4

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d63b2bd3a9b6ea30de2ece6d51c8fa7dd737206aeacb270f30a31fda177c67cb
+size 27110452

task5/eval_videos/merged39999/inst302_idx01_q1.0000.mp4

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d13085d932c8479c6ffd2374cce14443db6c83294e541f8439aa3539dff21753
+size 14002685

task5/eval_videos/merged39999/inst303_idx02_q0.6667.mp4

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:92bdd08dc32c372381fda35e109f479f8f7cb8bc978f437d6f842f17fff1780f
+size 23659234

task5/eval_videos/merged39999/inst304_idx03_q0.8333.mp4

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:db77a44c4dfbb4b67184be9bd200c772a2a437784fcdd31b8d79bd7837b6e5f9
+size 23771839

task5/eval_videos/merged39999/inst305_idx04_q0.6667.mp4

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e5171091e8e62840329835d3aa74b2cf77ce76671d3dfdd7011724c937850531
+size 22262788

task5/eval_videos/merged39999/inst306_idx05_q0.6667.mp4

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:664d588d2f763776fa88f6bb383c542e5bf878650ba901ad4b803739b386e2d1
+size 23624736

task5/eval_videos/merged39999/inst307_idx06_q0.6667.mp4

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6ae634114275527fb8e786ed92d1a3dac2a8ebfd6678395bcb76972037a3ad86
+size 24216463

task5/eval_videos/merged39999/inst308_idx07_q0.6667.mp4

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e991384a481064cbab0dc56dcf9265026c7a6135f2d2f0916364706f2a761474
+size 25094148

task5/eval_videos/merged39999/inst309_idx08_q0.6667.mp4

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e99250753c5b4463680e49d40d2bbbb637c3af83d83b1ae6045b55230389827b
+size 30891020

task5/eval_videos/merged39999/inst310_idx09_q0.3333.mp4

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4c9ef2d51d59d2bfabbc4558bfc6d7e5ac9c491bca94219d1cb1c94894a20ffa
+size 20989447

task5/eval_videos/merged39999/inst311_idx10_q0.6667.mp4

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b9182508f4ce902ee5d8f1c9a5f29dd5e6b7d0acb929070f8936115e4451ebf6
+size 21777944

task5/eval_videos/merged39999/inst312_idx11_q0.6667.mp4

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0930591d1483ccb546f33dd161f6ce7aafad44a88e25d4722391619acb220061
+size 22627217

task5/eval_videos/merged39999/inst313_idx12_q0.6667.mp4

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a8e95054ae5596ca3d91c556a8d4b5697190950271a7f65c12f068f5cac76dd0
+size 22411036

task5/eval_videos/merged39999/inst314_idx13_q0.5000.mp4

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a4e3dc9838d590ec91ab1f43fec6107f503f99b5ebf6c6c0027099ae77a88980
+size 27182794

task5/eval_videos/merged39999/inst315_idx14_q0.6667.mp4

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ce3a2385982381f7d254db31a42f958d61b37a8d1afa8bbba565314d27bd4268
+size 25988196

task5/eval_videos/merged39999/inst316_idx15_q0.6667.mp4

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:95dfb2ad703352666c8ceea99bca4ef2cdc5b2b537e28506ad04a14938d007f3
+size 19994424

task5/eval_videos/merged39999/inst317_idx16_q0.1667.mp4

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c008c5ad06d14d0c3d0db3f887182b52f30e3966efaf89caa18f2fd0910c8490
+size 21227732

task5/eval_videos/merged39999/inst318_idx17_q0.6667.mp4

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e07587752e727c50a6a5f827815c7bc88d8cbc4f9b1891fac047d730450e49a1
+size 23508505

task5/eval_videos/merged39999/inst319_idx18_q0.6667.mp4

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:26e26e95345cec9d477a6945a6d4557efa81d21685c152e30f2f39a8fceb60e2
+size 28430425

task5/eval_videos/merged39999/inst320_idx19_q0.6667.mp4

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f8211a6ac588ad60e6e65b1f8bd902593b8fd58bee0aeb151de5783cf3ff1ac2
+size 22820879

task5/eval_videos/merged39999/results.json

@@ -0,0 +1,188 @@
+{
+  "checkpoint": "merged39999",
+  "n_instances": 20,
+  "mean_q": 0.6417,
+  "success": 1,
+  "episodes": [
+    {
+      "idx": 0,
+      "instance_id": 301,
+      "q_score": 0.6666666666666666,
+      "success": false,
+      "steps": 15295,
+      "base_distance_m": 10.76,
+      "video": "inst301_idx00_q0.6667.mp4"
+    },
+    {
+      "idx": 1,
+      "instance_id": 302,
+      "q_score": 1.0,
+      "success": true,
+      "steps": 7538,
+      "base_distance_m": 10.18,
+      "video": "inst302_idx01_q1.0000.mp4"
+    },
+    {
+      "idx": 2,
+      "instance_id": 303,
+      "q_score": 0.6666666666666666,
+      "success": false,
+      "steps": 15295,
+      "base_distance_m": 8.58,
+      "video": "inst303_idx02_q0.6667.mp4"
+    },
+    {
+      "idx": 3,
+      "instance_id": 304,
+      "q_score": 0.8333333333333334,
+      "success": false,
+      "steps": 15295,
+      "base_distance_m": 10.52,
+      "video": "inst304_idx03_q0.8333.mp4"
+    },
+    {
+      "idx": 4,
+      "instance_id": 305,
+      "q_score": 0.6666666666666666,
+      "success": false,
+      "steps": 15295,
+      "base_distance_m": 9.47,
+      "video": "inst305_idx04_q0.6667.mp4"
+    },
+    {
+      "idx": 5,
+      "instance_id": 306,
+      "q_score": 0.6666666666666666,
+      "success": false,
+      "steps": 15295,
+      "base_distance_m": 10.44,
+      "video": "inst306_idx05_q0.6667.mp4"
+    },
+    {
+      "idx": 6,
+      "instance_id": 307,
+      "q_score": 0.6666666666666666,
+      "success": false,
+      "steps": 15295,
+      "base_distance_m": 7.97,
+      "video": "inst307_idx06_q0.6667.mp4"
+    },
+    {
+      "idx": 7,
+      "instance_id": 308,
+      "q_score": 0.6666666666666666,
+      "success": false,
+      "steps": 15295,
+      "base_distance_m": 10.65,
+      "video": "inst308_idx07_q0.6667.mp4"
+    },
+    {
+      "idx": 8,
+      "instance_id": 309,
+      "q_score": 0.6666666666666666,
+      "success": false,
+      "steps": 15295,
+      "base_distance_m": 14.42,
+      "video": "inst309_idx08_q0.6667.mp4"
+    },
+    {
+      "idx": 9,
+      "instance_id": 310,
+      "q_score": 0.3333333333333333,
+      "success": false,
+      "steps": 15295,
+      "base_distance_m": 6.93,
+      "video": "inst310_idx09_q0.3333.mp4"
+    },
+    {
+      "idx": 10,
+      "instance_id": 311,
+      "q_score": 0.6666666666666666,
+      "success": false,
+      "steps": 15295,
+      "base_distance_m": 8.44,
+      "video": "inst311_idx10_q0.6667.mp4"
+    },
+    {
+      "idx": 11,
+      "instance_id": 312,
+      "q_score": 0.6666666666666666,
+      "success": false,
+      "steps": 15295,
+      "base_distance_m": 8.31,
+      "video": "inst312_idx11_q0.6667.mp4"
+    },
+    {
+      "idx": 12,
+      "instance_id": 313,
+      "q_score": 0.6666666666666666,
+      "success": false,
+      "steps": 15295,
+      "base_distance_m": 10.29,
+      "video": "inst313_idx12_q0.6667.mp4"
+    },
+    {
+      "idx": 13,
+      "instance_id": 314,
+      "q_score": 0.5,
+      "success": false,
+      "steps": 15295,
+      "base_distance_m": 8.97,
+      "video": "inst314_idx13_q0.5000.mp4"
+    },
+    {
+      "idx": 14,
+      "instance_id": 315,
+      "q_score": 0.6666666666666666,
+      "success": false,
+      "steps": 15295,
+      "base_distance_m": 12.09,
+      "video": "inst315_idx14_q0.6667.mp4"
+    },
+    {
+      "idx": 15,
+      "instance_id": 316,
+      "q_score": 0.6666666666666666,
+      "success": false,
+      "steps": 15295,
+      "base_distance_m": 6.87,
+      "video": "inst316_idx15_q0.6667.mp4"
+    },
+    {
+      "idx": 16,
+      "instance_id": 317,
+      "q_score": 0.16666666666666666,
+      "success": false,
+      "steps": 15295,
+      "base_distance_m": 4.88,
+      "video": "inst317_idx16_q0.1667.mp4"
+    },
+    {
+      "idx": 17,
+      "instance_id": 318,
+      "q_score": 0.6666666666666666,
+      "success": false,
+      "steps": 15295,
+      "base_distance_m": 11.04,
+      "video": "inst318_idx17_q0.6667.mp4"
+    },
+    {
+      "idx": 18,
+      "instance_id": 319,
+      "q_score": 0.6666666666666666,
+      "success": false,
+      "steps": 15295,
+      "base_distance_m": 12.53,
+      "video": "inst319_idx18_q0.6667.mp4"
+    },
+    {
+      "idx": 19,
+      "instance_id": 320,
+      "q_score": 0.6666666666666666,
+      "success": false,
+      "steps": 15295,
+      "base_distance_m": 10.39,
+      "video": "inst320_idx19_q0.6667.mp4"
+    }
+  ]
+}