Auto-sync: 2026-06-28 01:15:29

results/README.md

@@ -24,6 +24,8 @@ Use these summaries for the current paper tables:
 - `h16_policy_ckpt_near_miss_policy_bc5_bestpt_retrieval_residual_knn4_v2_summary.md`
 - `h16_policy_ckpt_nonexpert_policy_bc5_summary.md`
 - `h16_policy_ckpt_nonexpert_policy_bc5_bestpt_field_sweep_summary.md`
+- `h16_policy_ckpt_field_selected_noexpert_bc5_summary.md`
+- `h16_policy_ckpt_field_selected_noexpert_bc5_bestpt_field_sweep_summary.md`
 
 Known stale or incomplete files:
 
@@ -55,21 +57,19 @@ Completed deployment-clean diagnostics:
 - Job `14858327` exported the train-split field-selected no-expert target map.
   It selected `near_miss` for 1,820 of 2,298 train groups and non-near-miss
   no-expert candidates for the rest.
+- Jobs `14858328`-`14858333` completed train-split field-teacher distillation:
+  direct student rollout is 26.84%, and field-guided rollout is 27.65%.
 
 Active field-teacher distillation jobs:
 
-Last checked: `2026-06-28 05:03 UTC`.
+Last checked: `2026-06-28 05:20 UTC`.
 
-- Job `14858328` is running 3 seeds of `field_selected_noexpert_bc5` with the
-  train-split target map; jobs `14858329`/`14858330` and
-  `14858331`/`14858332` evaluate direct and field-guided rollouts afterward.
-- Job `14858333` rebuilds `paper_table_status.*` after the train-split
-  field-teacher summaries.
 - Job `14858449` completed the all-split target map export for aligned validation
   checkpoint selection and seed-invariant student train coverage.
-- Job `14858450` trains 3 seeds of `field_selected_noexpert_bc5_allmap`; jobs
-  `14858451`/`14858452` and `14858453`/`14858454` evaluate direct and
-  field-guided rollouts afterward.
+- Job `14858450` completed 3 seeds of `field_selected_noexpert_bc5_allmap` with
+  100% train/val target-map coverage.
+- Jobs `14858451`/`14858452` and `14858453`/`14858454` are pending priority and
+  will evaluate direct and field-guided allmap rollouts.
 - Job `14858455` rebuilds `paper_table_status.*` after the allmap summaries.
 
 Paper table automation:

results/dovla_cil_run_report_2026-06-27.md

@@ -23,6 +23,8 @@ The deployed h=16 behavior-cloning policy remains weak, but the interventional f
 | Trust-region field optimization | 25.39% | -4.35 pp | Negative diagnostic; field is not a generic action optimizer |
 | Best non-expert proposal policy | 27.88% | -1.86 pp | Broad BC targets do not solve proposal generation |
 | Best non-expert proposal + field | 26.49% | -3.25 pp | Broad proposal-field bridge also fails |
+| Field-selected no-expert policy, seed-0 train map | 26.84% | -2.90 pp | Train-split field-teacher student fails |
+| Field-selected no-expert policy + field, seed-0 train map | 27.65% | -2.09 pp | Field scoring around that student remains below baseline |
 | Train-state residual retrieval | 32.12% | +2.38 pp | Positive clean bridge, below current clean best |
 | KNN train-state residual retrieval | 29.91% | +0.17 pp | More retrieved tangent neighborhoods dilute the signal |
 
@@ -75,16 +77,16 @@ Completed since the first report:
 - Field-teacher target exports now exist:
   - train split: 2,298 groups, 1,820 `near_miss`, 478 non-near-miss no-expert targets;
   - all split: 2,873 groups, 2,273 `near_miss`, 600 non-near-miss no-expert targets.
+- Train-split field-teacher distillation completed as a negative diagnostic:
+  direct student 26.84%, field-guided best 27.65%.
 
 Active field-teacher jobs:
 
-- `14858328` is running train-split `field_selected_noexpert_bc5` training;
-  `14858329`/`14858330` and `14858331`/`14858332` evaluate direct and
-  field-guided rollouts.
-- `14858450` is pending all-split `field_selected_noexpert_bc5_allmap`
-  training; `14858451`/`14858452` and `14858453`/`14858454` evaluate direct and
-  field-guided rollouts.
-- `14858333` and `14858455` rebuild `paper_table_status.*` after the summaries.
+- `14858450` completed all-split `field_selected_noexpert_bc5_allmap` training
+  with 100% train/val target coverage for all three seeds.
+- `14858451`/`14858452` and `14858453`/`14858454` are pending priority to
+  evaluate direct and field-guided allmap rollouts.
+- `14858455` rebuilds `paper_table_status.*` after the allmap summaries.
 
 Use `results/paper_table_status.md` as the canonical current table. The job
 table below is historical and includes statuses that were true at earlier

results/h16_policy_ckpt_field_selected_noexpert_bc5_bestpt_field_sweep_summary.json

@@ -0,0 +1,985 @@
+{
+  "run_root": "/scratch/knguy52/dovla/experiments/dovla_h16_field_selected_noexpert_bc5_bestpt_field_sweep",
+  "baseline_h4_policy_success": 0.2967,
+  "baseline_h16_policy_success": 0.29739130434782607,
+  "num_result_files": 12,
+  "configs": [
+    {
+      "config": "k8_sigma0.10",
+      "completed_seeds": [
+        0,
+        1,
+        2
+      ],
+      "num_completed": 3,
+      "mean_success": 0.27652173913043476,
+      "std_success": 0.04217167183645961,
+      "mean_progress": 0.5031051267804444,
+      "mean_action_mse_to_best": 0.4708352829712997,
+      "absolute_gain_vs_h4_baseline": -0.020178260869565257,
+      "absolute_gain_vs_h16_policy": -0.020869565217391306
+    },
+    {
+      "config": "k64_sigma0.50",
+      "completed_seeds": [
+        0,
+        1,
+        2
+      ],
+      "num_completed": 3,
+      "mean_success": 0.2707246376811594,
+      "std_success": 0.040313828755278176,
+      "mean_progress": 0.49595623123586885,
+      "mean_action_mse_to_best": 0.4889948419428876,
+      "absolute_gain_vs_h4_baseline": -0.025975362318840622,
+      "absolute_gain_vs_h16_policy": -0.026666666666666672
+    },
+    {
+      "config": "k16_sigma0.20",
+      "completed_seeds": [
+        0,
+        1,
+        2
+      ],
+      "num_completed": 3,
+      "mean_success": 0.2684057971014493,
+      "std_success": 0.04516161554449235,
+      "mean_progress": 0.49610337290181145,
+      "mean_action_mse_to_best": 0.4744613969620263,
+      "absolute_gain_vs_h4_baseline": -0.028294202898550724,
+      "absolute_gain_vs_h16_policy": -0.028985507246376774
+    },
+    {
+      "config": "k32_sigma0.35",
+      "completed_seeds": [
+        0,
+        1,
+        2
+      ],
+      "num_completed": 3,
+      "mean_success": 0.2672463768115942,
+      "std_success": 0.044214063688506305,
+      "mean_progress": 0.493803747793176,
+      "mean_action_mse_to_best": 0.48158605349317624,
+      "absolute_gain_vs_h4_baseline": -0.02945362318840583,
+      "absolute_gain_vs_h16_policy": -0.03014492753623188
+    }
+  ],
+  "best": {
+    "config": "k8_sigma0.10",
+    "completed_seeds": [
+      0,
+      1,
+      2
+    ],
+    "num_completed": 3,
+    "mean_success": 0.27652173913043476,
+    "std_success": 0.04217167183645961,
+    "mean_progress": 0.5031051267804444,
+    "mean_action_mse_to_best": 0.4708352829712997,
+    "absolute_gain_vs_h4_baseline": -0.020178260869565257,
+    "absolute_gain_vs_h16_policy": -0.020869565217391306
+  },
+  "rows": [
+    {
+      "config": "k16_sigma0.20",
+      "seed": 0,
+      "path": "/scratch/knguy52/dovla/experiments/dovla_h16_field_selected_noexpert_bc5_bestpt_field_sweep/k16_sigma0.20/seed_0/online_rollout.json",
+      "selection_mode": "field",
+      "num_candidates": 16,
+      "candidate_sigma": 0.2,
+      "field_optim_steps": 0,
+      "field_optim_step_size": 0.0,
+      "field_optim_trust_radius": 0.0,
+      "field_optim_l2_penalty": 0.0,
+      "retrieval_neighbors": 0,
+      "num_groups": 575,
+      "policy_rollout_success_rate": 0.21913043478260869,
+      "policy_rollout_progress": 0.46793411430032195,
+      "oracle_success_rate": 0.8573913043478261,
+      "action_mse_to_best": 0.468760979136695,
+      "per_task": {
+        "LiftPegUpright-v1": {
+          "action_mse_to_best": 0.35266343150863944,
+          "expert_success_rate": 0.8865979381443299,
+          "num_groups": 97,
+          "oracle_success_rate": 0.9278350515463918,
+          "policy_expert_regret": 1.20295861394135,
+          "policy_oracle_regret": 1.2557163656372385,
+          "policy_rollout_progress": 0.5160976043067027,
+          "policy_rollout_success_rate": 0.14432989690721648,
+          "restore_max_error": 4.76837158203125e-07
+        },
+        "PickCube-v1": {
+          "action_mse_to_best": 0.4146603767831738,
+          "expert_success_rate": 0.9375,
+          "num_groups": 208,
+          "oracle_success_rate": 0.9471153846153846,
+          "policy_expert_regret": 1.2972651475664372,
+          "policy_oracle_regret": 1.3106880149929425,
+          "policy_rollout_progress": 0.47517616109241945,
+          "policy_rollout_success_rate": 0.13942307692307693,
+          "restore_max_error": 4.76837158203125e-07
+        },
+        "PullCube-v1": {
+          "action_mse_to_best": 0.7021898142509646,
+          "expert_success_rate": 0.19480519480519481,
+          "num_groups": 77,
+          "oracle_success_rate": 0.36363636363636365,
+          "policy_expert_regret": 0.2625723276604814,
+          "policy_oracle_regret": 0.5177143988359793,
+          "policy_rollout_progress": 0.267815385828726,
+          "policy_rollout_success_rate": 0.12987012987012986,
+          "restore_max_error": 4.76837158203125e-07
+        },
+        "PushCube-v1": {
+          "action_mse_to_best": 0.3936375088672689,
+          "expert_success_rate": 0.8617021276595744,
+          "num_groups": 94,
+          "oracle_success_rate": 0.9893617021276596,
+          "policy_expert_regret": 0.702704998882527,
+          "policy_oracle_regret": 0.8001218893109484,
+          "policy_rollout_progress": 0.6057824138948258,
+          "policy_rollout_success_rate": 0.574468085106383,
+          "restore_max_error": 4.76837158203125e-07
+        },
+        "StackCube-v1": {
+          "action_mse_to_best": 0.5859526287425648,
+          "expert_success_rate": 0.6767676767676768,
+          "num_groups": 99,
+          "oracle_success_rate": 0.8585858585858586,
+          "policy_expert_regret": 1.0460213774984533,
+          "policy_oracle_regret": 1.1990576034242457,
+          "policy_rollout_progress": 0.4302896462907695,
+          "policy_rollout_success_rate": 0.1919191919191919,
+          "restore_max_error": 3.948807716369629e-07
+        }
+      }
+    },
+    {
+      "config": "k16_sigma0.20",
+      "seed": 1,
+      "path": "/scratch/knguy52/dovla/experiments/dovla_h16_field_selected_noexpert_bc5_bestpt_field_sweep/k16_sigma0.20/seed_1/online_rollout.json",
+      "selection_mode": "field",
+      "num_candidates": 16,
+      "candidate_sigma": 0.2,
+      "field_optim_steps": 0,
+      "field_optim_step_size": 0.0,
+      "field_optim_trust_radius": 0.0,
+      "field_optim_l2_penalty": 0.0,
+      "retrieval_neighbors": 0,
+      "num_groups": 575,
+      "policy_rollout_success_rate": 0.2782608695652174,
+      "policy_rollout_progress": 0.5095858010730666,
+      "oracle_success_rate": 0.8695652173913043,
+      "action_mse_to_best": 0.4680624765392555,
+      "per_task": {
+        "LiftPegUpright-v1": {
+          "action_mse_to_best": 0.35002948106802273,
+          "expert_success_rate": 0.8584070796460177,
+          "num_groups": 113,
+          "oracle_success_rate": 0.9380530973451328,
+          "policy_expert_regret": 1.1798317065808626,
+          "policy_oracle_regret": 1.2723509379192792,
+          "policy_rollout_progress": 0.5208574027086781,
+          "policy_rollout_success_rate": 0.1504424778761062,
+          "restore_max_error": 4.76837158203125e-07
+        },
+        "PickCube-v1": {
+          "action_mse_to_best": 0.39405514559020166,
+          "expert_success_rate": 0.9402173913043478,
+          "num_groups": 184,
+          "oracle_success_rate": 0.9456521739130435,
+          "policy_expert_regret": 1.1305499031998054,
+          "policy_oracle_regret": 1.1380868081671551,
+          "policy_rollout_progress": 0.5538577482246024,
+          "policy_rollout_success_rate": 0.2391304347826087,
+          "restore_max_error": 4.76837158203125e-07
+        },
+        "PullCube-v1": {
+          "action_mse_to_best": 0.6909535866426794,
+          "expert_success_rate": 0.25,
+          "num_groups": 76,
+          "oracle_success_rate": 0.40789473684210525,
+          "policy_expert_regret": 0.39813052471972216,
+          "policy_oracle_regret": 0.6531739636005736,
+          "policy_rollout_progress": 0.2255952119900796,
+          "policy_rollout_success_rate": 0.07894736842105263,
+          "restore_max_error": 4.76837158203125e-07
+        },
+        "PushCube-v1": {
+          "action_mse_to_best": 0.41637755876725857,
+          "expert_success_rate": 0.8198198198198198,
+          "num_groups": 111,
+          "oracle_success_rate": 1.0,
+          "policy_expert_regret": 0.39772362980219694,
+          "policy_oracle_regret": 0.4817321421326818,
+          "policy_rollout_progress": 0.7705201101195704,
+          "policy_rollout_success_rate": 0.7477477477477478,
+          "restore_max_error": 4.76837158203125e-07
+        },
+        "StackCube-v1": {
+          "action_mse_to_best": 0.6411655412393285,
+          "expert_success_rate": 0.6923076923076923,
+          "num_groups": 91,
+          "oracle_success_rate": 0.8571428571428571,
+          "policy_expert_regret": 1.2249158738733648,
+          "policy_oracle_regret": 1.3844720531295944,
+          "policy_rollout_progress": 0.3249687373965651,
+          "policy_rollout_success_rate": 0.10989010989010989,
+          "restore_max_error": 3.948807716369629e-07
+        }
+      }
+    },
+    {
+      "config": "k16_sigma0.20",
+      "seed": 2,
+      "path": "/scratch/knguy52/dovla/experiments/dovla_h16_field_selected_noexpert_bc5_bestpt_field_sweep/k16_sigma0.20/seed_2/online_rollout.json",
+      "selection_mode": "field",
+      "num_candidates": 16,
+      "candidate_sigma": 0.2,
+      "field_optim_steps": 0,
+      "field_optim_step_size": 0.0,
+      "field_optim_trust_radius": 0.0,
+      "field_optim_l2_penalty": 0.0,
+      "retrieval_neighbors": 0,
+      "num_groups": 575,
+      "policy_rollout_success_rate": 0.30782608695652175,
+      "policy_rollout_progress": 0.5107902033320458,
+      "oracle_success_rate": 0.8765217391304347,
+      "action_mse_to_best": 0.48656073521012844,
+      "per_task": {
+        "LiftPegUpright-v1": {
+          "action_mse_to_best": 0.37539764823547256,
+          "expert_success_rate": 0.8229166666666666,
+          "num_groups": 96,
+          "oracle_success_rate": 0.9270833333333334,
+          "policy_expert_regret": 1.0008620529746015,
+          "policy_oracle_regret": 1.1211368835841615,
+          "policy_rollout_progress": 0.5729093362266818,
+          "policy_rollout_success_rate": 0.23958333333333334,
+          "restore_max_error": 3.5762786865234375e-07
+        },
+        "PickCube-v1": {
+          "action_mse_to_best": 0.3807297901372717,
+          "expert_success_rate": 0.9444444444444444,
+          "num_groups": 198,
+          "oracle_success_rate": 0.9595959595959596,
+          "policy_expert_regret": 1.0298031912157022,
+          "policy_oracle_regret": 1.0368866417444107,
+          "policy_rollout_progress": 0.5855083816581309,
+          "policy_rollout_success_rate": 0.3181818181818182,
+          "restore_max_error": 4.76837158203125e-07
+        },
+        "PullCube-v1": {
+          "action_mse_to_best": 0.7341989019678699,
+          "expert_success_rate": 0.24444444444444444,
+          "num_groups": 90,
+          "oracle_success_rate": 0.4666666666666667,
+          "policy_expert_regret": 0.36530390631540083,
+          "policy_oracle_regret": 0.6634106457784785,
+          "policy_rollout_progress": 0.2576814704747651,
+          "policy_rollout_success_rate": 0.13333333333333333,
+          "restore_max_error": 4.0978193283081055e-07
+        },
+        "PushCube-v1": {
+          "action_mse_to_best": 0.45260379271637097,
+          "expert_success_rate": 0.8514851485148515,
+          "num_groups": 101,
+          "oracle_success_rate": 1.0,
+          "policy_expert_regret": 0.47767280514287475,
+          "policy_oracle_regret": 0.6053462448981729,
+          "policy_rollout_progress": 0.711485438270144,
+          "policy_rollout_success_rate": 0.6831683168316832,
+          "restore_max_error": 4.76837158203125e-07
+        },
+        "StackCube-v1": {
+          "action_mse_to_best": 0.6284318425175216,
+          "expert_success_rate": 0.7666666666666667,
+          "num_groups": 90,
+          "oracle_success_rate": 0.9111111111111111,
+          "policy_expert_regret": 1.31410144418478,
+          "policy_oracle_regret": 1.4628699377179146,
+          "policy_rollout_progress": 0.3080338829093509,
+          "policy_rollout_success_rate": 0.1111111111111111,
+          "restore_max_error": 4.76837158203125e-07
+        }
+      }
+    },
+    {
+      "config": "k32_sigma0.35",
+      "seed": 0,
+      "path": "/scratch/knguy52/dovla/experiments/dovla_h16_field_selected_noexpert_bc5_bestpt_field_sweep/k32_sigma0.35/seed_0/online_rollout.json",
+      "selection_mode": "field",
+      "num_candidates": 32,
+      "candidate_sigma": 0.35,
+      "field_optim_steps": 0,
+      "field_optim_step_size": 0.0,
+      "field_optim_trust_radius": 0.0,
+      "field_optim_l2_penalty": 0.0,
+      "retrieval_neighbors": 0,
+      "num_groups": 575,
+      "policy_rollout_success_rate": 0.21913043478260869,
+      "policy_rollout_progress": 0.46738898912987986,
+      "oracle_success_rate": 0.8573913043478261,
+      "action_mse_to_best": 0.47375724539484665,
+      "per_task": {
+        "LiftPegUpright-v1": {
+          "action_mse_to_best": 0.3524797545726766,
+          "expert_success_rate": 0.8865979381443299,
+          "num_groups": 97,
+          "oracle_success_rate": 0.9278350515463918,
+          "policy_expert_regret": 1.1849500404805253,
+          "policy_oracle_regret": 1.2377077921764137,
+          "policy_rollout_progress": 0.523796899417012,
+          "policy_rollout_success_rate": 0.15463917525773196,
+          "restore_max_error": 4.76837158203125e-07
+        },
+        "PickCube-v1": {
+          "action_mse_to_best": 0.41800202110495704,
+          "expert_success_rate": 0.9375,
+          "num_groups": 208,
+          "oracle_success_rate": 0.9471153846153846,
+          "policy_expert_regret": 1.293418727734556,
+          "policy_oracle_regret": 1.3068415951610615,
+          "policy_rollout_progress": 0.4790225809243006,
+          "policy_rollout_success_rate": 0.13942307692307693,
+          "restore_max_error": 4.76837158203125e-07
+        },
+        "PullCube-v1": {
+          "action_mse_to_best": 0.7232648653595092,
+          "expert_success_rate": 0.19480519480519481,
+          "num_groups": 77,
+          "oracle_success_rate": 0.36363636363636365,
+          "policy_expert_regret": 0.2673212721985684,
+          "policy_oracle_regret": 0.5014150884479699,
+          "policy_rollout_progress": 0.27085492715014764,
+          "policy_rollout_success_rate": 0.14285714285714285,
+          "restore_max_error": 4.76837158203125e-07
+        },
+        "PushCube-v1": {
+          "action_mse_to_best": 0.3973129745176498,
+          "expert_success_rate": 0.8617021276595744,
+          "num_groups": 94,
+          "oracle_success_rate": 0.9893617021276596,
+          "policy_expert_regret": 0.7247732332412232,
+          "policy_oracle_regret": 0.8431307670283825,
+          "policy_rollout_progress": 0.5840501319220726,
+          "policy_rollout_success_rate": 0.5531914893617021,
+          "restore_max_error": 4.76837158203125e-07
+        },
+        "StackCube-v1": {
+          "action_mse_to_best": 0.5882489422355035,
+          "expert_success_rate": 0.6767676767676768,
+          "num_groups": 99,
+          "oracle_success_rate": 0.8585858585858586,
+          "policy_expert_regret": 1.046542024973667,
+          "policy_oracle_regret": 1.1995782508994595,
+          "policy_rollout_progress": 0.42976899881555575,
+          "policy_rollout_success_rate": 0.1919191919191919,
+          "restore_max_error": 3.948807716369629e-07
+        }
+      }
+    },
+    {
+      "config": "k32_sigma0.35",
+      "seed": 1,
+      "path": "/scratch/knguy52/dovla/experiments/dovla_h16_field_selected_noexpert_bc5_bestpt_field_sweep/k32_sigma0.35/seed_1/online_rollout.json",
+      "selection_mode": "field",
+      "num_candidates": 32,
+      "candidate_sigma": 0.35,
+      "field_optim_steps": 0,
+      "field_optim_step_size": 0.0,
+      "field_optim_trust_radius": 0.0,
+      "field_optim_l2_penalty": 0.0,
+      "retrieval_neighbors": 0,
+      "num_groups": 575,
+      "policy_rollout_success_rate": 0.27652173913043476,
+      "policy_rollout_progress": 0.5041067413548412,
+      "oracle_success_rate": 0.8695652173913043,
+      "action_mse_to_best": 0.4759621399697726,
+      "per_task": {
+        "LiftPegUpright-v1": {
+          "action_mse_to_best": 0.349115602874024,
+          "expert_success_rate": 0.8584070796460177,
+          "num_groups": 113,
+          "oracle_success_rate": 0.9380530973451328,
+          "policy_expert_regret": 1.1531897760861742,
+          "policy_oracle_regret": 1.245709007424591,
+          "policy_rollout_progress": 0.5298002181591186,
+          "policy_rollout_success_rate": 0.168141592920354,
+          "restore_max_error": 4.76837158203125e-07
+        },
+        "PickCube-v1": {
+          "action_mse_to_best": 0.39974564475857693,
+          "expert_success_rate": 0.9402173913043478,
+          "num_groups": 184,
+          "oracle_success_rate": 0.9456521739130435,
+          "policy_expert_regret": 1.1354111315753392,
+          "policy_oracle_regret": 1.1429480365426887,
+          "policy_rollout_progress": 0.5489965198490687,
+          "policy_rollout_success_rate": 0.2391304347826087,
+          "restore_max_error": 4.76837158203125e-07
+        },
+        "PullCube-v1": {
+          "action_mse_to_best": 0.7238199750672242,
+          "expert_success_rate": 0.25,
+          "num_groups": 76,
+          "oracle_success_rate": 0.40789473684210525,
+          "policy_expert_regret": 0.451350043429748,
+          "policy_oracle_regret": 0.6905959643129456,
+          "policy_rollout_progress": 0.19615636427739733,
+          "policy_rollout_success_rate": 0.06578947368421052,
+          "restore_max_error": 4.76837158203125e-07
+        },
+        "PushCube-v1": {
+          "action_mse_to_best": 0.4286191267473204,
+          "expert_success_rate": 0.8198198198198198,
+          "num_groups": 111,
+          "oracle_success_rate": 1.0,
+          "policy_expert_regret": 0.4146888485631427,
+          "policy_oracle_regret": 0.5320024189648328,
+          "policy_rollout_progress": 0.7472768603144465,
+          "policy_rollout_success_rate": 0.7207207207207207,
+          "restore_max_error": 4.76837158203125e-07
+        },
+        "StackCube-v1": {
+          "action_mse_to_best": 0.6383288741562065,
+          "expert_success_rate": 0.6923076923076923,
+          "num_groups": 91,
+          "oracle_success_rate": 0.8571428571428571,
+          "policy_expert_regret": 1.1968848662717002,
+          "policy_oracle_regret": 1.3564410455279299,
+          "policy_rollout_progress": 0.3420107340092187,
+          "policy_rollout_success_rate": 0.12087912087912088,
+          "restore_max_error": 3.948807716369629e-07
+        }
+      }
+    },
+    {
+      "config": "k32_sigma0.35",
+      "seed": 2,
+      "path": "/scratch/knguy52/dovla/experiments/dovla_h16_field_selected_noexpert_bc5_bestpt_field_sweep/k32_sigma0.35/seed_2/online_rollout.json",
+      "selection_mode": "field",
+      "num_candidates": 32,
+      "candidate_sigma": 0.35,
+      "field_optim_steps": 0,
+      "field_optim_step_size": 0.0,
+      "field_optim_trust_radius": 0.0,
+      "field_optim_l2_penalty": 0.0,
+      "retrieval_neighbors": 0,
+      "num_groups": 575,
+      "policy_rollout_success_rate": 0.3060869565217391,
+      "policy_rollout_progress": 0.5099155128948069,
+      "oracle_success_rate": 0.8765217391304347,
+      "action_mse_to_best": 0.49503877511490946,
+      "per_task": {
+        "LiftPegUpright-v1": {
+          "action_mse_to_best": 0.3736456293069447,
+          "expert_success_rate": 0.8229166666666666,
+          "num_groups": 96,
+          "oracle_success_rate": 0.9270833333333334,
+          "policy_expert_regret": 1.0010371517079573,
+          "policy_oracle_regret": 1.1213119823175173,
+          "policy_rollout_progress": 0.5755758554053804,
+          "policy_rollout_success_rate": 0.25,
+          "restore_max_error": 3.5762786865234375e-07
+        },
+        "PickCube-v1": {
+          "action_mse_to_best": 0.3811475902494758,
+          "expert_success_rate": 0.9444444444444444,
+          "num_groups": 198,
+          "oracle_success_rate": 0.9595959595959596,
+          "policy_expert_regret": 1.0301577876764108,
+          "policy_oracle_regret": 1.037241238205119,
+          "policy_rollout_progress": 0.5851537851974224,
+          "policy_rollout_success_rate": 0.3181818181818182,
+          "restore_max_error": 4.76837158203125e-07
+        },
+        "PullCube-v1": {
+          "action_mse_to_best": 0.7827393248677254,
+          "expert_success_rate": 0.24444444444444444,
+          "num_groups": 90,
+          "oracle_success_rate": 0.4666666666666667,
+          "policy_expert_regret": 0.39821494068536495,
+          "policy_oracle_regret": 0.6810178060084582,
+          "policy_rollout_progress": 0.24872837766177125,
+          "policy_rollout_success_rate": 0.12222222222222222,
+          "restore_max_error": 4.0978193283081055e-07
+        },
+        "PushCube-v1": {
+          "action_mse_to_best": 0.4594265000507383,
+          "expert_success_rate": 0.8514851485148515,
+          "num_groups": 101,
+          "oracle_success_rate": 1.0,
+          "policy_expert_regret": 0.4958930028842227,
+          "policy_oracle_regret": 0.6248585299985243,
+          "policy_rollout_progress": 0.7018741432688024,
+          "policy_rollout_success_rate": 0.6732673267326733,
+          "restore_max_error": 4.76837158203125e-07
+        },
+        "StackCube-v1": {
+          "action_mse_to_best": 0.6273497407221131,
+          "expert_success_rate": 0.7666666666666667,
+          "num_groups": 90,
+          "oracle_success_rate": 0.9111111111111111,
+          "policy_expert_regret": 1.302014817463027,
+          "policy_oracle_regret": 1.4507833109961616,
+          "policy_rollout_progress": 0.32012050963110394,
+          "policy_rollout_success_rate": 0.1111111111111111,
+          "restore_max_error": 4.76837158203125e-07
+        }
+      }
+    },
+    {
+      "config": "k64_sigma0.50",
+      "seed": 0,
+      "path": "/scratch/knguy52/dovla/experiments/dovla_h16_field_selected_noexpert_bc5_bestpt_field_sweep/k64_sigma0.50/seed_0/online_rollout.json",
+      "selection_mode": "field",
+      "num_candidates": 64,
+      "candidate_sigma": 0.5,
+      "field_optim_steps": 0,
+      "field_optim_step_size": 0.0,
+      "field_optim_trust_radius": 0.0,
+      "field_optim_l2_penalty": 0.0,
+      "retrieval_neighbors": 0,
+      "num_groups": 575,
+      "policy_rollout_success_rate": 0.22782608695652173,
+      "policy_rollout_progress": 0.474431411483649,
+      "oracle_success_rate": 0.8573913043478261,
+      "action_mse_to_best": 0.47588635947069396,
+      "per_task": {
+        "LiftPegUpright-v1": {
+          "action_mse_to_best": 0.35277089376732246,
+          "expert_success_rate": 0.8865979381443299,
+          "num_groups": 97,
+          "oracle_success_rate": 0.9278350515463918,
+          "policy_expert_regret": 1.184891695214301,
+          "policy_oracle_regret": 1.2376494469101895,
+          "policy_rollout_progress": 0.5238552446832362,
+          "policy_rollout_success_rate": 0.15463917525773196,
+          "restore_max_error": 4.76837158203125e-07
+        },
+        "PickCube-v1": {
+          "action_mse_to_best": 0.41841672013442105,
+          "expert_success_rate": 0.9375,
+          "num_groups": 208,
+          "oracle_success_rate": 0.9471153846153846,
+          "policy_expert_regret": 1.2863650867590108,
+          "policy_oracle_regret": 1.2997879541855162,
+          "policy_rollout_progress": 0.48126852959215355,
+          "policy_rollout_success_rate": 0.14423076923076922,
+          "restore_max_error": 4.76837158203125e-07
+        },
+        "PullCube-v1": {
+          "action_mse_to_best": 0.7349351081126309,
+          "expert_success_rate": 0.19480519480519481,
+          "num_groups": 77,
+          "oracle_success_rate": 0.36363636363636365,
+          "policy_expert_regret": 0.2896711546761383,
+          "policy_oracle_regret": 0.501337112019794,
+          "policy_rollout_progress": 0.28172497145752967,
+          "policy_rollout_success_rate": 0.15584415584415584,
+          "restore_max_error": 4.76837158203125e-07
+        },
+        "PushCube-v1": {
+          "action_mse_to_best": 0.3999176624607533,
+          "expert_success_rate": 0.8617021276595744,
+          "num_groups": 94,
+          "oracle_success_rate": 0.9893617021276596,
+          "policy_expert_regret": 0.6628930673320242,
+          "policy_oracle_regret": 0.7818994298577309,
+          "policy_rollout_progress": 0.613366575475703,
+          "policy_rollout_success_rate": 0.5851063829787234,
+          "restore_max_error": 4.76837158203125e-07
+        },
+        "StackCube-v1": {
+          "action_mse_to_best": 0.5879084708714726,
+          "expert_success_rate": 0.6767676767676768,
+          "num_groups": 99,
+          "oracle_success_rate": 0.8585858585858586,
+          "policy_expert_regret": 1.0467052882668948,
+          "policy_oracle_regret": 1.199741514192687,
+          "policy_rollout_progress": 0.429605735522328,
+          "policy_rollout_success_rate": 0.1919191919191919,
+          "restore_max_error": 3.948807716369629e-07
+        }
+      }
+    },
+    {
+      "config": "k64_sigma0.50",
+      "seed": 1,
+      "path": "/scratch/knguy52/dovla/experiments/dovla_h16_field_selected_noexpert_bc5_bestpt_field_sweep/k64_sigma0.50/seed_1/online_rollout.json",
+      "selection_mode": "field",
+      "num_candidates": 64,
+      "candidate_sigma": 0.5,
+      "field_optim_steps": 0,
+      "field_optim_step_size": 0.0,
+      "field_optim_trust_radius": 0.0,
+      "field_optim_l2_penalty": 0.0,
+      "retrieval_neighbors": 0,
+      "num_groups": 575,
+      "policy_rollout_success_rate": 0.27652173913043476,
+      "policy_rollout_progress": 0.5038111128841631,
+      "oracle_success_rate": 0.8695652173913043,
+      "action_mse_to_best": 0.485377110492681,
+      "per_task": {
+        "LiftPegUpright-v1": {
+          "action_mse_to_best": 0.3496806182470008,
+          "expert_success_rate": 0.8584070796460177,
+          "num_groups": 113,
+          "oracle_success_rate": 0.9380530973451328,
+          "policy_expert_regret": 1.169163638643459,
+          "policy_oracle_regret": 1.2616828699818754,
+          "policy_rollout_progress": 0.5226759131239579,
+          "policy_rollout_success_rate": 0.1592920353982301,
+          "restore_max_error": 4.76837158203125e-07
+        },
+        "PickCube-v1": {
+          "action_mse_to_best": 0.4060886063329551,
+          "expert_success_rate": 0.9402173913043478,
+          "num_groups": 184,
+          "oracle_success_rate": 0.9456521739130435,
+          "policy_expert_regret": 1.13451692196743,
+          "policy_oracle_regret": 1.1420538269347795,
+          "policy_rollout_progress": 0.549890729456978,
+          "policy_rollout_success_rate": 0.2391304347826087,
+          "restore_max_error": 4.76837158203125e-07
+        },
+        "PullCube-v1": {
+          "action_mse_to_best": 0.7909409432690345,
+          "expert_success_rate": 0.25,
+          "num_groups": 76,
+          "oracle_success_rate": 0.40789473684210525,
+          "policy_expert_regret": 0.43219950842555926,
+          "policy_oracle_regret": 0.6995100968010775,
+          "policy_rollout_progress": 0.18716378344975296,
+          "policy_rollout_success_rate": 0.06578947368421052,
+          "restore_max_error": 4.76837158203125e-07
+        },
+        "PushCube-v1": {
+          "action_mse_to_best": 0.41940284178063675,
+          "expert_success_rate": 0.8198198198198198,
+          "num_groups": 111,
+          "oracle_success_rate": 1.0,
+          "policy_expert_regret": 0.3959935593443948,
+          "policy_oracle_regret": 0.5129548193098189,
+          "policy_rollout_progress": 0.7573154509604514,
+          "policy_rollout_success_rate": 0.7297297297297297,
+          "restore_max_error": 4.76837158203125e-07
+        },
+        "StackCube-v1": {
+          "action_mse_to_best": 0.6394769008793346,
+          "expert_success_rate": 0.6923076923076923,
+          "num_groups": 91,
+          "oracle_success_rate": 0.8571428571428571,
+          "policy_expert_regret": 1.196448843066509,
+          "policy_oracle_regret": 1.3560050223227387,
+          "policy_rollout_progress": 0.34244675721441,
+          "policy_rollout_success_rate": 0.12087912087912088,
+          "restore_max_error": 3.948807716369629e-07
+        }
+      }
+    },
+    {
+      "config": "k64_sigma0.50",
+      "seed": 2,
+      "path": "/scratch/knguy52/dovla/experiments/dovla_h16_field_selected_noexpert_bc5_bestpt_field_sweep/k64_sigma0.50/seed_2/online_rollout.json",
+      "selection_mode": "field",
+      "num_candidates": 64,
+      "candidate_sigma": 0.5,
+      "field_optim_steps": 0,
+      "field_optim_step_size": 0.0,
+      "field_optim_trust_radius": 0.0,
+      "field_optim_l2_penalty": 0.0,
+      "retrieval_neighbors": 0,
+      "num_groups": 575,
+      "policy_rollout_success_rate": 0.30782608695652175,
+      "policy_rollout_progress": 0.5096261693397944,
+      "oracle_success_rate": 0.8765217391304347,
+      "action_mse_to_best": 0.5057210558652878,
+      "per_task": {
+        "LiftPegUpright-v1": {
+          "action_mse_to_best": 0.3736456293069447,
+          "expert_success_rate": 0.8229166666666666,
+          "num_groups": 96,
+          "oracle_success_rate": 0.9270833333333334,
+          "policy_expert_regret": 1.0010371517079573,
+          "policy_oracle_regret": 1.1213119823175173,
+          "policy_rollout_progress": 0.5755758554053804,
+          "policy_rollout_success_rate": 0.25,
+          "restore_max_error": 3.5762786865234375e-07
+        },
+        "PickCube-v1": {
+          "action_mse_to_best": 0.3808895478946994,
+          "expert_success_rate": 0.9444444444444444,
+          "num_groups": 198,
+          "oracle_success_rate": 0.9595959595959596,
+          "policy_expert_regret": 1.0302143845443767,
+          "policy_oracle_regret": 1.037297835073085,
+          "policy_rollout_progress": 0.5850971883294566,
+          "policy_rollout_success_rate": 0.3181818181818182,
+          "restore_max_error": 4.76837158203125e-07
+        },
+        "PullCube-v1": {
+          "action_mse_to_best": 0.8449775661859248,
+          "expert_success_rate": 0.24444444444444444,
+          "num_groups": 90,
+          "oracle_success_rate": 0.4666666666666667,
+          "policy_expert_regret": 0.42840350720410547,
+          "policy_oracle_regret": 0.6953901627307965,
+          "policy_rollout_progress": 0.23573277904134657,
+          "policy_rollout_success_rate": 0.12222222222222222,
+          "restore_max_error": 4.0978193283081055e-07
+        },
+        "PushCube-v1": {
+          "action_mse_to_best": 0.4644910559648334,
+          "expert_success_rate": 0.8514851485148515,
+          "num_groups": 101,
+          "oracle_success_rate": 1.0,
+          "policy_expert_regret": 0.4763863344888876,
+          "policy_oracle_regret": 0.6050164121212346,
+          "policy_rollout_progress": 0.7118152710470823,
+          "policy_rollout_success_rate": 0.6831683168316832,
+          "restore_max_error": 4.76837158203125e-07
+        },
+        "StackCube-v1": {
+          "action_mse_to_best": 0.628243540186021,
+          "expert_success_rate": 0.7666666666666667,
+          "num_groups": 90,
+          "oracle_success_rate": 0.9111111111111111,
+          "policy_expert_regret": 1.3018994440635046,
+          "policy_oracle_regret": 1.450667937596639,
+          "policy_rollout_progress": 0.3202358830306265,
+          "policy_rollout_success_rate": 0.1111111111111111,
+          "restore_max_error": 4.76837158203125e-07
+        }
+      }
+    },
+    {
+      "config": "k8_sigma0.10",
+      "seed": 0,
+      "path": "/scratch/knguy52/dovla/experiments/dovla_h16_field_selected_noexpert_bc5_bestpt_field_sweep/k8_sigma0.10/seed_0/online_rollout.json",
+      "selection_mode": "field",
+      "num_candidates": 8,
+      "candidate_sigma": 0.1,
+      "field_optim_steps": 0,
+      "field_optim_step_size": 0.0,
+      "field_optim_trust_radius": 0.0,
+      "field_optim_l2_penalty": 0.0,
+      "retrieval_neighbors": 0,
+      "num_groups": 575,
+      "policy_rollout_success_rate": 0.23130434782608697,
+      "policy_rollout_progress": 0.4804371877111818,
+      "oracle_success_rate": 0.8573913043478261,
+      "action_mse_to_best": 0.4665292473299348,
+      "per_task": {
+        "LiftPegUpright-v1": {
+          "action_mse_to_best": 0.3532839670930941,
+          "expert_success_rate": 0.8865979381443299,
+          "num_groups": 97,
+          "oracle_success_rate": 0.9278350515463918,
+          "policy_expert_regret": 1.1681908187792474,
+          "policy_oracle_regret": 1.220948570475136,
+          "policy_rollout_progress": 0.5405561211182899,
+          "policy_rollout_success_rate": 0.15463917525773196,
+          "restore_max_error": 4.76837158203125e-07
+        },
+        "PickCube-v1": {
+          "action_mse_to_best": 0.4131943359791946,
+          "expert_success_rate": 0.9375,
+          "num_groups": 208,
+          "oracle_success_rate": 0.9471153846153846,
+          "policy_expert_regret": 1.279397780675656,
+          "policy_oracle_regret": 1.2928206481021614,
+          "policy_rollout_progress": 0.48342814336781603,
+          "policy_rollout_success_rate": 0.14903846153846154,
+          "restore_max_error": 4.76837158203125e-07
+        },
+        "PullCube-v1": {
+          "action_mse_to_best": 0.6910990537567572,
+          "expert_success_rate": 0.19480519480519481,
+          "num_groups": 77,
+          "oracle_success_rate": 0.36363636363636365,
+          "policy_expert_regret": 0.31112918189980765,
+          "policy_oracle_regret": 0.5419044978432841,
+          "policy_rollout_progress": 0.28447308410684785,
+          "policy_rollout_success_rate": 0.15584415584415584,
+          "restore_max_error": 4.76837158203125e-07
+        },
+        "PushCube-v1": {
+          "action_mse_to_best": 0.39067850464043463,
+          "expert_success_rate": 0.8617021276595744,
+          "num_groups": 94,
+          "oracle_success_rate": 0.9893617021276596,
+          "policy_expert_regret": 0.6222622066419176,
+          "policy_oracle_regret": 0.7400320969680523,
+          "policy_rollout_progress": 0.6339573126207007,
+          "policy_rollout_success_rate": 0.6063829787234043,
+          "restore_max_error": 4.76837158203125e-07
+        },
+        "StackCube-v1": {
+          "action_mse_to_best": 0.5868984237125124,
+          "expert_success_rate": 0.6767676767676768,
+          "num_groups": 99,
+          "oracle_success_rate": 0.8585858585858586,
+          "policy_expert_regret": 1.0527102315064631,
+          "policy_oracle_regret": 1.2175495678728276,
+          "policy_rollout_progress": 0.4218986919431975,
+          "policy_rollout_success_rate": 0.18181818181818182,
+          "restore_max_error": 3.948807716369629e-07
+        }
+      }
+    },
+    {
+      "config": "k8_sigma0.10",
+      "seed": 1,
+      "path": "/scratch/knguy52/dovla/experiments/dovla_h16_field_selected_noexpert_bc5_bestpt_field_sweep/k8_sigma0.10/seed_1/online_rollout.json",
+      "selection_mode": "field",
+      "num_candidates": 8,
+      "candidate_sigma": 0.1,
+      "field_optim_steps": 0,
+      "field_optim_step_size": 0.0,
+      "field_optim_trust_radius": 0.0,
+      "field_optim_l2_penalty": 0.0,
+      "retrieval_neighbors": 0,
+      "num_groups": 575,
+      "policy_rollout_success_rate": 0.28347826086956524,
+      "policy_rollout_progress": 0.5112803031795699,
+      "oracle_success_rate": 0.8695652173913043,
+      "action_mse_to_best": 0.46244008072125525,
+      "per_task": {
+        "LiftPegUpright-v1": {
+          "action_mse_to_best": 0.3500265953691462,
+          "expert_success_rate": 0.8584070796460177,
+          "num_groups": 113,
+          "oracle_success_rate": 0.9380530973451328,
+          "policy_expert_regret": 1.1728479576058093,
+          "policy_oracle_regret": 1.2653671889442257,
+          "policy_rollout_progress": 0.5189915941616076,
+          "policy_rollout_success_rate": 0.1592920353982301,
+          "restore_max_error": 4.76837158203125e-07
+        },
+        "PickCube-v1": {
+          "action_mse_to_best": 0.39200827625134715,
+          "expert_success_rate": 0.9402173913043478,
+          "num_groups": 184,
+          "oracle_success_rate": 0.9456521739130435,
+          "policy_expert_regret": 1.136972747793745,
+          "policy_oracle_regret": 1.1445096527610945,
+          "policy_rollout_progress": 0.5528696862393585,
+          "policy_rollout_success_rate": 0.23369565217391305,
+          "restore_max_error": 4.76837158203125e-07
+        },
+        "PullCube-v1": {
+          "action_mse_to_best": 0.6667322731135708,
+          "expert_success_rate": 0.25,
+          "num_groups": 76,
+          "oracle_success_rate": 0.40789473684210525,
+          "policy_expert_regret": 0.4254634598956296,
+          "policy_oracle_regret": 0.7053027871604028,
+          "policy_rollout_progress": 0.21283553334835328,
+          "policy_rollout_success_rate": 0.06578947368421052,
+          "restore_max_error": 4.76837158203125e-07
+        },
+        "PushCube-v1": {
+          "action_mse_to_best": 0.4085549002026652,
+          "expert_success_rate": 0.8198198198198198,
+          "num_groups": 111,
+          "oracle_success_rate": 1.0,
+          "policy_expert_regret": 0.3684367251557273,
+          "policy_oracle_regret": 0.4687258407876298,
+          "policy_rollout_progress": 0.7745174024556134,
+          "policy_rollout_success_rate": 0.7567567567567568,
+          "restore_max_error": 4.76837158203125e-07
+        },
+        "StackCube-v1": {
+          "action_mse_to_best": 0.639552435479485,
+          "expert_success_rate": 0.6923076923076923,
+          "num_groups": 91,
+          "oracle_success_rate": 0.8571428571428571,
+          "policy_expert_regret": 1.1711464825567308,
+          "policy_oracle_regret": 1.3307026618129605,
+          "policy_rollout_progress": 0.3457710957461661,
+          "policy_rollout_success_rate": 0.14285714285714285,
+          "restore_max_error": 3.948807716369629e-07
+        }
+      }
+    },
+    {
+      "config": "k8_sigma0.10",
+      "seed": 2,
+      "path": "/scratch/knguy52/dovla/experiments/dovla_h16_field_selected_noexpert_bc5_bestpt_field_sweep/k8_sigma0.10/seed_2/online_rollout.json",
+      "selection_mode": "field",
+      "num_candidates": 8,
+      "candidate_sigma": 0.1,
+      "field_optim_steps": 0,
+      "field_optim_step_size": 0.0,
+      "field_optim_trust_radius": 0.0,
+      "field_optim_l2_penalty": 0.0,
+      "retrieval_neighbors": 0,
+      "num_groups": 575,
+      "policy_rollout_success_rate": 0.31478260869565217,
+      "policy_rollout_progress": 0.5175978894505814,
+      "oracle_success_rate": 0.8765217391304347,
+      "action_mse_to_best": 0.48353652086270893,
+      "per_task": {
+        "LiftPegUpright-v1": {
+          "action_mse_to_best": 0.3778388290957082,
+          "expert_success_rate": 0.8229166666666666,
+          "num_groups": 96,
+          "oracle_success_rate": 0.9270833333333334,
+          "policy_expert_regret": 1.0527732948151727,
+          "policy_oracle_regret": 1.1730423748182754,
+          "policy_rollout_progress": 0.5550954629046222,
+          "policy_rollout_success_rate": 0.21875,
+          "restore_max_error": 3.5762786865234375e-07
+        },
+        "PickCube-v1": {
+          "action_mse_to_best": 0.3805342139017702,
+          "expert_success_rate": 0.9444444444444444,
+          "num_groups": 198,
+          "oracle_success_rate": 0.9595959595959596,
+          "policy_expert_regret": 1.0301365685357584,
+          "policy_oracle_regret": 1.0372200190644667,
+          "policy_rollout_progress": 0.5851750043380749,
+          "policy_rollout_success_rate": 0.3181818181818182,
+          "restore_max_error": 4.76837158203125e-07
+        },
+        "PullCube-v1": {
+          "action_mse_to_best": 0.7137743220043679,
+          "expert_success_rate": 0.24444444444444444,
+          "num_groups": 90,
+          "oracle_success_rate": 0.4666666666666667,
+          "policy_expert_regret": 0.42930986115501985,
+          "policy_oracle_regret": 0.705745512040125,
+          "policy_rollout_progress": 0.2533828056106965,
+          "policy_rollout_success_rate": 0.13333333333333333,
+          "restore_max_error": 4.0978193283081055e-07
+        },
+        "PushCube-v1": {
+          "action_mse_to_best": 0.45052769396564746,
+          "expert_success_rate": 0.8514851485148515,
+          "num_groups": 101,
+          "oracle_success_rate": 1.0,
+          "policy_expert_regret": 0.43760172889964416,
+          "policy_oracle_regret": 0.49276997871918254,
+          "policy_rollout_progress": 0.7646557638550749,
+          "policy_rollout_success_rate": 0.7425742574257426,
+          "restore_max_error": 4.76837158203125e-07
+        },
+        "StackCube-v1": {
+          "action_mse_to_best": 0.6296912386599515,
+          "expert_success_rate": 0.7666666666666667,
+          "num_groups": 90,
+          "oracle_success_rate": 0.9111111111111111,
+          "policy_expert_regret": 1.3062432550721699,
+          "policy_oracle_regret": 1.4550117486053042,
+          "policy_rollout_progress": 0.31589207202196123,
+          "policy_rollout_success_rate": 0.1111111111111111,
+          "restore_max_error": 4.76837158203125e-07
+        }
+      }
+    }
+  ]
+}

results/h16_policy_ckpt_field_selected_noexpert_bc5_bestpt_field_sweep_summary.md

@@ -0,0 +1,18 @@
+# h=16 Field-Guided Rollout Sweep
+
+Result root: `/scratch/knguy52/dovla/experiments/dovla_h16_field_selected_noexpert_bc5_bestpt_field_sweep`
+Completed result files: 12
+Baseline h=4 policy success: 29.67%
+Baseline h=16 policy success: 29.74%
+
+| config | seeds | mean success | gain vs h=16 | progress | action MSE |
+|---|---:|---:|---:|---:|---:|
+| k8_sigma0.10 | 3 | 27.65% | -2.09% | 50.31% | 0.471 |
+| k64_sigma0.50 | 3 | 27.07% | -2.67% | 49.60% | 0.489 |
+| k16_sigma0.20 | 3 | 26.84% | -2.90% | 49.61% | 0.474 |
+| k32_sigma0.35 | 3 | 26.72% | -3.01% | 49.38% | 0.482 |
+
+Best config:
+- k8_sigma0.10
+- mean success: 27.65%
+- gain vs h=16 policy: -2.09%

results/h16_policy_ckpt_field_selected_noexpert_bc5_summary.json

@@ -0,0 +1,277 @@
+{
+  "run_root": "/scratch/knguy52/dovla/experiments/dovla_h16_policy_ckpt_runs",
+  "objective": "field_selected_noexpert_bc5",
+  "out_name": "policy_rollout.json",
+  "num_completed": 3,
+  "baseline_h4_policy_success": 0.2967,
+  "baseline_h16_rank_checkpoint_success": 0.29739130434782607,
+  "mean_success": 0.2684057971014493,
+  "std_success": 0.060479078751281036,
+  "mean_progress": 0.49737596602975453,
+  "mean_action_mse_to_best": 0.4531931612484049,
+  "gain_vs_h4": -0.028294202898550724,
+  "gain_vs_h16_rank_checkpoint": -0.028985507246376774,
+  "rows": [
+    {
+      "seed": 0,
+      "path": "/scratch/knguy52/dovla/experiments/dovla_h16_policy_ckpt_runs/field_selected_noexpert_bc5/seed_0/policy_rollout.json",
+      "num_groups": 575,
+      "selection_mode": "policy",
+      "num_candidates": 1,
+      "candidate_sigma": 0.0,
+      "field_optim_steps": 0,
+      "field_optim_step_size": 0.0,
+      "field_optim_trust_radius": 0.0,
+      "field_optim_l2_penalty": 0.0,
+      "retrieval_neighbors": 0,
+      "policy_rollout_success_rate": 0.2,
+      "policy_rollout_progress": 0.4590369786613661,
+      "oracle_success_rate": 0.8573913043478261,
+      "action_mse_to_best": 0.43677694921098326,
+      "best_policy_val": {
+        "bc_loss": 0.20038707554340363,
+        "field_effect_loss": 0.010150647670444515,
+        "field_potential_loss": 0.24883300893836552,
+        "field_preference_loss": 0.5245596203539107,
+        "lattice_edges": 3833.3333333333335,
+        "progress_mae": 0.1846791985962126,
+        "rank_acc": 0.8240882919894325,
+        "rank_loss": 0.5245526432991028,
+        "regret_mae": 0.41100967427094776,
+        "success_accuracy": 0.8816119233767191,
+        "total_loss": 1.8707644608285692
+      },
+      "per_task": {
+        "LiftPegUpright-v1": {
+          "action_mse_to_best": 0.3570530945051116,
+          "expert_success_rate": 0.8865979381443299,
+          "num_groups": 97,
+          "oracle_success_rate": 0.9278350515463918,
+          "policy_expert_regret": 1.3238540102833325,
+          "policy_oracle_regret": 1.3634367666600906,
+          "policy_rollout_progress": 0.45710550156450763,
+          "policy_rollout_success_rate": 0.08247422680412371,
+          "restore_max_error": 4.76837158203125e-07
+        },
+        "PickCube-v1": {
+          "action_mse_to_best": 0.3344459112267941,
+          "expert_success_rate": 0.9375,
+          "num_groups": 208,
+          "oracle_success_rate": 0.9471153846153846,
+          "policy_expert_regret": 1.2608316384721547,
+          "policy_oracle_regret": 1.2608528731999775,
+          "policy_rollout_progress": 0.5009997645930315,
+          "policy_rollout_success_rate": 0.16346153846153846,
+          "restore_max_error": 4.76837158203125e-07
+        },
+        "PullCube-v1": {
+          "action_mse_to_best": 0.680206579047364,
+          "expert_success_rate": 0.19480519480519481,
+          "num_groups": 77,
+          "oracle_success_rate": 0.36363636363636365,
+          "policy_expert_regret": 0.3535010172900828,
+          "policy_oracle_regret": 0.5732873161262894,
+          "policy_rollout_progress": 0.2555536103567907,
+          "policy_rollout_success_rate": 0.09090909090909091,
+          "restore_max_error": 4.76837158203125e-07
+        },
+        "PushCube-v1": {
+          "action_mse_to_best": 0.3976371214784523,
+          "expert_success_rate": 0.8617021276595744,
+          "num_groups": 94,
+          "oracle_success_rate": 0.9893617021276596,
+          "policy_expert_regret": 0.6190679878630536,
+          "policy_oracle_regret": 0.7177435708172778,
+          "policy_rollout_progress": 0.6545968547146371,
+          "policy_rollout_success_rate": 0.6276595744680851,
+          "restore_max_error": 4.76837158203125e-07
+        },
+        "StackCube-v1": {
+          "action_mse_to_best": 0.5777176776618669,
+          "expert_success_rate": 0.6767676767676768,
+          "num_groups": 99,
+          "oracle_success_rate": 0.8585858585858586,
+          "policy_expert_regret": 1.2022333902241005,
+          "policy_oracle_regret": 1.4056525183747512,
+          "policy_rollout_progress": 0.34534692628817126,
+          "policy_rollout_success_rate": 0.0707070707070707,
+          "restore_max_error": 3.948807716369629e-07
+        }
+      }
+    },
+    {
+      "seed": 1,
+      "path": "/scratch/knguy52/dovla/experiments/dovla_h16_policy_ckpt_runs/field_selected_noexpert_bc5/seed_1/policy_rollout.json",
+      "num_groups": 575,
+      "selection_mode": "policy",
+      "num_candidates": 1,
+      "candidate_sigma": 0.0,
+      "field_optim_steps": 0,
+      "field_optim_step_size": 0.0,
+      "field_optim_trust_radius": 0.0,
+      "field_optim_l2_penalty": 0.0,
+      "retrieval_neighbors": 0,
+      "policy_rollout_success_rate": 0.31478260869565217,
+      "policy_rollout_progress": 0.5297623421640499,
+      "oracle_success_rate": 0.8695652173913043,
+      "action_mse_to_best": 0.4462703319169257,
+      "best_policy_val": {
+        "bc_loss": 0.1842877868976858,
+        "field_effect_loss": 0.0097798108537164,
+        "field_potential_loss": 0.2688092821174198,
+        "field_preference_loss": 0.5151831226216422,
+        "lattice_edges": 3833.3333333333335,
+        "progress_mae": 0.187625582019488,
+        "rank_acc": 0.8292942278914981,
+        "rank_loss": 0.5151734915044572,
+        "regret_mae": 0.364786328540908,
+        "success_accuracy": 0.8715837796529134,
+        "total_loss": 1.8006369206640456
+      },
+      "per_task": {
+        "LiftPegUpright-v1": {
+          "action_mse_to_best": 0.34565994232085295,
+          "expert_success_rate": 0.8584070796460177,
+          "num_groups": 113,
+          "oracle_success_rate": 0.9380530973451328,
+          "policy_expert_regret": 1.0717079918996422,
+          "policy_oracle_regret": 1.1398367760455714,
+          "policy_rollout_progress": 0.5687134840847117,
+          "policy_rollout_success_rate": 0.21238938053097345,
+          "restore_max_error": 4.76837158203125e-07
+        },
+        "PickCube-v1": {
+          "action_mse_to_best": 0.38182726992375177,
+          "expert_success_rate": 0.9402173913043478,
+          "num_groups": 184,
+          "oracle_success_rate": 0.9456521739130435,
+          "policy_expert_regret": 1.1353175368402963,
+          "policy_oracle_regret": 1.1428379987002066,
+          "policy_rollout_progress": 0.5414779179365091,
+          "policy_rollout_success_rate": 0.2391304347826087,
+          "restore_max_error": 4.76837158203125e-07
+        },
+        "PullCube-v1": {
+          "action_mse_to_best": 0.6262720288696552,
+          "expert_success_rate": 0.25,
+          "num_groups": 76,
+          "oracle_success_rate": 0.40789473684210525,
+          "policy_expert_regret": 0.4040453817793413,
+          "policy_oracle_regret": 0.6600335615343953,
+          "policy_rollout_progress": 0.21925117011721196,
+          "policy_rollout_success_rate": 0.07894736842105263,
+          "restore_max_error": 4.76837158203125e-07
+        },
+        "PushCube-v1": {
+          "action_mse_to_best": 0.3934799292133198,
+          "expert_success_rate": 0.8198198198198198,
+          "num_groups": 111,
+          "oracle_success_rate": 1.0,
+          "policy_expert_regret": 0.3318567147126069,
+          "policy_oracle_regret": 0.39898568257555234,
+          "policy_rollout_progress": 0.8082215246316549,
+          "policy_rollout_success_rate": 0.7927927927927928,
+          "restore_max_error": 4.76837158203125e-07
+        },
+        "StackCube-v1": {
+          "action_mse_to_best": 0.6155681688706953,
+          "expert_success_rate": 0.6923076923076923,
+          "num_groups": 91,
+          "oracle_success_rate": 0.8571428571428571,
+          "policy_expert_regret": 1.086109248818932,
+          "policy_oracle_regret": 1.2456936374470429,
+          "policy_rollout_progress": 0.3773748129606247,
+          "policy_rollout_success_rate": 0.2087912087912088,
+          "restore_max_error": 3.948807716369629e-07
+        }
+      }
+    },
+    {
+      "seed": 2,
+      "path": "/scratch/knguy52/dovla/experiments/dovla_h16_policy_ckpt_runs/field_selected_noexpert_bc5/seed_2/policy_rollout.json",
+      "num_groups": 575,
+      "selection_mode": "policy",
+      "num_candidates": 1,
+      "candidate_sigma": 0.0,
+      "field_optim_steps": 0,
+      "field_optim_step_size": 0.0,
+      "field_optim_trust_radius": 0.0,
+      "field_optim_l2_penalty": 0.0,
+      "retrieval_neighbors": 0,
+      "policy_rollout_success_rate": 0.29043478260869565,
+      "policy_rollout_progress": 0.5033285772638476,
+      "oracle_success_rate": 0.8765217391304347,
+      "action_mse_to_best": 0.4765322026173058,
+      "best_policy_val": {
+        "bc_loss": 0.1667875602013535,
+        "field_effect_loss": 0.009291487564850185,
+        "field_potential_loss": 0.2782222537530793,
+        "field_preference_loss": 0.5111869358354144,
+        "lattice_edges": 3833.3333333333335,
+        "progress_mae": 0.19110752642154694,
+        "rank_acc": 0.8316871755652957,
+        "rank_loss": 0.511167930232154,
+        "regret_mae": 0.3905289289024141,
+        "success_accuracy": 0.8701276878515879,
+        "total_loss": 1.715771006213294
+      },
+      "per_task": {
+        "LiftPegUpright-v1": {
+          "action_mse_to_best": 0.36919080032870016,
+          "expert_success_rate": 0.8229166666666666,
+          "num_groups": 96,
+          "oracle_success_rate": 0.9270833333333334,
+          "policy_expert_regret": 1.057313250998656,
+          "policy_oracle_regret": 1.1238391535977523,
+          "policy_rollout_progress": 0.567264037206769,
+          "policy_rollout_success_rate": 0.22916666666666666,
+          "restore_max_error": 3.5762786865234375e-07
+        },
+        "PickCube-v1": {
+          "action_mse_to_best": 0.3894048094410788,
+          "expert_success_rate": 0.9444444444444444,
+          "num_groups": 198,
+          "oracle_success_rate": 0.9595959595959596,
+          "policy_expert_regret": 1.0942561205928072,
+          "policy_oracle_regret": 1.108403751062173,
+          "policy_rollout_progress": 0.5686413978198261,
+          "policy_rollout_success_rate": 0.2777777777777778,
+          "restore_max_error": 4.76837158203125e-07
+        },
+        "PullCube-v1": {
+          "action_mse_to_best": 0.7008399473244531,
+          "expert_success_rate": 0.24444444444444444,
+          "num_groups": 90,
+          "oracle_success_rate": 0.4666666666666667,
+          "policy_expert_regret": 0.4289126294147637,
+          "policy_oracle_regret": 0.7427257450711396,
+          "policy_rollout_progress": 0.2430547617582811,
+          "policy_rollout_success_rate": 0.1111111111111111,
+          "restore_max_error": 4.0978193283081055e-07
+        },
+        "PushCube-v1": {
+          "action_mse_to_best": 0.4208698135496366,
+          "expert_success_rate": 0.8514851485148515,
+          "num_groups": 101,
+          "oracle_success_rate": 1.0,
+          "policy_expert_regret": 0.4975291885951958,
+          "policy_oracle_regret": 0.6072372276299071,
+          "policy_rollout_progress": 0.7095944555384097,
+          "policy_rollout_success_rate": 0.6831683168316832,
+          "restore_max_error": 4.76837158203125e-07
+        },
+        "StackCube-v1": {
+          "action_mse_to_best": 0.620867788626088,
+          "expert_success_rate": 0.7666666666666667,
+          "num_groups": 90,
+          "oracle_success_rate": 0.9111111111111111,
+          "policy_expert_regret": 1.2906039165125953,
+          "policy_oracle_regret": 1.4395524981949064,
+          "policy_rollout_progress": 0.32024021132124797,
+          "policy_rollout_success_rate": 0.12222222222222222,
+          "restore_max_error": 4.76837158203125e-07
+        }
+      }
+    }
+  ]
+}

results/h16_policy_ckpt_field_selected_noexpert_bc5_summary.md

@@ -0,0 +1,19 @@
+# h=16 Best-Policy Checkpoint Rollout
+
+Run root: `/scratch/knguy52/dovla/experiments/dovla_h16_policy_ckpt_runs`
+Objective: `field_selected_noexpert_bc5`
+Result file: `policy_rollout.json`
+Completed seeds: 3
+Baseline h=4 policy success: 29.67%
+Baseline h=16 rank-checkpoint success: 29.74%
+
+Mean success: 26.84% +/- 6.05%
+Gain vs h=16 rank checkpoint: -2.90%
+Mean progress: 49.74%
+Mean action MSE to best: 0.453
+
+| seed | mode | k | retrieval K | sigma | opt steps | trust | success | progress | oracle | action MSE |
+|---:|---|---:|---:|---:|---:|---:|---:|---:|---:|---:|
+| 0 | policy | 1 | 0 | 0.00 | 0 | 0.00 | 20.00% | 45.90% | 85.74% | 0.437 |
+| 1 | policy | 1 | 0 | 0.00 | 0 | 0.00 | 31.48% | 52.98% | 86.96% | 0.446 |
+| 2 | policy | 1 | 0 | 0.00 | 0 | 0.00 | 29.04% | 50.33% | 87.65% | 0.477 |