checkpoints/ogbench/README.md

# OGBench Checkpoints

## Scene-Play-v0 (Manipulation)

Best result: **48% GSC+Resampling+Pruning** (50 episodes, seed=0)

### Checkpoints

| Component | File | Training Steps | Notes |
|-----------|------|---------------|-------|
| Planner (original) | `scene-play/planner/state_1495000.pt` | 1.5M | `energy_based_compdfu`, batch=170, 8 GPUs |
| Planner (ogb_v1) | `scene-play/planner/ogb_v1_state_1495000.pt` | 1.5M | Re-trained, batch=128, 4 GPUs. **Better: 52% with same invdyn** |
| InvDyn | `scene-play/invdyn/state_1600000.pt` | 1.6M | `invdyn_scene_h150`, batch=32, horizon=150, uniform goal sampling |

### Eval Configs (50 episodes, seed=0)

| Config | Overall | T1 (open) | T2 (unlock) | T3 (rearrange) | T4 (drawer) | T5 (hard) |
|--------|---------|-----------|-------------|----------------|-------------|-----------|
| GSC | 36% | 70% | 40% | 50% | 10% | 10% |
| GSC+Resampling (U=10,min=10) | 40% | 70% | 20% | 60% | 50% | 0% |
| **GSC+Resamp+Pruning** | **48%** | **80%** | **50%** | **70%** | 30% | 10% |

### Reproduction Commands

```bash
# GSC (baseline)
CUDA_VISIBLE_DEVICES=0,1,2,3 torchrun --nproc_per_node=4 --master_port=29590 \
    -m src.compdiffuser.eval_sceneplay --env scene-play-v0 \
    --planner_name energy_based_compdfu --planner_epoch 1495000 \
    --invdyn_name invdyn_scene_h150 --invdyn_epoch 1600000 \
    --n_trials_per_task 10 --seed 0 \
    --ev_cp_infer_t_type gsc --ddim_steps 50 --cond_w 2.0 \
    --b_size_per_prob 40 --n_max_steps 1500

# GSC + Resampling (uniform U=10)
# Add: --ev_cp_infer_t_type gsc_resampling --num_resampling_steps 10 --min_resampling_steps 10

# GSC + Resampling + Pruning (best)
# Add: --ev_cp_infer_t_type gsc_resampling_pruning --num_resampling_steps 10 --min_resampling_steps 10 \
#      --pruning_start 0.5 --cv_threshold 0.01 --undo_eta 0.5 --use_gradient_ovlp --pruning_score_type inversion
```

### Critical Training Notes

- **InvDyn batch_size=32 is essential.** Batch=1024 gives 0-8%. The original invdyn_scene_h150 used batch=32.
- **InvDyn horizon=150** enables multi-step pick-place. Horizon=12 (default) gives 0%.
- **goal_sel_idxs must match plan_obs_select_dim**: `12 13 14 19 20 21 26 27 28 29 32 33 36 38`
- Planner ogb_v1 (re-trained) gets 52% with same invdyn — better than original 46%.

## Cube-Single-Play-v0

Best result: **28% GSC+Resampling** (50 episodes, planner at 1.5M)

| Component | File | Training Steps |
|-----------|------|---------------|
| Planner | `cube-single/planner/state_1495000.pt` | 1.5M |
| InvDyn | `cube-single/invdyn/state_1800000.pt` | 1.8M |

Cube-single invdyn was trained with batch=1024 (needs retraining with batch=32 for better results).