Update README for epoch 300
Browse files
README.md
CHANGED
|
@@ -1,3 +1,53 @@
|
|
| 1 |
---
|
| 2 |
license: mit
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 3 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
license: mit
|
| 3 |
+
tags:
|
| 4 |
+
- robotics
|
| 5 |
+
- libero
|
| 6 |
+
- oat
|
| 7 |
+
- dense-visual-memory
|
| 8 |
---
|
| 9 |
+
|
| 10 |
+
# OAT Dense LIBERO-10 — Checkpoint Epoch 300
|
| 11 |
+
|
| 12 |
+
Hugging Face model repository for a **dense cross-attention OAT policy** trained on
|
| 13 |
+
**LIBERO-10 (N500)**. This snapshot was taken at **epoch 300** during a long run
|
| 14 |
+
(`.tmp_ladder_logs`).
|
| 15 |
+
|
| 16 |
+
## Files
|
| 17 |
+
|
| 18 |
+
| File | Description |
|
| 19 |
+
|------|-------------|
|
| 20 |
+
| `ep-0300.ckpt` | PyTorch workspace checkpoint (~729 MB) |
|
| 21 |
+
| `ep-0300_upload_meta.json` | Offline metrics at upload time |
|
| 22 |
+
| `training_metrics_dashboard.png` | Training curves (dark dashboard) |
|
| 23 |
+
|
| 24 |
+
## Offline metrics @ epoch 300
|
| 25 |
+
|
| 26 |
+
| Metric | Value |
|
| 27 |
+
|--------|------:|
|
| 28 |
+
| Train loss | 2.4420902729034424 |
|
| 29 |
+
| Val loss | 5.05718469619751 |
|
| 30 |
+
| Test reconst MSE | 0.07346421480178833 |
|
| 31 |
+
|
| 32 |
+

|
| 33 |
+
|
| 34 |
+
## Model configuration (summary)
|
| 35 |
+
|
| 36 |
+
- **Policy:** OAT with `use_dense_visual_memory=true` (spatial visual tokens + cross-attn)
|
| 37 |
+
- **State memory:** enabled (`use_state_memory_tokens=true`)
|
| 38 |
+
- **Task UID:** enabled in state tokens
|
| 39 |
+
- **Dataset:** `libero10_N500.zarr`
|
| 40 |
+
- **Embed dim:** 256
|
| 41 |
+
|
| 42 |
+
## Evaluation note
|
| 43 |
+
|
| 44 |
+
Training used `lazy_eval=true` (no in-loop LIBERO rollout). **Success rate (SR)** must be
|
| 45 |
+
measured separately via `scripts/eval_policy_sim.py` on this checkpoint.
|
| 46 |
+
|
| 47 |
+
Reference (paper, pooled OAT8 on LIBERO-10): **~56.3%** mean success rate — external
|
| 48 |
+
baseline, not reproduced in this repo.
|
| 49 |
+
|
| 50 |
+
## Citation
|
| 51 |
+
|
| 52 |
+
If you use this checkpoint, please cite **OAT: Ordered Action Tokenization** and specify
|
| 53 |
+
epoch **300** of the dense LIBERO-10 ladder.
|