qiuly's picture
Add files using upload-large-folder tool
82369e4 verified
|
Raw
History Blame Contribute Delete
1.06 kB
# Mn Evaluation Results
`task_config = demo_clean`, `instruction_type = unseen`, 100 episodes per task.
Each task is evaluated with its own separately trained execution-module checkpoint
and its own normalization stats.
| Task | action_horizon | Success Rate | Reward |
|--------------------|:--------------:|:------------:|:------:|
| battery_try | 15 | **0.21** | 0.00 |
| blocks_ranking_try | 15 | **0.15** | 0.00 |
| cover_blocks | 8 | **0.76** | 0.82 |
| press_button | 30 | **0.02** | 0.00 |
| **Average** | β€” | **0.285** | β€” |
## Action horizon
Per-task inference-time `action_horizon` settings:
- `battery_try` β€” **15**
- `blocks_ranking_try` β€” **15**
- `cover_blocks` β€” **8**
- `press_button` β€” **30**
All results above were produced with these values.
## Files
- `<task>/episode0.mp4 … episode99.mp4` β€” full rollout videos (100 per task)
- `<task>/_result.txt` β€” raw score file for that run