Zyuan123 commited on
Commit
7db122e
·
verified ·
1 Parent(s): 2a7c83e

test: add E2 MLP Core4 model card

Browse files
e2_mlp_core4_current_state_20260910/README.md ADDED
@@ -0,0 +1,72 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ tags:
4
+ - robotics
5
+ - imitation-learning
6
+ - dexflow
7
+ - residual-mlp
8
+ - dexterous-manipulation
9
+ library_name: pytorch
10
+ ---
11
+
12
+ # DexFlow MLP Core4 Stage-2 (E2)
13
+
14
+ Human HandFlow + current object-state pretrain → robot 41D Residual MLP.
15
+
16
+ Org: [Humantwin](https://huggingface.co/Humantwin)
17
+ Repo path on Hub: `e2_mlp_core4_current_state_20260910/`
18
+
19
+ **Not ACT / DiT.** `DexFlowMLPPolicy` (`policy_variant=dexflow_mlp`).
20
+
21
+ ## Architecture
22
+
23
+ ```text
24
+ RGB 480×640 → act41_resize_pad 224 + ImageNet
25
+ → ResNet18 → Z_int [8×256] → Residual MLP → action chunk [30, 41]
26
+ ```
27
+
28
+ - `n_obs=1`, chunk 30 @ 30 Hz, no temporal ensemble, RTC off
29
+ - Deploy: publish 30/30, infer interval ≥1.05 s
30
+ - Normalization: per-task MEAN_STD `norm_stats.json` in the same folder
31
+ - Transfer: backbone 100 + interaction 42; action head 0
32
+
33
+ ## Checkpoints (30k, G2 PASS)
34
+
35
+ Same 10-ep robot set per task. Stage-1: `dexflow_mlp_stage1_core4_current_state_gate_20260910/stage1_step02000.ckpt`. Seed `20260910`.
36
+
37
+ | Task dir | Robot task | Open-loop nRMSE |
38
+ |---|---|---:|
39
+ | `plastic/` | bottle_upright | 0.0458 |
40
+ | `pill/` | med_bottle_into_box | 0.0599 |
41
+ | `open/` | open_box_lid | 0.0508 |
42
+ | `realsense/` | realsense_box_into_box | 0.0594 |
43
+
44
+ Each folder:
45
+
46
+ ```text
47
+ {task}/stage2.ckpt
48
+ {task}/norm_stats.json
49
+ ```
50
+
51
+ ## Load
52
+
53
+ ```python
54
+ from deploy.real_robot.ablation_e2_interaction_pretrain import load_task
55
+
56
+ model, normalizer = load_task("e2_mlp_core4_current_state_20260910", "plastic", device="cuda")
57
+ # image [B,1,3,480,640] float 0-1; state [B,41] MEAN_STD-normalized
58
+ chunk_n = model.predict_action_chunk({"image": img, "state": state_n})
59
+ action = normalizer.unnormalize_action(chunk_n) # [B,30,41] raw
60
+ ```
61
+
62
+ Or:
63
+
64
+ ```python
65
+ from deploy.real_robot.load_p0_policy import load_dexflow_policy
66
+ from dexflow.data.normalize import ActionStateNormalizer
67
+
68
+ model = load_dexflow_policy("plastic/stage2.ckpt", device="cuda")
69
+ normalizer = ActionStateNormalizer.load("plastic/norm_stats.json")
70
+ ```
71
+
72
+ Code pack: `dexflow_mlp_infer_20260914.tar.zst` (model + inference, no weights).