KAITANG2003 commited on
Commit
4db0ff0
·
verified ·
1 Parent(s): 411c31a

Separate LAW WAM from its complete VLM package

Browse files
Files changed (4) hide show
  1. README.md +7 -54
  2. q3/q3_config.json +0 -43
  3. q3/q3_state.pt +0 -3
  4. q3/source_checkpoint.json +0 -16
README.md CHANGED
@@ -2,62 +2,15 @@
2
  license: apache-2.0
3
  tags:
4
  - robotics
5
- - law
 
6
  ---
 
7
 
8
- # LAW-OpenWAM-20D
9
 
10
- Final 20D policy: OpenWAM step 120815 and Q3 step 50000. Uses the shared Q1/Q2 repository and the EEF20/unified80 conversion. Historical full evaluation: 95.56%; this historical benchmark was not rerun.
11
 
12
- ## Verified training and inference
13
 
14
- Validation completed on 2026-10-12 with the matching scoped LAW code.
15
- The tested code revision is `26141a69e32ad40b89eb765d4eeb6990ce013c2c`;
16
- subsequent documentation commits may retain the same tested numerical code.
17
- Matching code: [hey-cjj/LAW](https://github.com/hey-cjj/LAW). The tested code snapshot is retained in its Git history; see the repository checkpoint-binding and release-audit documents.
18
-
19
- All six selected training entry points ran on four nodes with eight A800 GPUs
20
- each (32 GPUs): FastWAM16D, OpenWAM20D, Q1, Q2, Q3-16D and Q3-20D.
21
- Each performed at least two actual optimizer updates and saved a nonempty,
22
- loadable checkpoint. Recorded losses and saved model tensors were finite.
23
- Q2 initialized from the Q1 checkpoint produced in that test. Both Q3 tests
24
- initialized from the selected historical shared Q1/Q2 model. The original
25
- batch/lr parameters, memory mode and ZeRO-1 settings were retained; only test
26
- length, checkpoint frequency and FastWAM loss logging frequency were shortened.
27
- The OpenWAM Accelerate 1.0.1 gradient-norm logging fix was tested in real training.
28
- VLM tests used fresh container-local environments. WAM fresh package installs
29
- were checked; the final repaired WAM tests reused verified isolated shared
30
- role environments without changing their packages.
31
-
32
- The selected final checkpoints passed matching loader/key/shape and bounded
33
- real inference checks for WAM, Q1/Q2 and both Q3 critics. Both complete production
34
- policy pipelines then completed one RoboTwin episode successfully on
35
- `pick_dual_bottles/demo_clean`, episode 0, fixed seed `4300000` (FastWAM 1/1,
36
- OpenWAM 1/1), including three-camera RGB/depth rendering, cuRobo planning,
37
- Q1 generation, Q3 scoring and action execution. Both used 32 candidates,
38
- 8 elites, micro-batch 32, and fixed Q2 done1 behavior with threshold 0.5.
39
- That episode produced one Q1 subtask; Q2 scores were checked separately and
40
- this episode is not evidence of a Q2-triggered subtask transition.
41
-
42
- These are real launch/update/save and inference/evaluation validations.
43
- They do not establish full retraining, a new full benchmark, or byte-for-byte
44
- historical reproduction. Existing latent caches were used for short training;
45
- no latent cache was rebuilt or uploaded. The cache-generation code is provided,
46
- but raw-download-to-new-cache-to-training was not rerun end to end.
47
-
48
- ## Checkpoint binding and download
49
-
50
- Five final groups are packaged across `LAW-16D` (WAM/Q3-16D), `LAW-OpenWAM-20D` (WAM/Q3-20D) and `LAW-Q1Q2` (shared VLM). Both WAMs use `first_layer_only` + `subtask` memory. Initialize training using the separate ActionDiT/Qwen/OpenWAM Alpha dependencies.
51
-
52
- Use the release downloader, `python scripts/download.py models --profile all`, to verify hashes and relocate original metadata. The original configuration snapshots may contain historical paths; the release prepares local configuration paths without altering tensors. Models remain private: authenticate using HF login or HF_TOKEN.
53
-
54
- ```python
55
- from huggingface_hub import snapshot_download
56
- snapshot_download("KAITANG2003/LAW-OpenWAM-20D", local_dir="checkpoints/LAW-OpenWAM-20D")
57
- ```
58
-
59
- See `MODEL_FILES.json` for original file sizes and SHA256. Historical Git/dirty-state and optimizer/RNG limits are recorded in the matching code release's `docs/checkpoint_binding.md`.
60
-
61
- ## License
62
-
63
- LAW-authored weights are Apache-2.0. Upstream licenses/notices are retained. See [LICENSE_WEIGHTS.txt](LICENSE_WEIGHTS.txt) and [LICENSE_SCOPE.md](LICENSE_SCOPE.md) for the full terms and scope. Code, annotations and original media have separate licensing.
 
2
  license: apache-2.0
3
  tags:
4
  - robotics
5
+ - LAW
6
+ - world-action-model
7
  ---
8
+ # LAW-OpenWAM
9
 
10
+ World-action model for **LAW + OpenWAM**, selected step-120,815 checkpoint. Use with the complete [LAW-VLM-OpenWAM](https://huggingface.co/KAITANG2003/LAW-VLM-OpenWAM) Q1/Q2/Q3 VLM.
11
 
12
+ Includes WAM weights, configuration and normalization statistics under `wam/`. The corresponding VLM is packaged separately. Original combined releases remain available in this repository's Git history.
13
 
14
+ Code and download guide: [hey-cjj/LAW](https://github.com/hey-cjj/LAW). Historical RoboTwin overall success: 95.56%. These are selected historical results, not a new benchmark. Six bounded 32-GPU training save/load checks and both bounded real RoboTwin policy episodes passed before this packaging change; see [release audit](https://github.com/hey-cjj/LAW/blob/main/docs/release_audit.md) for scope and historical provenance limits.
15
 
16
+ Tensor bytes are unchanged. LAW-authored trained weights/adapters are Apache-2.0; upstream materials retain their terms. See `LICENSE_WEIGHTS.txt` and `LICENSE_SCOPE.md`. Models remain private.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
q3/q3_config.json DELETED
@@ -1,43 +0,0 @@
1
- {
2
- "model": {
3
- "base_model": "/mnt/liying_ckp/qwen_ft/Qwen3-VL-2B-Instruct",
4
- "source_checkpoint": "/mnt/liying_ckp/qwen_ft/robotwin_qwen3vl_2b-fastwam-stage2-q2-lora_20260830_140608/checkpoint-50000",
5
- "q3_init": "q2_copy",
6
- "q3_lora_rank": 128,
7
- "q3_lora_alpha": 256,
8
- "q3_lora_target_modules": [
9
- "q_proj",
10
- "k_proj",
11
- "v_proj",
12
- "o_proj"
13
- ]
14
- },
15
- "data": {
16
- "sft_data_root": "/mnt/dataset/pku-data/robotwin_gt_depth_ee",
17
- "failure_data_root": "/mnt/dataset/pku-data/robotwin_failure_semantic_final_v2_train_v2",
18
- "exclude_sft_episodes": "/mnt/world_foundational_model/kai/dev/CogWAM/qwen-vl-progress-estimation/qwen-vl-finetune/config/robotwin_test_episodes.json",
19
- "failure_fraction": 0.25,
20
- "action_dt": 0.06,
21
- "horizon": 32,
22
- "action_dim": 20
23
- },
24
- "training": {
25
- "output_dir": "/mnt/kai_ckp/q3/robotwin_qwen3vl_2b-fastwam-stage3-q3-subtask-q2copy-attnonly-r128-20d-20260930/checkpoints",
26
- "max_steps": 50000,
27
- "per_device_train_batch_size": 8,
28
- "gradient_accumulation_steps": 1,
29
- "dataloader_num_workers": 4,
30
- "learning_rate": 1e-05,
31
- "weight_decay": 0.0,
32
- "warmup_steps": 1000,
33
- "save_steps": 2000,
34
- "model_max_length": 8192,
35
- "bf16": true,
36
- "gradient_checkpointing": true,
37
- "gradient_clip_norm": 1.0,
38
- "seed": 42,
39
- "num_nodes": 4,
40
- "gpus_per_node": 8,
41
- "expected_world_size": 32
42
- }
43
- }
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
q3/q3_state.pt DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:edae85178479b37360c3e62fe4f4ffff960086e9afcbfd9f55e1160f7c5bff10
3
- size 241345455
 
 
 
 
q3/source_checkpoint.json DELETED
@@ -1,16 +0,0 @@
1
- {
2
- "source_checkpoint": "/mnt/liying_ckp/qwen_ft/robotwin_qwen3vl_2b-fastwam-stage2-q2-lora_20260830_140608/checkpoint-50000",
3
- "q3_init": "q2_copy",
4
- "q3_lora_rank": 128,
5
- "q3_lora_alpha": 256,
6
- "q3_lora_target_modules": [
7
- "q_proj",
8
- "k_proj",
9
- "v_proj",
10
- "o_proj"
11
- ],
12
- "initialized_from_q3": null,
13
- "reward_mode": "subtask",
14
- "gt_reward_mode": "subtask",
15
- "rollout_reward_mode": "subtask"
16
- }