Separate LAW WAM from its complete VLM package
Browse files- README.md +7 -54
- q3/q3_config.json +0 -43
- q3/q3_state.pt +0 -3
- q3/source_checkpoint.json +0 -16
README.md
CHANGED
|
@@ -2,62 +2,15 @@
|
|
| 2 |
license: apache-2.0
|
| 3 |
tags:
|
| 4 |
- robotics
|
| 5 |
-
-
|
|
|
|
| 6 |
---
|
|
|
|
| 7 |
|
| 8 |
-
|
| 9 |
|
| 10 |
-
|
| 11 |
|
| 12 |
-
|
| 13 |
|
| 14 |
-
|
| 15 |
-
The tested code revision is `26141a69e32ad40b89eb765d4eeb6990ce013c2c`;
|
| 16 |
-
subsequent documentation commits may retain the same tested numerical code.
|
| 17 |
-
Matching code: [hey-cjj/LAW](https://github.com/hey-cjj/LAW). The tested code snapshot is retained in its Git history; see the repository checkpoint-binding and release-audit documents.
|
| 18 |
-
|
| 19 |
-
All six selected training entry points ran on four nodes with eight A800 GPUs
|
| 20 |
-
each (32 GPUs): FastWAM16D, OpenWAM20D, Q1, Q2, Q3-16D and Q3-20D.
|
| 21 |
-
Each performed at least two actual optimizer updates and saved a nonempty,
|
| 22 |
-
loadable checkpoint. Recorded losses and saved model tensors were finite.
|
| 23 |
-
Q2 initialized from the Q1 checkpoint produced in that test. Both Q3 tests
|
| 24 |
-
initialized from the selected historical shared Q1/Q2 model. The original
|
| 25 |
-
batch/lr parameters, memory mode and ZeRO-1 settings were retained; only test
|
| 26 |
-
length, checkpoint frequency and FastWAM loss logging frequency were shortened.
|
| 27 |
-
The OpenWAM Accelerate 1.0.1 gradient-norm logging fix was tested in real training.
|
| 28 |
-
VLM tests used fresh container-local environments. WAM fresh package installs
|
| 29 |
-
were checked; the final repaired WAM tests reused verified isolated shared
|
| 30 |
-
role environments without changing their packages.
|
| 31 |
-
|
| 32 |
-
The selected final checkpoints passed matching loader/key/shape and bounded
|
| 33 |
-
real inference checks for WAM, Q1/Q2 and both Q3 critics. Both complete production
|
| 34 |
-
policy pipelines then completed one RoboTwin episode successfully on
|
| 35 |
-
`pick_dual_bottles/demo_clean`, episode 0, fixed seed `4300000` (FastWAM 1/1,
|
| 36 |
-
OpenWAM 1/1), including three-camera RGB/depth rendering, cuRobo planning,
|
| 37 |
-
Q1 generation, Q3 scoring and action execution. Both used 32 candidates,
|
| 38 |
-
8 elites, micro-batch 32, and fixed Q2 done1 behavior with threshold 0.5.
|
| 39 |
-
That episode produced one Q1 subtask; Q2 scores were checked separately and
|
| 40 |
-
this episode is not evidence of a Q2-triggered subtask transition.
|
| 41 |
-
|
| 42 |
-
These are real launch/update/save and inference/evaluation validations.
|
| 43 |
-
They do not establish full retraining, a new full benchmark, or byte-for-byte
|
| 44 |
-
historical reproduction. Existing latent caches were used for short training;
|
| 45 |
-
no latent cache was rebuilt or uploaded. The cache-generation code is provided,
|
| 46 |
-
but raw-download-to-new-cache-to-training was not rerun end to end.
|
| 47 |
-
|
| 48 |
-
## Checkpoint binding and download
|
| 49 |
-
|
| 50 |
-
Five final groups are packaged across `LAW-16D` (WAM/Q3-16D), `LAW-OpenWAM-20D` (WAM/Q3-20D) and `LAW-Q1Q2` (shared VLM). Both WAMs use `first_layer_only` + `subtask` memory. Initialize training using the separate ActionDiT/Qwen/OpenWAM Alpha dependencies.
|
| 51 |
-
|
| 52 |
-
Use the release downloader, `python scripts/download.py models --profile all`, to verify hashes and relocate original metadata. The original configuration snapshots may contain historical paths; the release prepares local configuration paths without altering tensors. Models remain private: authenticate using HF login or HF_TOKEN.
|
| 53 |
-
|
| 54 |
-
```python
|
| 55 |
-
from huggingface_hub import snapshot_download
|
| 56 |
-
snapshot_download("KAITANG2003/LAW-OpenWAM-20D", local_dir="checkpoints/LAW-OpenWAM-20D")
|
| 57 |
-
```
|
| 58 |
-
|
| 59 |
-
See `MODEL_FILES.json` for original file sizes and SHA256. Historical Git/dirty-state and optimizer/RNG limits are recorded in the matching code release's `docs/checkpoint_binding.md`.
|
| 60 |
-
|
| 61 |
-
## License
|
| 62 |
-
|
| 63 |
-
LAW-authored weights are Apache-2.0. Upstream licenses/notices are retained. See [LICENSE_WEIGHTS.txt](LICENSE_WEIGHTS.txt) and [LICENSE_SCOPE.md](LICENSE_SCOPE.md) for the full terms and scope. Code, annotations and original media have separate licensing.
|
|
|
|
| 2 |
license: apache-2.0
|
| 3 |
tags:
|
| 4 |
- robotics
|
| 5 |
+
- LAW
|
| 6 |
+
- world-action-model
|
| 7 |
---
|
| 8 |
+
# LAW-OpenWAM
|
| 9 |
|
| 10 |
+
World-action model for **LAW + OpenWAM**, selected step-120,815 checkpoint. Use with the complete [LAW-VLM-OpenWAM](https://huggingface.co/KAITANG2003/LAW-VLM-OpenWAM) Q1/Q2/Q3 VLM.
|
| 11 |
|
| 12 |
+
Includes WAM weights, configuration and normalization statistics under `wam/`. The corresponding VLM is packaged separately. Original combined releases remain available in this repository's Git history.
|
| 13 |
|
| 14 |
+
Code and download guide: [hey-cjj/LAW](https://github.com/hey-cjj/LAW). Historical RoboTwin overall success: 95.56%. These are selected historical results, not a new benchmark. Six bounded 32-GPU training save/load checks and both bounded real RoboTwin policy episodes passed before this packaging change; see [release audit](https://github.com/hey-cjj/LAW/blob/main/docs/release_audit.md) for scope and historical provenance limits.
|
| 15 |
|
| 16 |
+
Tensor bytes are unchanged. LAW-authored trained weights/adapters are Apache-2.0; upstream materials retain their terms. See `LICENSE_WEIGHTS.txt` and `LICENSE_SCOPE.md`. Models remain private.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
q3/q3_config.json
DELETED
|
@@ -1,43 +0,0 @@
|
|
| 1 |
-
{
|
| 2 |
-
"model": {
|
| 3 |
-
"base_model": "/mnt/liying_ckp/qwen_ft/Qwen3-VL-2B-Instruct",
|
| 4 |
-
"source_checkpoint": "/mnt/liying_ckp/qwen_ft/robotwin_qwen3vl_2b-fastwam-stage2-q2-lora_20260830_140608/checkpoint-50000",
|
| 5 |
-
"q3_init": "q2_copy",
|
| 6 |
-
"q3_lora_rank": 128,
|
| 7 |
-
"q3_lora_alpha": 256,
|
| 8 |
-
"q3_lora_target_modules": [
|
| 9 |
-
"q_proj",
|
| 10 |
-
"k_proj",
|
| 11 |
-
"v_proj",
|
| 12 |
-
"o_proj"
|
| 13 |
-
]
|
| 14 |
-
},
|
| 15 |
-
"data": {
|
| 16 |
-
"sft_data_root": "/mnt/dataset/pku-data/robotwin_gt_depth_ee",
|
| 17 |
-
"failure_data_root": "/mnt/dataset/pku-data/robotwin_failure_semantic_final_v2_train_v2",
|
| 18 |
-
"exclude_sft_episodes": "/mnt/world_foundational_model/kai/dev/CogWAM/qwen-vl-progress-estimation/qwen-vl-finetune/config/robotwin_test_episodes.json",
|
| 19 |
-
"failure_fraction": 0.25,
|
| 20 |
-
"action_dt": 0.06,
|
| 21 |
-
"horizon": 32,
|
| 22 |
-
"action_dim": 20
|
| 23 |
-
},
|
| 24 |
-
"training": {
|
| 25 |
-
"output_dir": "/mnt/kai_ckp/q3/robotwin_qwen3vl_2b-fastwam-stage3-q3-subtask-q2copy-attnonly-r128-20d-20260930/checkpoints",
|
| 26 |
-
"max_steps": 50000,
|
| 27 |
-
"per_device_train_batch_size": 8,
|
| 28 |
-
"gradient_accumulation_steps": 1,
|
| 29 |
-
"dataloader_num_workers": 4,
|
| 30 |
-
"learning_rate": 1e-05,
|
| 31 |
-
"weight_decay": 0.0,
|
| 32 |
-
"warmup_steps": 1000,
|
| 33 |
-
"save_steps": 2000,
|
| 34 |
-
"model_max_length": 8192,
|
| 35 |
-
"bf16": true,
|
| 36 |
-
"gradient_checkpointing": true,
|
| 37 |
-
"gradient_clip_norm": 1.0,
|
| 38 |
-
"seed": 42,
|
| 39 |
-
"num_nodes": 4,
|
| 40 |
-
"gpus_per_node": 8,
|
| 41 |
-
"expected_world_size": 32
|
| 42 |
-
}
|
| 43 |
-
}
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
q3/q3_state.pt
DELETED
|
@@ -1,3 +0,0 @@
|
|
| 1 |
-
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:edae85178479b37360c3e62fe4f4ffff960086e9afcbfd9f55e1160f7c5bff10
|
| 3 |
-
size 241345455
|
|
|
|
|
|
|
|
|
|
|
|
q3/source_checkpoint.json
DELETED
|
@@ -1,16 +0,0 @@
|
|
| 1 |
-
{
|
| 2 |
-
"source_checkpoint": "/mnt/liying_ckp/qwen_ft/robotwin_qwen3vl_2b-fastwam-stage2-q2-lora_20260830_140608/checkpoint-50000",
|
| 3 |
-
"q3_init": "q2_copy",
|
| 4 |
-
"q3_lora_rank": 128,
|
| 5 |
-
"q3_lora_alpha": 256,
|
| 6 |
-
"q3_lora_target_modules": [
|
| 7 |
-
"q_proj",
|
| 8 |
-
"k_proj",
|
| 9 |
-
"v_proj",
|
| 10 |
-
"o_proj"
|
| 11 |
-
],
|
| 12 |
-
"initialized_from_q3": null,
|
| 13 |
-
"reward_mode": "subtask",
|
| 14 |
-
"gt_reward_mode": "subtask",
|
| 15 |
-
"rollout_reward_mode": "subtask"
|
| 16 |
-
}
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|