Commit ·
f172d9d
0
Parent(s):
Duplicate from yufanwei/CD-LAM
Browse files- .gitattributes +4 -0
- LICENSE.pdf +0 -0
- NOTICE +14 -0
- README.md +60 -0
- asset_manifest.json +0 -0
- models/lam/model.pt +3 -0
- models/posttrain/action_contract.json +30 -0
- models/posttrain/bridge.pt +3 -0
- models/posttrain/model.pt +3 -0
- models/pretrain/model.pt +3 -0
.gitattributes
ADDED
|
@@ -0,0 +1,4 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
| 2 |
+
*.pt filter=lfs diff=lfs merge=lfs -text
|
| 3 |
+
*.pth filter=lfs diff=lfs merge=lfs -text
|
| 4 |
+
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
LICENSE.pdf
ADDED
|
Binary file (79 kB). View file
|
|
|
NOTICE
ADDED
|
@@ -0,0 +1,14 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
CD-LAM
|
| 2 |
+
Copyright 2026 CD-LAM contributors
|
| 3 |
+
|
| 4 |
+
The checkpoint files are derivatives of an NVIDIA model. The complete
|
| 5 |
+
applicable NVIDIA Open Model License Agreement is included in
|
| 6 |
+
LICENSE.pdf.
|
| 7 |
+
|
| 8 |
+
Licensed by NVIDIA Corporation under the NVIDIA Open Model License
|
| 9 |
+
|
| 10 |
+
Built on NVIDIA Cosmos
|
| 11 |
+
|
| 12 |
+
The release does not redistribute the external NVIDIA base checkpoint,
|
| 13 |
+
datasets, SAM3, or CoWTracker. Those components retain their own terms; see
|
| 14 |
+
the model card and asset_manifest.json.
|
README.md
ADDED
|
@@ -0,0 +1,60 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: other
|
| 3 |
+
license_name: nvidia-open-model-license
|
| 4 |
+
license_link: https://www.nvidia.com/en-us/agreements/enterprise-software/nvidia-open-model-license/
|
| 5 |
+
library_name: pytorch
|
| 6 |
+
tags:
|
| 7 |
+
- latent-action-model
|
| 8 |
+
- world-model
|
| 9 |
+
- robotics
|
| 10 |
+
- video-prediction
|
| 11 |
+
- research
|
| 12 |
+
---
|
| 13 |
+
|
| 14 |
+
# CD-LAM
|
| 15 |
+
|
| 16 |
+
This repository contains three CD-LAM model entries.
|
| 17 |
+
|
| 18 |
+
| entry | file | role |
|
| 19 |
+
|---|---|---|
|
| 20 |
+
| LAM | `models/lam/model.pt` | 32D latent-action model |
|
| 21 |
+
| Pretrain | `models/pretrain/model.pt` | latent-action-conditioned world-model overlay |
|
| 22 |
+
| Posttrain | `models/posttrain/model.pt` | robot-action post-trained world-model overlay |
|
| 23 |
+
|
| 24 |
+
The posttrain folder also contains its required
|
| 25 |
+
`models/posttrain/bridge.pt` and
|
| 26 |
+
`models/posttrain/action_contract.json`. They are support files for the
|
| 27 |
+
posttrain entry, not additional models.
|
| 28 |
+
|
| 29 |
+
## Use with the source release
|
| 30 |
+
|
| 31 |
+
```bash
|
| 32 |
+
git clone https://github.com/yufanwei/CD-LAM.git
|
| 33 |
+
cd CD-LAM
|
| 34 |
+
bash setup.sh --accept-base-license --with-models
|
| 35 |
+
```
|
| 36 |
+
|
| 37 |
+
The source downloader pins an immutable Hub revision and verifies file sizes
|
| 38 |
+
and SHA-256 values from `asset_manifest.json`.
|
| 39 |
+
|
| 40 |
+
## Compatibility
|
| 41 |
+
|
| 42 |
+
The LAM and pretrain entries are compatible with each other. The posttrain
|
| 43 |
+
entry must use the bridge and action contract in the same folder.
|
| 44 |
+
|
| 45 |
+
The two world-model files are overlays and require the compatible external
|
| 46 |
+
NVIDIA 2B base checkpoint, Cosmos tokenizer, and text encoder. Exact revisions
|
| 47 |
+
are recorded in `asset_manifest.json` and the
|
| 48 |
+
[CD-LAM source release](https://github.com/yufanwei/CD-LAM).
|
| 49 |
+
|
| 50 |
+
## Scope
|
| 51 |
+
|
| 52 |
+
These are inference and evaluation research artifacts, not optimizer-resume
|
| 53 |
+
checkpoints, a robot policy, or a safety controller. Model identity and tensor
|
| 54 |
+
verification do not by themselves reproduce the manuscript tables.
|
| 55 |
+
|
| 56 |
+
## License and citation
|
| 57 |
+
|
| 58 |
+
Read `NOTICE` and `LICENSE.pdf` before using the checkpoints. Built on NVIDIA Cosmos.
|
| 59 |
+
The paper BibTeX entry is available in the source repository's
|
| 60 |
+
[README](https://github.com/yufanwei/CD-LAM#citation).
|
asset_manifest.json
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|
models/lam/model.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:084f9b1ad1e09926c217a0fe7668e672f2e93b89314a4ff18eeed20b6b5cb6ee
|
| 3 |
+
size 2839525895
|
models/posttrain/action_contract.json
ADDED
|
@@ -0,0 +1,30 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"schema_version": 1,
|
| 3 |
+
"contract_id": "agibot-alpha-22d-raw-adjacent-stride4",
|
| 4 |
+
"embodiment": "agibot",
|
| 5 |
+
"action_dim": 22,
|
| 6 |
+
"action_tokens": 12,
|
| 7 |
+
"block_size": 4,
|
| 8 |
+
"source_stride": 4,
|
| 9 |
+
"loader_representation": "minmax_normalized_block_anchor_cumulative_delta",
|
| 10 |
+
"bridge_representation": "raw_adjacent_stride_delta",
|
| 11 |
+
"stats_relative_path": "shared_meta/AgiBot_stats.json",
|
| 12 |
+
"stats_sha256": "ea3999b4141236cf41c702b6c618bc6ab9ee696a80f154eaa91efbbf88fbd72b",
|
| 13 |
+
"modality_relative_path": "shared_meta/AgiBot_modality.json",
|
| 14 |
+
"modality_sha256": "29fd7cec495ddeb0baa8e6d13c3d73a259a1bb2447b7afb5fe2390f1e223a4ed",
|
| 15 |
+
"metadata_source_repository": "https://github.com/NVIDIA/DreamDojo.git",
|
| 16 |
+
"metadata_source_revision": "02f119b759d5c7f84a399fdeea3c6e82e7ed6cff",
|
| 17 |
+
"legacy_bridge_sha256_by_scale_family": {
|
| 18 |
+
"posttrain": "346710032ca50ba18876d2727981b18db60cb9e7bea1d6efdb10056bb7232fdd"
|
| 19 |
+
},
|
| 20 |
+
"layout": [
|
| 21 |
+
{"name": "left_arm_joint_position", "start": 0, "end": 7},
|
| 22 |
+
{"name": "right_arm_joint_position", "start": 7, "end": 14},
|
| 23 |
+
{"name": "left_effector_position", "start": 14, "end": 15},
|
| 24 |
+
{"name": "right_effector_position", "start": 15, "end": 16},
|
| 25 |
+
{"name": "head_position", "start": 16, "end": 18},
|
| 26 |
+
{"name": "waist_pitch", "start": 18, "end": 19},
|
| 27 |
+
{"name": "waist_lift", "start": 19, "end": 20},
|
| 28 |
+
{"name": "robot_velocity", "start": 20, "end": 22}
|
| 29 |
+
]
|
| 30 |
+
}
|
models/posttrain/bridge.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:e3ab4ed2fe755d7e4fb127ef8f0e9d05feda859855d05f4509797f1bae301e8a
|
| 3 |
+
size 639927
|
models/posttrain/model.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:07440025c3780f907fb2b87c27263343b02e2464f3be658f07543aada088d86c
|
| 3 |
+
size 4303229324
|
models/pretrain/model.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:8b06cebedc3fadc64b4795bd3730b29c794ba8bf38a237c5bf19e1e3aca74b9c
|
| 3 |
+
size 4303229324
|