Yuyang-z commited on
Commit
97d3db5
·
verified ·
1 Parent(s): 1ca9d17

Publish LingBot as a LoRA-only adapter

Browse files

Remove merged transformer files and update the model card and integrity manifest. Adapter weights and configuration are unchanged.

README.md CHANGED
@@ -17,7 +17,7 @@ tags:
17
 
18
  # WORL-Lingbot
19
 
20
- **WORL-Lingbot** is a camera-conditioned video world-model policy trained with
21
  WORL on top of [LingBot-World-Fast](https://huggingface.co/robbyant/lingbot-world-fast).
22
  It generates video continuations conditioned on an initial image, text and
23
  camera trajectories.
@@ -35,15 +35,13 @@ and [WORL-Helios](https://huggingface.co/Efficient-Large-Model/WORL-Helios).
35
  | Base revision | `b7a1db2da9bd3ba675ee01c228f41db0309b981e` |
36
  | Base subfolder | `lingbot_world_fast` |
37
  | Architecture | Camera-conditioned `WanModelFast` transformer |
38
- | Release formats | BF16 PEFT LoRA adapter and merged BF16 transformer |
39
  | LoRA rank / alpha | 128 / 128 |
40
- | Merged parameter count | 18,544,332,864 |
41
  | Output geometry documented by the source release | 81 frames, 832 × 464 pixels, 16 FPS |
42
 
43
- The two formats represent the same released policy. The merged transformer
44
- has the adapter incorporated and does not need PEFT for inference. Both forms
45
- still require the compatible text encoder, tokenizer, VAE, scheduler and
46
- LingBot runtime, which are not included in this repository.
47
 
48
  ## Inputs and outputs
49
 
@@ -73,35 +71,12 @@ dataset is distributed separately from these weights.
73
 
74
  ## Download and load
75
 
76
- For the adapter only:
77
-
78
- ```bash
79
- hf download Efficient-Large-Model/WORL-Lingbot \
80
- --exclude 'merged/*' \
81
- --local-dir artifacts/WORL-Lingbot
82
- ```
83
-
84
- For the full repository, including the merged transformer:
85
-
86
  ```bash
87
  hf download Efficient-Large-Model/WORL-Lingbot --local-dir artifacts/WORL-Lingbot
88
  ```
89
 
90
- With a compatible LingBot runtime installed, load the merged transformer:
91
-
92
- ```python
93
- import torch
94
- from wan.modules.model_fast import WanModelFast
95
-
96
- model = WanModelFast.from_pretrained(
97
- "Efficient-Large-Model/WORL-Lingbot",
98
- subfolder="merged",
99
- torch_dtype=torch.bfloat16,
100
- control_type="cam",
101
- ).eval()
102
- ```
103
-
104
- Alternatively, attach the adapter to the pinned base transformer:
105
 
106
  ```python
107
  import torch
@@ -122,7 +97,7 @@ model = PeftModel.from_pretrained(
122
  ).eval()
123
  ```
124
 
125
- These examples load the transformer. Integrate it with the remaining compatible
126
  pipeline components for complete video generation.
127
 
128
  ## Files and provenance
@@ -131,19 +106,14 @@ pipeline components for complete video generation.
131
  | --- | --- |
132
  | `adapter_model.safetensors` | Approximately 1.23 GB BF16 adapter |
133
  | `adapter_config.json` | PEFT configuration |
134
- | `merged/` | Eight indexed BF16 transformer shards, approximately 37.09 GB, and config |
135
- | `merged/SHA256SUMS` | Checksums for the merged files |
136
  | `RELEASE_MANIFEST.json` | Source revision and SHA-256 inventory |
137
 
138
- Weights and model configurations are unchanged from
139
  [qyoo/lingbot-worl at d3e449c675f5](https://huggingface.co/qyoo/lingbot-worl/tree/d3e449c675f5a8bfb3afd29e30f1675e4445b9c3).
140
- Documentation and release manifests were updated for this repository. Original
141
- export, merge and load records remain available at that source revision.
142
-
143
- The source records report a safe PEFT merge, matching sampled merged weights,
144
- and an H100 reload with no remaining LoRA state keys. Those checks establish
145
- merge/load behavior, not a new training run or a general performance claim.
146
- No new GPU benchmark was performed for this publication.
147
 
148
  ## Intended use and limitations
149
 
 
17
 
18
  # WORL-Lingbot
19
 
20
+ **WORL-Lingbot** is a camera-conditioned video world-model LoRA adapter trained with
21
  WORL on top of [LingBot-World-Fast](https://huggingface.co/robbyant/lingbot-world-fast).
22
  It generates video continuations conditioned on an initial image, text and
23
  camera trajectories.
 
35
  | Base revision | `b7a1db2da9bd3ba675ee01c228f41db0309b981e` |
36
  | Base subfolder | `lingbot_world_fast` |
37
  | Architecture | Camera-conditioned `WanModelFast` transformer |
38
+ | Release format | BF16 PEFT LoRA adapter |
39
  | LoRA rank / alpha | 128 / 128 |
 
40
  | Output geometry documented by the source release | 81 frames, 832 × 464 pixels, 16 FPS |
41
 
42
+ Load this adapter on top of the pinned LingBot-World-Fast base transformer.
43
+ The compatible base transformer, text encoder, tokenizer, VAE, scheduler and
44
+ LingBot runtime are required separately.
 
45
 
46
  ## Inputs and outputs
47
 
 
71
 
72
  ## Download and load
73
 
 
 
 
 
 
 
 
 
 
 
74
  ```bash
75
  hf download Efficient-Large-Model/WORL-Lingbot --local-dir artifacts/WORL-Lingbot
76
  ```
77
 
78
+ With a compatible LingBot runtime installed, attach the adapter to the pinned
79
+ base transformer:
 
 
 
 
 
 
 
 
 
 
 
 
 
80
 
81
  ```python
82
  import torch
 
97
  ).eval()
98
  ```
99
 
100
+ This example loads the base transformer and adapter. Integrate them with the remaining compatible
101
  pipeline components for complete video generation.
102
 
103
  ## Files and provenance
 
106
  | --- | --- |
107
  | `adapter_model.safetensors` | Approximately 1.23 GB BF16 adapter |
108
  | `adapter_config.json` | PEFT configuration |
 
 
109
  | `RELEASE_MANIFEST.json` | Source revision and SHA-256 inventory |
110
 
111
+ Adapter weights and configuration are unchanged from
112
  [qyoo/lingbot-worl at d3e449c675f5](https://huggingface.co/qyoo/lingbot-worl/tree/d3e449c675f5a8bfb3afd29e30f1675e4445b9c3).
113
+ Documentation and release manifests were updated for this repository's
114
+ adapter-only release. The original export record remains available at the
115
+ pinned source revision. File integrity is checked against that source snapshot;
116
+ no new GPU benchmark was performed for this publication.
 
 
 
117
 
118
  ## Intended use and limitations
119
 
RELEASE_MANIFEST.json CHANGED
@@ -27,8 +27,8 @@
27
  },
28
  {
29
  "path": "README.md",
30
- "size_bytes": 5828,
31
- "sha256": "a1597b03b840eb11b05ac7993a566ac0bf125cced7437a08a041bbac4fa768d7"
32
  },
33
  {
34
  "path": "adapter_config.json",
@@ -49,66 +49,6 @@
49
  "path": "assets/worl-teaser.webp",
50
  "size_bytes": 273380,
51
  "sha256": "4cce61f77c912cfdbeac7a2b6d8626c3d1b77099744fee068aa5e5d2d98c89b3"
52
- },
53
- {
54
- "path": "merged/README.md",
55
- "size_bytes": 702,
56
- "sha256": "7b34dc542821a8d5867978b392fd6c086353600970c5a14968864199188ed581"
57
- },
58
- {
59
- "path": "merged/SHA256SUMS",
60
- "size_bytes": 1203,
61
- "sha256": "eb9ccb4a64139c585c31c92a265da7791a357d63d0491b56e9de31e5e5224428"
62
- },
63
- {
64
- "path": "merged/config.json",
65
- "size_bytes": 532,
66
- "sha256": "8e162023892651c30de45c41d029b2d05767585a2eec25a74fa9becd872e3267"
67
- },
68
- {
69
- "path": "merged/diffusion_pytorch_model-00001-of-00008.safetensors",
70
- "size_bytes": 4991624976,
71
- "sha256": "97870275ccec0fa64a213e7909d3bae3d77cb2021ec37609d4c29127f1f05263"
72
- },
73
- {
74
- "path": "merged/diffusion_pytorch_model-00002-of-00008.safetensors",
75
- "size_bytes": 4982358760,
76
- "sha256": "3a16767352aea3e7bbd58bc4e92488aac3e24d456131da7c553662ea7769fe3f"
77
- },
78
- {
79
- "path": "merged/diffusion_pytorch_model-00003-of-00008.safetensors",
80
- "size_bytes": 4861666096,
81
- "sha256": "fad09faf0c9353f6803c5852fc2aaec7d28d4e5dc049b3db05c6c65221d10288"
82
- },
83
- {
84
- "path": "merged/diffusion_pytorch_model-00004-of-00008.safetensors",
85
- "size_bytes": 4966568072,
86
- "sha256": "14cec26b8afe32622f885d3fd32f6732e17eedbee7466a2fe7478d51b2d94703"
87
- },
88
- {
89
- "path": "merged/diffusion_pytorch_model-00005-of-00008.safetensors",
90
- "size_bytes": 4929878840,
91
- "sha256": "2411c8bfe88a18816f2195e859910e42786ee4791a5e1c63cfc50ba8d01a5f46"
92
- },
93
- {
94
- "path": "merged/diffusion_pytorch_model-00006-of-00008.safetensors",
95
- "size_bytes": 4950774384,
96
- "sha256": "3a7db7a6e36fe047fa66c1f86e67004f6cc3ecb2a5e5ff0066694257ac98fae6"
97
- },
98
- {
99
- "path": "merged/diffusion_pytorch_model-00007-of-00008.safetensors",
100
- "size_bytes": 4982358936,
101
- "sha256": "c3dd20329b34c13e79a3c5f6b23171434fea59131d98c37625a23bf339630707"
102
- },
103
- {
104
- "path": "merged/diffusion_pytorch_model-00008-of-00008.safetensors",
105
- "size_bytes": 2423583064,
106
- "sha256": "48cc5e471d323e03bcb96ed39f8ea44b307a9f96b84327847c2656f40949e01e"
107
- },
108
- {
109
- "path": "merged/diffusion_pytorch_model.safetensors.index.json",
110
- "size_bytes": 127685,
111
- "sha256": "2444bb18169f99786e3aafb3080a8cbd4998359300851c6570f90be57493e6ff"
112
  }
113
  ]
114
  }
 
27
  },
28
  {
29
  "path": "README.md",
30
+ "size_bytes": 4884,
31
+ "sha256": "33507fb8cc826f364239a04039add527bfe5da82094e31cb32ff8925eb6e5868"
32
  },
33
  {
34
  "path": "adapter_config.json",
 
49
  "path": "assets/worl-teaser.webp",
50
  "size_bytes": 273380,
51
  "sha256": "4cce61f77c912cfdbeac7a2b6d8626c3d1b77099744fee068aa5e5d2d98c89b3"
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
52
  }
53
  ]
54
  }
merged/README.md DELETED
@@ -1,15 +0,0 @@
1
- # WORL-Lingbot: merged transformer
2
-
3
- This directory contains the BF16 camera-conditioned `WanModelFast`
4
- transformer with the WORL adapter merged. It has 18,544,332,864
5
- parameters stored in eight indexed Safetensors shards.
6
-
7
- See the [main model card](../README.md) for loading examples, inputs,
8
- limitations and provenance. The text encoder, tokenizer, VAE, scheduler
9
- and compatible LingBot runtime are required separately.
10
-
11
- Weight files and configuration are unchanged from the source release.
12
- This documentation and `SHA256SUMS` were updated for WORL-Lingbot.
13
- Run `sha256sum -c SHA256SUMS` from this directory to check its files.
14
-
15
- License: [Apache 2.0](../LICENSE.txt). See [NOTICE.txt](../NOTICE.txt).
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
merged/SHA256SUMS DELETED
@@ -1,11 +0,0 @@
1
- 7b34dc542821a8d5867978b392fd6c086353600970c5a14968864199188ed581 README.md
2
- 8e162023892651c30de45c41d029b2d05767585a2eec25a74fa9becd872e3267 config.json
3
- 97870275ccec0fa64a213e7909d3bae3d77cb2021ec37609d4c29127f1f05263 diffusion_pytorch_model-00001-of-00008.safetensors
4
- 3a16767352aea3e7bbd58bc4e92488aac3e24d456131da7c553662ea7769fe3f diffusion_pytorch_model-00002-of-00008.safetensors
5
- fad09faf0c9353f6803c5852fc2aaec7d28d4e5dc049b3db05c6c65221d10288 diffusion_pytorch_model-00003-of-00008.safetensors
6
- 14cec26b8afe32622f885d3fd32f6732e17eedbee7466a2fe7478d51b2d94703 diffusion_pytorch_model-00004-of-00008.safetensors
7
- 2411c8bfe88a18816f2195e859910e42786ee4791a5e1c63cfc50ba8d01a5f46 diffusion_pytorch_model-00005-of-00008.safetensors
8
- 3a7db7a6e36fe047fa66c1f86e67004f6cc3ecb2a5e5ff0066694257ac98fae6 diffusion_pytorch_model-00006-of-00008.safetensors
9
- c3dd20329b34c13e79a3c5f6b23171434fea59131d98c37625a23bf339630707 diffusion_pytorch_model-00007-of-00008.safetensors
10
- 48cc5e471d323e03bcb96ed39f8ea44b307a9f96b84327847c2656f40949e01e diffusion_pytorch_model-00008-of-00008.safetensors
11
- 2444bb18169f99786e3aafb3080a8cbd4998359300851c6570f90be57493e6ff diffusion_pytorch_model.safetensors.index.json
 
 
 
 
 
 
 
 
 
 
 
 
merged/config.json DELETED
@@ -1,18 +0,0 @@
1
- {
2
- "_class_name": "WanModelFast",
3
- "_diffusers_version": "0.35.2",
4
- "_name_or_path": "/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/qiyuanh/benchmark_experiments/recovery/rev_wbench_candidate_6c391161_parity_20260809/source/checkpoint/models/lingbot_world_fast/base",
5
- "control_type": "cam",
6
- "dim": 5120,
7
- "eps": 1e-06,
8
- "ffn_dim": 13824,
9
- "freq_dim": 256,
10
- "in_dim": 36,
11
- "local_attn_size": -1,
12
- "model_type": "i2v",
13
- "num_heads": 40,
14
- "num_layers": 40,
15
- "out_dim": 16,
16
- "sink_size": 0,
17
- "text_len": 512
18
- }
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
merged/diffusion_pytorch_model-00001-of-00008.safetensors DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:97870275ccec0fa64a213e7909d3bae3d77cb2021ec37609d4c29127f1f05263
3
- size 4991624976
 
 
 
 
merged/diffusion_pytorch_model-00002-of-00008.safetensors DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:3a16767352aea3e7bbd58bc4e92488aac3e24d456131da7c553662ea7769fe3f
3
- size 4982358760
 
 
 
 
merged/diffusion_pytorch_model-00003-of-00008.safetensors DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:fad09faf0c9353f6803c5852fc2aaec7d28d4e5dc049b3db05c6c65221d10288
3
- size 4861666096
 
 
 
 
merged/diffusion_pytorch_model-00004-of-00008.safetensors DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:14cec26b8afe32622f885d3fd32f6732e17eedbee7466a2fe7478d51b2d94703
3
- size 4966568072
 
 
 
 
merged/diffusion_pytorch_model-00005-of-00008.safetensors DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:2411c8bfe88a18816f2195e859910e42786ee4791a5e1c63cfc50ba8d01a5f46
3
- size 4929878840
 
 
 
 
merged/diffusion_pytorch_model-00006-of-00008.safetensors DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:3a7db7a6e36fe047fa66c1f86e67004f6cc3ecb2a5e5ff0066694257ac98fae6
3
- size 4950774384
 
 
 
 
merged/diffusion_pytorch_model-00007-of-00008.safetensors DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:c3dd20329b34c13e79a3c5f6b23171434fea59131d98c37625a23bf339630707
3
- size 4982358936
 
 
 
 
merged/diffusion_pytorch_model-00008-of-00008.safetensors DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:48cc5e471d323e03bcb96ed39f8ea44b307a9f96b84327847c2656f40949e01e
3
- size 2423583064
 
 
 
 
merged/diffusion_pytorch_model.safetensors.index.json DELETED
The diff for this file is too large to render. See raw diff