ruichen9618 commited on
Commit
db23cbf
·
verified ·
1 Parent(s): 6a5b039

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +21 -29
README.md CHANGED
@@ -1,5 +1,5 @@
1
  ---
2
- license: apache-2.0
3
  tags:
4
  - world-model
5
  - video-generation
@@ -95,26 +95,26 @@ In the current inference script, `action_speed_list` is used as the relative dur
95
 
96
  ### Camera Action Commands
97
 
98
- DreamX-World-5B uses `WASD` for camera translation and `IJKL` for view rotation:
99
 
100
- | Action | Description |
101
- |--------|-------------|
102
- | `w` | Move forward |
103
- | `s` | Move backward |
104
  | `a` | Move left |
105
  | `d` | Move right |
106
- | `i` | Look up |
107
- | `k` | Look down |
108
- | `j` | Look left |
109
- | `l` | Look right |
110
 
111
  Actions can be composed in one string:
112
 
113
- - `wi`: move forward while looking up
114
- - `wk`: move forward while looking down
115
- - `wj`: move forward while looking left
116
- - `wl`: move forward while looking right
117
- - `dj`: move right while looking left
118
 
119
  ### Run Inference
120
 
@@ -178,27 +178,19 @@ Because the default causal block size is 3 latent frames, `num_output_frames` sh
178
  | **Causal Block Size** | 3 latent frames per block by default |
179
  | **VAE** | Wan2.2 VAE, temporal compression 4x, spatial compression 16x |
180
  | **Text Encoder** | UMT5-XXL |
181
- | **Denoising Steps** | `[1000, 750, 500, 250]` in the provided AR config |
182
  | **Precision** | BFloat16 |
183
 
184
- ## Limitations
185
 
186
- - Very long rollouts can still accumulate visual artifacts, camera-control errors, or color/style drift.
187
- - Camera actions are approximate controls, not guaranteed physical camera trajectories.
188
- - The provided inference script resizes inputs to 704 x 1280 and uses fixed normalized camera intrinsics.
189
- - `action_speed_list` controls relative segment duration in the provided script; it does not directly change the per-frame camera velocity.
190
- - Inference requires a CUDA GPU and substantial VRAM. Longer generations require more time and memory.
191
- - Generated videos may reflect biases or artifacts from the training data and base model.
192
 
193
- ## Intended Use
194
-
195
- DreamX-World-5B is intended for research and creative applications in interactive world simulation, camera-controllable video generation, long-horizon image-to-video generation, game-like environment exploration, and promptable world modeling.
196
-
197
- The model should not be used to create deceptive, harmful, illegal, or rights-violating content, or to represent generated videos as real-world footage.
198
 
199
  ## License
200
 
201
- This model is released under the [Apache License 2.0](LICENSE).
202
 
203
  ## Citation
204
 
 
1
  ---
2
+ license: mit
3
  tags:
4
  - world-model
5
  - video-generation
 
95
 
96
  ### Camera Action Commands
97
 
98
+ DreamX-World-5B uses `WASD` for camera translation and `IJKL` for camera rotation:
99
 
100
+ | Action | Camera Control |
101
+ |--------|----------------|
102
+ | `w` | Push in |
103
+ | `s` | Pull out |
104
  | `a` | Move left |
105
  | `d` | Move right |
106
+ | `i` | Tilt up |
107
+ | `k` | Tilt down |
108
+ | `j` | Pan left |
109
+ | `l` | Pan right |
110
 
111
  Actions can be composed in one string:
112
 
113
+ - `wi`: push in while tilting up
114
+ - `wk`: push in while tilting down
115
+ - `wj`: push in while panning left
116
+ - `wl`: push in while panning right
117
+ - `dj`: move right while panning left
118
 
119
  ### Run Inference
120
 
 
178
  | **Causal Block Size** | 3 latent frames per block by default |
179
  | **VAE** | Wan2.2 VAE, temporal compression 4x, spatial compression 16x |
180
  | **Text Encoder** | UMT5-XXL |
 
181
  | **Precision** | BFloat16 |
182
 
183
+ ## WeChat Group
184
 
185
+ Join our WeChat group for discussion:
 
 
 
 
 
186
 
187
+ <div align="center">
188
+ <img src="assets/wechat_group_qrcode.png" width="300" alt="WeChat Group QR Code">
189
+ </div>
 
 
190
 
191
  ## License
192
 
193
+ This model is released under the [MIT License](LICENSE).
194
 
195
  ## Citation
196