File size: 2,320 Bytes
bee86c6
 
 
 
 
 
dafaa6b
bee86c6
 
 
 
 
 
 
dafaa6b
bee86c6
dafaa6b
 
 
 
bee86c6
dafaa6b
 
 
 
 
bee86c6
8883340
 
bee86c6
dafaa6b
bee86c6
dafaa6b
 
 
bee86c6
dafaa6b
 
bee86c6
dafaa6b
bee86c6
dafaa6b
 
 
bee86c6
dafaa6b
 
bee86c6
 
 
dafaa6b
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
bee86c6
 
 
dafaa6b
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
---
license: apache-2.0
tags:
- video
- image-to-video
- world-model
- interactive-world-model
- lora
- diffusion
- action-conditioning
- game-world-model
base_model: MiniMax/MiniMax-H3
---

# 🎮 H3-World: Turning Language Understanding into World Control

H3-World is the **first interactive world model** built on
[MiniMax-H3](https://huggingface.co/MiniMax/MiniMax-H3). Given an initial frame
and keyboard controls, it generates action-controlled video with coordinated
character and camera motion.

H3-World converts keyboard states into one language instruction per future video
latent and uses directed attention routing to bind each instruction to its
corresponding latent interval. Using 8,000 gameplay clips from
[ABot-World-Explorer-500h](https://huggingface.co/datasets/acvlab/ABot-World-Explorer-500h),
it learns 65.6M LoRA parameters, only 0.199% of the 33B MiniMax-H3 backbone.

![teaser](teaser.png)


## Checkpoint

| File | Description |
| --- | --- |
| `step-10000.safetensors` | Released rank-32 H3-World LoRA checkpoint |

Character controls use `W`, `A`, `S`, and `D`. Camera controls use `I`, `J`,
`K`, and `L`, with `F` indicating fast camera motion.

## Usage

This checkpoint is a LoRA delta for MiniMax-H3. It requires the MiniMax-H3 base
weights and H3-World's directed-attention patch; loading the LoRA through an
unmodified MiniMax-H3 pipeline will not reproduce the reported behavior.

Please use the official [H3-World code repository](https://github.com/Danzer1xxxxChan/H3-World)
for setup, inference, and training instructions.

## License

The H3-World LoRA checkpoint is released under Apache 2.0. MiniMax-H3 is
governed by its own license terms.

## Citation

```bibtex
@misc{chen2026h3worldturninglanguageunderstanding,
      title={H3-World: Turning Language Understanding into World Control},
      author={Danze Chen and Zeqing Wang and Ziyue Lin and Xingyi Yang and Yeying Jin},
      year={2026},
      eprint={2609.01560},
      archivePrefix={arXiv},
      primaryClass={cs.CV},
      url={https://arxiv.org/abs/2609.01560},
}
```

## Acknowledgements

- [MiniMax-H3](https://huggingface.co/MiniMax/MiniMax-H3)
- [DiffSynth-Studio](https://github.com/modelscope/DiffSynth-Studio)
- [ABot-World-Explorer-500h](https://huggingface.co/datasets/acvlab/ABot-World-Explorer-500h)