File size: 1,967 Bytes
02aea7d | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 | ---
pipeline_tag: image-to-video
library_name: diffusers
language:
- en
tags:
- world-model
- video-generation
- image-to-video
---
<div align="center">
<img src="https://mbzuai-oryx.github.io/WorldGuide/assets/worldguide-logo.png" alt="WorldGuide" width="120"/>
# WorldGuide: Goal-Directed Video World Model for Procedural Task Execution
[Ankan Deria](https://ankan8145.github.io), [Komal Kumar](https://komalkumar.org), [Hisham Cholakkal](https://hishamcholakkal.com), [Fahad Shahbaz Khan](https://sites.google.com/view/fahadkhans), [Salman Khan](https://salman-h-khan.github.io)
**Mohamed bin Zayed University of Artificial Intelligence**
[](https://mbzuai-oryx.github.io/WorldGuide/)
[](https://github.com/mbzuai-oryx/WorldGuide)
</div>
Official checkpoints for **WorldGuide**. Method details, results and training code are on the [project page](https://mbzuai-oryx.github.io/WorldGuide/) and on [GitHub](https://github.com/mbzuai-oryx/WorldGuide).
## Checkpoints
```text
WorldGuide-Ckpt/
├── transformer/ # WorldGuide Video DiT → --action_ckpt
└── text_encoder/llm/ # WorldGuide ContextPlanner → --planner_model_path
```
## Usage
```bash
git clone https://github.com/mbzuai-oryx/WorldGuide.git
cd WorldGuide
pip install -r requirements.txt
# Download this repository and all other required components into ./ckpts
python download_models.py --hf_token <your_hf_token>
# Run closed-loop inference
bash scripts/inference/run_v5_qwen_closed_loop_memory.sh
```
## Citation
```bibtex
@misc{worldguide,
title = {WorldGuide: Goal-Directed Video World Model for Procedural Task Execution},
author = {Deria, Ankan and Kumar, Komal and Cholakkal, Hisham and Khan, Fahad Shahbaz and Khan, Salman},
year = {2026}
}
```
|