Instructions to use AlayaLab/AlayaWorld with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use AlayaLab/AlayaWorld with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline from diffusers.utils import load_image, export_to_video # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("AlayaLab/AlayaWorld", dtype=torch.bfloat16, device_map="cuda") pipe.to("cuda") prompt = "A man with short gray hair plays a red electric guitar." image = load_image( "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/diffusers/guitar-man.png" ) output = pipe(image=image, prompt=prompt).frames[0] export_to_video(output, "output.mp4") - Notebooks
- Google Colab
- Kaggle
| license: other | |
| license_name: ltx-2-community-license-agreement | |
| license_link: https://github.com/Lightricks/LTX-2/blob/main/LICENSE | |
| library_name: diffusers | |
| pipeline_tag: image-to-video | |
| tags: | |
| - video-generation | |
| - world-model | |
| - image-to-video | |
| - autoregressive | |
| base_model: Lightricks/LTX-2.3 | |
| # AlayaWorld — Weights | |
| Pretrained inference weights for **AlayaWorld: Long-Horizon and Playable Video | |
| World Generation** (Alaya Lab). | |
| - **Code:** https://github.com/AlayaLab/AlayaWorld | |
| - **Technical report:** https://arxiv.org/abs/2607.06291 | |
| ## Files | |
| | File | Description | | |
| |------|-------------| | |
| | `merged_infer.safetensors` | Single bundle: DiT + VAE + text-encoder + history-encoder. Place under `checkpoints/` per the code repo's README. | | |
| The text encoder (Gemma-3) and the spatial-memory depth model (Depth-Anything-3) | |
| are **not** included here — download them from their original sources as | |
| described in the code repository's README. | |
| ## License | |
| This project is based on **LTX-2** by Lightricks Ltd. `merged_infer.safetensors` | |
| is fine-tuned from the LTX-2.3-22B base and is a **derivative of LTX-2.3**; | |
| accordingly it is released under the **LTX-2 Community License Agreement** | |
| (https://github.com/Lightricks/LTX-2/blob/main/LICENSE), not Apache 2.0. All | |
| original LTX-2 copyright and attribution notices are retained. | |
| **For academic research and non-commercial use only.** For commercial use of | |
| LTX-2 or its derivatives, contact Lightricks Ltd.; entities with ≥ $10M annual | |
| revenue require a commercial license from Lightricks. | |
| ## Citation | |
| ```bibtex | |
| @article{team2026alayaworld, | |
| title={AlayaWorld: Long-Horizon and Playable Video World Generation}, | |
| author={Team, AlayaWorld and Zhang, Kaipeng and Li, Chuanhao and Zhan, Yifan and Ge, Yongtao and Yin, Yuanyang and others}, | |
| journal={arXiv preprint arXiv:2607.06291}, | |
| year={2026} | |
| } | |
| ``` | |