---
license: other
license_name: minimax-h3-community-license
license_link: https://huggingface.co/MiniMaxAI/MiniMax-H3/blob/main/LICENSE
base_model: MiniMaxAI/MiniMax-H3
pipeline_tag: video-to-video
tags:
  - lora
  - video-to-video
  - game-rendering
  - minimax-h3
---

# AnyGameRenderer: Entity-Consistent Generative Rendering Across Games and an Entity-Level Benchmark

AnyGameRenderer takes a crude gameplay recording (the "programmer art" agents produce: gray boxes and colored cylinders on flat ground) and a text prompt, and outputs the same gameplay re-rendered in the prompted style, frame-aligned with the input.

This repository holds the **LoRA** (`anygamerenderer_lora.safetensors`, 2.4 GB) that turns [MiniMax-H3](https://huggingface.co/MiniMaxAI/MiniMax-H3) Ref2VA into AnyGameRenderer. Paper: https://arxiv.org/pdf/2610.31466 · Project page: https://alaya-lab.github.io/AnyGameRenderer/ · Inference code, the caption builder, and examples: https://github.com/AlayaLab/AnyGameRenderer.

- 🎮 **Generalizes across genres:** one checkpoint renders tower defense, auto-battlers, top-down survivors, turn-based battles, kart racing, crowd runners, arena survival, co-op games, and shooters.
- 🎯 **Keeps entity correspondence:** group counts stay correct, entities appear and disappear on the right frame, and small far-away entities are not lost.
- 📹 **Its input is plain video:** gray blockouts, colored primitives, semantic maps, wireframes, and coarse mockups all work, with no per-object labels or engine hooks.
- 🎨 **Any prompted style:** photoreal AAA, LEGO, Ghibli, crayon, synthwave, samurai, candy land … with the characters re-imagined to match.

## Files

| file | size | what |
|---|---|---|
| `anygamerenderer_lora.safetensors` | 2.4 GB | LoRA on the MiniMax-H3 Ref2VA transformer: rank 128, alpha 128, on `attn.qkv_proj`, `attn.out_proj`, `mlp.fc1`, `mlp.fc2` of every block (musubi-tuner `networks.lora_minimax_h3` format). |

The base weights (Ref2VA transformer, Qwen3-VL-32B text encoder, video and audio VAEs, ~123 GB) are not included; download them from [Comfy-Org/MiniMax-H3](https://huggingface.co/Comfy-Org/MiniMax-H3) after accepting the MiniMax-H3 Community License.

## Usage

```bash
git clone https://github.com/AlayaLab/AnyGameRenderer.git && cd AnyGameRenderer
bash setup_env.sh && conda activate agr
bash download_weights.sh                                   # base weights -> weights/
huggingface-cli download AlayaLab/AnyGameRenderer anygamerenderer_lora.safetensors --local-dir weights
bash run_example.sh                                        # renders the bundled examples (~17 min per 5 s clip on an 80 GB GPU)
```

Inputs are 1344×768, 24 fps clips of 2–15 s; captions are built from a short `spec.json` with `make_caption.py` (see the repo README and the `anygamerenderer-caption` skill for how to write one).

## Citation

```bibtex
@article{liu2026anygamerenderer,
  title={AnyGameRenderer: Entity-Consistent Generative Rendering Across Games and an Entity-Level Benchmark},
  author={Liu, Ruicong and Ouyang, Liangyang and Lan, Fengbo and Wang, Zhixiang and Zhang, Kaipeng},
  journal={arXiv preprint arXiv:2610.31466},
  year={2026}
}
```

## License

The LoRA is a derivative of the MiniMax-H3 weights and is distributed under the [MiniMax-H3 Community License](https://huggingface.co/MiniMaxAI/MiniMax-H3/blob/main/LICENSE).