| --- |
| title: AnimeLoom |
| short_description: Open anime character LoRAs and tools for the AnimeLoom text-to-anime-video pipeline. |
| --- |
| |
| # AnimeLoom |
|
|
| **Open-source character LoRAs and tooling for face-consistent anime video generation.** |
|
|
| AnimeLoom is a text-to-anime-video pipeline focused on the hardest part of long-form |
| anime generation: **keeping the same character's face the same across every shot.** |
|
|
| This organization hosts the character LoRAs used by the |
| [AnimeLoom pipeline](https://github.com/JoelJohnsonThomas/AnimeLoom) on GitHub. |
|
|
| --- |
|
|
| ## Character LoRAs |
|
|
| | Character | Series | Repo | |
| |-----------|--------|------| |
| | Sakura Haruno | Naruto | [AnimeLoom/sakura-haruno](https://huggingface.co/AnimeLoom/sakura-haruno) | |
| | Denji | Chainsaw Man | [AnimeLoom/denji](https://huggingface.co/AnimeLoom/denji) | |
| | Yuki Nagato | The Melancholy of Haruhi Suzumiya | [AnimeLoom/yuki-nagato](https://huggingface.co/AnimeLoom/yuki-nagato) | |
|
|
| Every LoRA ships **two adapters** in one repo: |
|
|
| - `sdxl/` — for [Animagine XL 3.1](https://huggingface.co/cagliostrolab/animagine-xl-3.1), used by AnimeLoom's identity-keyframe stage |
| - `sd15/` — for [DreamShaper 8](https://huggingface.co/Lykon/dreamshaper-8), for lightweight AnimateDiff workflows |
|
|
| All adapters are LoRA rank 32, trained with [PEFT](https://huggingface.co/docs/peft). |
|
|
| --- |
|
|
| ## The pipeline |
|
|
| AnimeLoom is a Director-Orchestrated pipeline that turns a text story into a |
| multi-shot anime video with consistent character identity. |
|
|
| ``` |
| text story |
| ↓ |
| Story Decomposer (Gemini → Claude) → shot script |
| ↓ |
| SDXL + character LoRA + IP-Adapter → identity keyframe per shot (Phase 2) |
| ↓ |
| Wan2.2 I2V → motion driving clip (Phase 3a) |
| ↓ |
| Wan2.2-Animate face-lock → face from keyframe pasted |
| onto motion clip (Phase 3b) |
| ↓ |
| RIFE + Real-ESRGAN + GFPGAN → temporal/spatial upscale, |
| anime face restore (Phase 4) |
| ↓ |
| Cross-dissolve assembly → final 24fps video |
| ``` |
|
|
| ### Why face-lock matters |
|
|
| The "Animate" stage at Phase 3b is the moat. Per |
| [community testing](https://apatero.com/blog/wan22-animate-14b-character-animation-guide-2025), |
| Wan2.2-Animate-14B achieves an **89% usable rate** versus AnimateDiff's 71% and |
| commercial APIs' ~78%. Combined with character-specific LoRAs trained for the |
| SDXL identity stage, AnimeLoom can keep a character recognizably "themselves" |
| across every shot of a multi-shot scene — the part most open-source pipelines |
| struggle with. |
|
|
| --- |
|
|
| ## Quick start |
|
|
| Train your own character LoRA, or use one from this org: |
|
|
| ```python |
| import torch |
| from diffusers import StableDiffusionXLPipeline |
| from peft import PeftModel |
| |
| pipe = StableDiffusionXLPipeline.from_pretrained( |
| "cagliostrolab/animagine-xl-3.1", |
| torch_dtype=torch.float16, |
| ).to("cuda") |
| |
| # Load any AnimeLoom character LoRA |
| pipe.unet = PeftModel.from_pretrained( |
| pipe.unet, |
| "AnimeLoom/sakura-haruno", # or AnimeLoom/denji, AnimeLoom/yuki-nagato |
| subfolder="sdxl", |
| ) |
| |
| img = pipe( |
| "1girl, sakura haruno, pink hair, cherry blossom forest, anime, masterpiece", |
| num_inference_steps=28, |
| guidance_scale=6.5, |
| height=1024, width=1024, |
| ).images[0] |
| img.save("out.png") |
| ``` |
|
|
| For the full text-to-video pipeline, see the |
| [AnimeLoom RunPod notebook](https://github.com/JoelJohnsonThomas/AnimeLoom/blob/main/notebooks/AnimeLoom_RunPod.ipynb). |
|
|
| --- |
|
|
| ## License |
|
|
| All character LoRAs in this org are released under |
| [OpenRAIL++](https://huggingface.co/spaces/CompVis/stable-diffusion-license), |
| inheriting from their base models (Animagine XL 3.1 / DreamShaper 8). |
| The AnimeLoom pipeline code on GitHub is MIT licensed. |
|
|
| --- |
|
|
| ## Contributing |
|
|
| Want to add a character? The training script is in |
| [`agents/character/trainer.py`](https://github.com/JoelJohnsonThomas/AnimeLoom/tree/main/agents/character). |
| Recommended dataset: 15-30 clean anime reference images of the character at |
| 512 or 1024 resolution. |
|
|
| Issues, PRs, and new character requests: [GitHub Issues](https://github.com/JoelJohnsonThomas/AnimeLoom/issues). |
|
|
| --- |
|
|
| ## Links |
|
|
| - 🐙 **GitHub**: [JoelJohnsonThomas/AnimeLoom](https://github.com/JoelJohnsonThomas/AnimeLoom) |
| - 📦 **Pipeline notebook**: [AnimeLoom_RunPod.ipynb](https://github.com/JoelJohnsonThomas/AnimeLoom/blob/main/notebooks/AnimeLoom_RunPod.ipynb) |
| - 🤗 **All models**: [huggingface.co/AnimeLoom](https://huggingface.co/AnimeLoom) |
|
|
