File size: 7,762 Bytes
cb18c6d 1a3f617 cb18c6d 1a3f617 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 | ---
license: apache-2.0
library_name: comfyui
base_model: GAIR/daVinci-MagiHuman
pipeline_tag: image-to-video
language:
- en
- zh
- ja
- ko
- de
- fr
- yue
tags:
- comfyui
- image-to-video
- image-text-to-audio-video
- multimodal
- int8
---
# ComfyUI-RH-daVinci-MagiHuman INT8
[](https://www.runninghub.cn/?inviteCode=rh-v1367)
[](https://www.runninghub.ai/?inviteCode=rh-v1367)
[](./README.md)
[](./README_CN.md)
INT8-quantised daVinci-MagiHuman DiT and super-resolution weights for
[ComfyUI-RH-daVinci-MagiHuman](https://github.com/RH-RunningHub/ComfyUI-RH-daVinci-MagiHuman).
This repository contains only the four converted `.pt` files. TurboVAE, the
T5 text encoder, and the video/audio VAEs still come from the official
releases.
The ComfyUI nodes load these INT8 files directly. Official BF16 DiT shards and
official `540p_sr/` / `1080p_sr/` config directories are not required.
Full snapshot is about **57 GiB**. Download only the files you need.
Mirror: [Hugging Face](https://huggingface.co/Gluttony10/ComfyUI-RH-daVinci-MagiHuman) /
[ModelScope](https://www.modelscope.cn/models/Gluttony10/ComfyUI-RH-daVinci-MagiHuman)
## Run Online and API Access
If you do not want to download and configure the full model assets locally, you can first try related MagiHuman workflows online on RunningHub, or integrate RunningHub AI app / workflow APIs into your own product.
- [RunningHub](https://www.runninghub.ai)
- [RunningHub China](https://www.runninghub.cn)
- [RunningHub API](https://www.runninghub.ai/call-api)
- [RunningHub API Documentation](https://www.runninghub.cn/runninghub-api-doc-en/)
- [RunningHub API Docs CN](https://www.runninghub.cn/runninghub-api-doc-cn/)
- [ComfyUI-RH-daVinci-MagiHuman Plugin](https://github.com/RH-RunningHub/ComfyUI-RH-daVinci-MagiHuman)
RunningHub is useful for quickly validating workflows such as reference-image-to-talking-head video, digital human video, and AI presenter / spokesperson video generation. You can first run and tune the workflow online, then choose local deployment if needed, or integrate similar capabilities into your product through RunningHub API.
> Want to try it quickly? Open [RunningHub](https://www.runninghub.ai) to explore runnable AI workflows. Want to integrate digital human / talking-head video generation into your product? Start with the [RunningHub API Documentation](https://www.runninghub.cn/runninghub-api-doc-en/).
RunningHub API supports model APIs, AI app APIs, workflow APIs, and LLM APIs. For MagiHuman-style video generation workflows, the recommended task flow is:
```text
Submit task -> get taskId -> check task status -> retrieve generated result
```
Recommended use cases:
- Run daVinci-MagiHuman / MagiHuman talking-head video generation workflows online
- Add reference-image-to-video, digital human presenter, and AI video generation capabilities to your product
- Provide creators, developers, and teams with no-local-setup generative AI workflows
- Build automated video generation, content production, or multimodal applications with RunningHub API
## Contents
| File | Size | Role |
|---|---:|---|
| `base_int8.pt` | 14.25 GiB | INT8 Base DiT (32 steps, higher quality) |
| `distill_int8.pt` | 14.25 GiB | INT8 Distill DiT (8 steps, faster) |
| `sr_540p_sr_int8.pt` | 14.25 GiB | Optional INT8 540p super-resolution |
| `sr_1080p_sr_int8.pt` | 14.25 GiB | Optional INT8 1080p super-resolution |
You need **one** of `base_int8.pt` / `distill_int8.pt`. Add an SR file only
when the loader's `sr_model` is `540p_sr` or `1080p_sr`.
## Install into ComfyUI
```text
ComfyUI/models/MagiHuman/
โโโ base_int8.pt
โโโ distill_int8.pt
โโโ sr_540p_sr_int8.pt # optional
โโโ sr_1080p_sr_int8.pt # optional
```
### Hugging Face
```bash
cd /path/to/ComfyUI
python3 -m pip install -U huggingface_hub
hf download Gluttony10/ComfyUI-RH-daVinci-MagiHuman base_int8.pt \
--local-dir ./models/MagiHuman
hf download Gluttony10/ComfyUI-RH-daVinci-MagiHuman distill_int8.pt \
--local-dir ./models/MagiHuman
hf download Gluttony10/ComfyUI-RH-daVinci-MagiHuman sr_540p_sr_int8.pt \
--local-dir ./models/MagiHuman
hf download Gluttony10/ComfyUI-RH-daVinci-MagiHuman sr_1080p_sr_int8.pt \
--local-dir ./models/MagiHuman
```
### ModelScope
```bash
pip install modelscope
cd /path/to/ComfyUI
modelscope download --model Gluttony10/ComfyUI-RH-daVinci-MagiHuman base_int8.pt \
--local_dir ./models/MagiHuman
modelscope download --model Gluttony10/ComfyUI-RH-daVinci-MagiHuman distill_int8.pt \
--local_dir ./models/MagiHuman
modelscope download --model Gluttony10/ComfyUI-RH-daVinci-MagiHuman sr_540p_sr_int8.pt \
--local_dir ./models/MagiHuman
modelscope download --model Gluttony10/ComfyUI-RH-daVinci-MagiHuman sr_1080p_sr_int8.pt \
--local_dir ./models/MagiHuman
```
## Other required assets
These files are **not** in this repository:
```bash
# Official MagiHuman assets (TurboVAE, T5 text encoder)
hf download GAIR/daVinci-MagiHuman --local-dir ./models/MagiHuman
pip install modelscope
modelscope download --model GAIR/daVinci-MagiHuman --local_dir ./models/MagiHuman
# External VAEs
hf download stabilityai/stable-audio-open-1.0 \
--local-dir ./models/audio_checkpoints/stable-audio-open-1.0
hf download Wan-AI/Wan2.2-TI2V-5B \
--local-dir ./models/Ovi/Wan2.2-TI2V-5B
```
Expected layout after everything is in place:
```text
ComfyUI/models/
โโโ MagiHuman/
โ โโโ base_int8.pt
โ โโโ distill_int8.pt
โ โโโ sr_540p_sr_int8.pt
โ โโโ sr_1080p_sr_int8.pt
โ โโโ t5gemma-9b-9b-ul2/
โ โโโ turbo_vae/
โโโ audio_checkpoints/stable-audio-open-1.0/
โโโ Ovi/Wan2.2-TI2V-5B/
```
## Plugin
Current plugin: [RH-RunningHub/ComfyUI-RH-daVinci-MagiHuman](https://github.com/RH-RunningHub/ComfyUI-RH-daVinci-MagiHuman)
| Node | Purpose |
|---|---|
| `RH MagiHuman Model Loader` (`RH_MagiHumanModelLoader`) | Load INT8 DiT, VAEs, and optional SR |
| `RH MagiHuman Generate` (`RH_MagiHumanGenerate`) | Talking-head video from a reference image and text prompt |
Loader options:
- `model_type`: `base` (32 steps) or `distill` (8 steps)
- `vram_mode`: `mid_vram` (~16 GB) or `low_vram` (~6.5 GB)
- `sr_model`: `none` / `540p_sr` / `1080p_sr`
`mid_vram` + 540p SR needs about 24 GB. `mid_vram` + 1080p SR needs about 48 GB.
## License
Converted weights follow the upstream
[Apache-2.0](https://opensource.org/licenses/Apache-2.0) license of
[daVinci-MagiHuman](https://huggingface.co/GAIR/daVinci-MagiHuman).
## Links
[](https://www.runninghub.cn/?inviteCode=rh-v1367)
[](https://www.runninghub.ai/?inviteCode=rh-v1367)
- [RunningHub](https://www.runninghub.ai)
- [RunningHub China](https://www.runninghub.cn)
- [RunningHub API](https://www.runninghub.ai/call-api)
- [RunningHub API Documentation](https://www.runninghub.cn/runninghub-api-doc-en/)
- [TokenPlus](https://tokenplus.net/)
- [Official daVinci-MagiHuman](https://github.com/GAIR-NLP/daVinci-MagiHuman)
- [Official weights](https://huggingface.co/GAIR/daVinci-MagiHuman)
- [Official assets on ModelScope](https://www.modelscope.cn/models/GAIR/daVinci-MagiHuman)
- [ComfyUI-RH-daVinci-MagiHuman](https://github.com/RH-RunningHub/ComfyUI-RH-daVinci-MagiHuman)
|