| --- |
| license: mit |
| license_link: LICENSE.md |
| tags: |
| - liveportrait |
| - face-animation |
| - image-to-video |
| - portrait |
| - safetensors |
| - comfyui |
| - ffmpega |
| pipeline_tag: image-to-video |
| --- |
| |
| # LivePortrait Models (safetensors) |
|
|
| Mirror of the [LivePortrait](https://github.com/KlingAIResearch/LivePortrait) model weights, converted from `.pth` to **safetensors** format for safe, pickle-free loading. Hosted by [Æmotion Studio](https://github.com/AEmotionStudio) for use with [ComfyUI-FFMPEGA](https://github.com/AEmotionStudio/ComfyUI-FFMPEGA). |
|
|
| ## What is LivePortrait? |
|
|
| LivePortrait is an AI model for **portrait animation** — it transfers head pose, facial expressions, eye gaze, and lip movements from a driving video onto a source face image. It produces high-quality results in real-time. |
|
|
| **Paper:** [LivePortrait: Efficient Portrait Animation with Stitching and Retargeting Control](https://arxiv.org/abs/2407.03168) |
|
|
| ## Files |
|
|
| | File | Size | Params | Description | |
| |:-----|-----:|-------:|:------------| |
| | `appearance_feature_extractor.safetensors` | 3.2 MB | 836K | Extracts 3D appearance features from face crops | |
| | `motion_extractor.safetensors` | 107.3 MB | 28.1M | Extracts keypoints, head pose, and expressions | |
| | `spade_generator.safetensors` | 211.5 MB | 55.4M | SPADE decoder — generates output face images | |
| | `warping_module.safetensors` | 173.7 MB | 45.5M | Warps appearance features via dense motion | |
| | `stitching_retargeting_module.safetensors` | 0.9 MB | 227K | Stitching + lip/eye retargeting networks | |
| | **Total** | **496.6 MB** | **130M** | | |
|
|
| ## ⚠️ Conversion Note |
|
|
| Weights were converted from the official `.pth` checkpoints in [KlingTeam/LivePortrait](https://huggingface.co/KlingTeam/LivePortrait) using: |
|
|
| ```python |
| from safetensors.torch import save_file |
| import torch |
| |
| # For base models (direct state dict) |
| sd = torch.load("model.pth", map_location="cpu") |
| save_file(sd, "model.safetensors") |
| |
| # For stitching module (nested sub-dicts → flat prefixed keys) |
| # retarget_shoulder → stitching.* |
| # retarget_mouth → retarget_lip.* |
| # retarget_eye → retarget_eye.* |
| ``` |
|
|
| The stitching/retargeting module uses flat prefixed keys in safetensors format. The `module.` DDP prefix is stripped from all keys. |
|
|
| ## Usage |
|
|
| These models are automatically downloaded by ComfyUI-FFMPEGA when the **Animate Portrait** skill is used. No manual setup required if `allow_model_downloads` is enabled. |
|
|
| ### Manual Installation |
|
|
| 1. Download all `.safetensors` files from this repo |
| 2. Place them in `ComfyUI/models/liveportrait/` |
|
|
| ## Why This Mirror? |
|
|
| - **Pickle-free**: safetensors format eliminates arbitrary code execution risks |
| - **Supply chain resilience**: first-party mirror ensures availability |
| - **Faster loading**: safetensors loads faster than pickle-based `.pth` |
|
|
| ## License |
|
|
| LivePortrait is released under the **MIT License** — see [LICENSE.md](LICENSE.md). See the [original repository](https://github.com/KlingAIResearch/LivePortrait) for details. |
|
|
| ## Credits |
|
|
| - **Original model by**: [Kling AI Research](https://github.com/KlingAIResearch/LivePortrait) |
| - **Paper**: *LivePortrait: Efficient Portrait Animation with Stitching and Retargeting Control* ([arXiv:2407.03168](https://arxiv.org/abs/2407.03168)) |
| - **Redistributed by**: [Æmotion Studio](https://huggingface.co/AEmotionStudio) for use with [ComfyUI-FFMPEGA](https://github.com/AEmotionStudio/ComfyUI-FFMPEGA) |
|
|
