Update README.md
Browse files
README.md
CHANGED
|
@@ -20,6 +20,27 @@ Terminal Technology Department, Alipay, Ant Group.
|
|
| 20 |
<a href='https://huggingface.co/BadToBest/EchoMimic'><img src='https://img.shields.io/badge/%F0%9F%A4%97%20HuggingFace-Model-yellow'></a>
|
| 21 |
</div>
|
| 22 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 23 |
## Gallery
|
| 24 |
### Audio Driven (Sing)
|
| 25 |
|
|
@@ -113,14 +134,6 @@ Terminal Technology Department, Alipay, Ant Group.
|
|
| 113 |
|
| 114 |
**οΌSome demo images above are sourced from image websites. If there is any infringement, we will immediately remove them and apologize.οΌ**
|
| 115 |
|
| 116 |
-
## Acknowledgements
|
| 117 |
-
|
| 118 |
-
We would like to thank the contributors to the [AnimateDiff](https://github.com/guoyww/AnimateDiff), [Moore-AnimateAnyone](https://github.com/MooreThreads/Moore-AnimateAnyone) and [MuseTalk](https://github.com/TMElyralab/MuseTalk) repositories, for their open research and exploration.
|
| 119 |
-
|
| 120 |
-
We are also grateful to [V-Express](https://github.com/tencent-ailab/V-Express) and [hallo](https://github.com/fudan-generative-vision/hallo) for their outstanding work in the area of diffusion-based talking heads.
|
| 121 |
-
|
| 122 |
-
If we missed any open-source projects or related articles, we would like to complement the acknowledgement of this specific work immediately.
|
| 123 |
-
|
| 124 |
## Citation
|
| 125 |
|
| 126 |
If you find our work useful for your research, please consider citing the paper:
|
|
|
|
| 20 |
<a href='https://huggingface.co/BadToBest/EchoMimic'><img src='https://img.shields.io/badge/%F0%9F%A4%97%20HuggingFace-Model-yellow'></a>
|
| 21 |
</div>
|
| 22 |
|
| 23 |
+
## Model Files
|
| 24 |
+
|
| 25 |
+
```
|
| 26 |
+
./pretrained_models/
|
| 27 |
+
βββ denoising_unet.pth
|
| 28 |
+
βββ reference_unet.pth
|
| 29 |
+
βββ motion_module.pth
|
| 30 |
+
βββ face_locator.pth
|
| 31 |
+
βββ sd-vae-ft-mse
|
| 32 |
+
β βββ ...
|
| 33 |
+
βββ sd-image-variations-diffusers
|
| 34 |
+
β βββ ...
|
| 35 |
+
βββ audio_processor
|
| 36 |
+
βββ whisper_tiny.pt
|
| 37 |
+
```
|
| 38 |
+
|
| 39 |
+
Some models in this hub can be directly downloaded from it's original hub:
|
| 40 |
+
- [sd-vae-ft-mse](https://huggingface.co/stabilityai/sd-vae-ft-mse): Weights are intended to be used with the diffusers library. (_Thanks to [stablilityai](https://huggingface.co/stabilityai)_)
|
| 41 |
+
- [sd-image-variations-diffusers](https://huggingface.co/lambdalabs/sd-image-variations-diffusers)
|
| 42 |
+
- [audio_processor](https://openaipublic.azureedge.net/main/whisper/models/65147644a518d12f04e32d6f3b26facc3f8dd46e5390956a9424a650c0ce22b9/tiny.pt)
|
| 43 |
+
|
| 44 |
## Gallery
|
| 45 |
### Audio Driven (Sing)
|
| 46 |
|
|
|
|
| 134 |
|
| 135 |
**οΌSome demo images above are sourced from image websites. If there is any infringement, we will immediately remove them and apologize.οΌ**
|
| 136 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 137 |
## Citation
|
| 138 |
|
| 139 |
If you find our work useful for your research, please consider citing the paper:
|