Spaces:
Runtime error
Runtime error
| title: 'Extremely-Fast diffusion text-to-speech synthesis pipeline with ProDiff and FastDiff' | |
| description: | | |
| Gradio demo for **2-iter** ProDiff and **4-iter** FastDiff. To use it, simply add your audio, or click one of the examples to load them. **This space is running on CPU, inference will be slower.** | |
| ## Key Features | |
| - **Extremely-Fast** diffusion text-to-speech synthesis pipeline for potential **industrial deployment**. | |
| - **Tutorial and code base** for speech diffusion models. | |
| - More **supported diffusion mechanism** (e.g., guided diffusion) will be available. | |
| article: | | |
| ## Reference | |
| Link to <a href='https://github.com/Rongjiehuang/ProDiff' style='color:blue;' target='_blank\'>ProDiff Github REPO</a> | |
| If you find this code useful in your research, please cite our work: | |
| ``` | |
| @inproceedings{huang2022prodiff, | |
| title={ProDiff: Progressive Fast Diffusion Model For High-Quality Text-to-Speech}, | |
| author={Huang, Rongjie and Zhao, Zhou and Liu, Huadai and Liu, Jinglin and Cui, Chenye and Ren, Yi}, | |
| booktitle={Proceedings of the 30th ACM International Conference on Multimedia}, | |
| year={2022} | |
| @inproceedings{huang2022fastdiff, | |
| title={FastDiff: A Fast Conditional Diffusion Model for High-Quality Speech Synthesis}, | |
| author={Huang, Rongjie and Lam, Max WY and Wang, Jun and Su, Dan and Yu, Dong and Ren, Yi and Zhao, Zhou}, | |
| booktitle = {Proceedings of the Thirty-First International Joint Conference on Artificial Intelligence, {IJCAI-22}}, | |
| year={2022} | |
| } | |
| ``` | |
| ## Disclaimer | |
| Any organization or individual is prohibited from using any technology mentioned in this paper to generate someone's speech without his/her consent, including but not limited to government leaders, political figures, and celebrities. If you do not comply with this item, you could be in violation of copyright laws. | |
| example_inputs: | |
| - |- | |
| the invention of movable metal letters in the middle of the fifteenth century may justly be considered as the invention of the art of printing. | |
| - |- | |
| Printing, in the only sense with which we are at present concerned, differs from most if not from all the arts and crafts represented in the Exhibition. | |
| inference_cls: inference.ProDiff.ProDiffInfer | |
| exp_name: ProDiff | |
| config: modules/ProDiff/config/prodiff.yaml |