Spaces:
Sleeping
Sleeping
Upload f5_tts/infer/SHARED.md with huggingface_hub
Browse files- f5_tts/infer/SHARED.md +103 -0
f5_tts/infer/SHARED.md
ADDED
|
@@ -0,0 +1,103 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
<!-- omit in toc -->
|
| 2 |
+
# Shared Model Cards
|
| 3 |
+
|
| 4 |
+
<!-- omit in toc -->
|
| 5 |
+
### **Prerequisites of using**
|
| 6 |
+
- This document is serving as a quick lookup table for the community training/finetuning result, with various language support.
|
| 7 |
+
- The models in this repository are open source and are based on voluntary contributions from contributors.
|
| 8 |
+
- The use of models must be conditioned on respect for the respective creators. The convenience brought comes from their efforts.
|
| 9 |
+
|
| 10 |
+
<!-- omit in toc -->
|
| 11 |
+
### **Welcome to share here**
|
| 12 |
+
- Have a pretrained/finetuned result: model checkpoint (pruned best to facilitate inference, i.e. leave only `ema_model_state_dict`) and corresponding vocab file (for tokenization).
|
| 13 |
+
- Host a public [huggingface model repository](https://huggingface.co/new) and upload the model related files.
|
| 14 |
+
- Make a pull request adding a model card to the current page, i.e. `src\f5_tts\infer\SHARED.md`.
|
| 15 |
+
|
| 16 |
+
<!-- omit in toc -->
|
| 17 |
+
### Supported Languages
|
| 18 |
+
- [Multilingual](#multilingual)
|
| 19 |
+
- [F5-TTS Base @ pretrain @ zh \& en](#f5-tts-base--pretrain--zh--en)
|
| 20 |
+
- [English](#english)
|
| 21 |
+
- [Finnish](#finnish)
|
| 22 |
+
- [Finnish Common\_Voice Vox\_Populi @ finetune @ fi](#finnish-common_voice-vox_populi--finetune--fi)
|
| 23 |
+
- [French](#french)
|
| 24 |
+
- [French LibriVox @ finetune @ fr](#french-librivox--finetune--fr)
|
| 25 |
+
- [Japanese](#japanese)
|
| 26 |
+
- [F5-TTS Japanese @ pretrain/finetune @ ja](#f5-tts-japanese--pretrainfinetune--ja)
|
| 27 |
+
- [Mandarin](#mandarin)
|
| 28 |
+
- [Spanish](#spanish)
|
| 29 |
+
- [F5-TTS Spanish @ pretrain/finetune @ es](#f5-tts-spanish--pretrainfinetune--es)
|
| 30 |
+
|
| 31 |
+
|
| 32 |
+
## Multilingual
|
| 33 |
+
|
| 34 |
+
#### F5-TTS Base @ pretrain @ zh & en
|
| 35 |
+
|Model|🤗Hugging Face|Data (Hours)|Model License|
|
| 36 |
+
|:---:|:------------:|:-----------:|:-------------:|
|
| 37 |
+
|F5-TTS Base|[ckpt & vocab](https://huggingface.co/SWivid/F5-TTS/tree/main/F5TTS_Base)|[Emilia 95K zh&en](https://huggingface.co/datasets/amphion/Emilia-Dataset/tree/fc71e07)|cc-by-nc-4.0|
|
| 38 |
+
|
| 39 |
+
```bash
|
| 40 |
+
MODEL_CKPT: hf://SWivid/F5-TTS/F5TTS_Base/model_1200000.safetensors
|
| 41 |
+
VOCAB_FILE: hf://SWivid/F5-TTS/F5TTS_Base/vocab.txt
|
| 42 |
+
```
|
| 43 |
+
|
| 44 |
+
*Other infos, e.g. Author info, Github repo, Link to some sampled results, Usage instruction, Tutorial (Blog, Video, etc.) ...*
|
| 45 |
+
|
| 46 |
+
|
| 47 |
+
## English
|
| 48 |
+
|
| 49 |
+
|
| 50 |
+
## Finnish
|
| 51 |
+
|
| 52 |
+
#### Finnish Common_Voice Vox_Populi @ finetune @ fi
|
| 53 |
+
|Model|🤗Hugging Face|Data|Model License|
|
| 54 |
+
|:---:|:------------:|:-----------:|:-------------:|
|
| 55 |
+
|F5-TTS Finnish|[ckpt & vocab](https://huggingface.co/AsmoKoskinen/F5-TTS_Finnish_Model)|[Common Voice](https://huggingface.co/datasets/mozilla-foundation/common_voice_17_0), [Vox Populi](https://huggingface.co/datasets/facebook/voxpopuli)|cc-by-nc-4.0|
|
| 56 |
+
|
| 57 |
+
```bash
|
| 58 |
+
MODEL_CKPT: hf://AsmoKoskinen/F5-TTS_Finish_Model/model_common_voice_fi_vox_populi_fi_20241206.safetensors
|
| 59 |
+
VOCAB_FILE: hf://AsmoKoskinen/F5-TTS_Finish_Model/vocab.txt
|
| 60 |
+
```
|
| 61 |
+
|
| 62 |
+
|
| 63 |
+
## French
|
| 64 |
+
|
| 65 |
+
#### French LibriVox @ finetune @ fr
|
| 66 |
+
|Model|🤗Hugging Face|Data (Hours)|Model License|
|
| 67 |
+
|:---:|:------------:|:-----------:|:-------------:|
|
| 68 |
+
|F5-TTS French|[ckpt & vocab](https://huggingface.co/RASPIAUDIO/F5-French-MixedSpeakers-reduced)|[LibriVox](https://librivox.org/)|cc-by-nc-4.0|
|
| 69 |
+
|
| 70 |
+
```bash
|
| 71 |
+
MODEL_CKPT: hf://RASPIAUDIO/F5-French-MixedSpeakers-reduced/model_last_reduced.pt
|
| 72 |
+
VOCAB_FILE: hf://RASPIAUDIO/F5-French-MixedSpeakers-reduced/vocab.txt
|
| 73 |
+
```
|
| 74 |
+
|
| 75 |
+
- [Online Inference with Hugging Face Space](https://huggingface.co/spaces/RASPIAUDIO/f5-tts_french).
|
| 76 |
+
- [Tutorial video to train a new language model](https://www.youtube.com/watch?v=UO4usaOojys).
|
| 77 |
+
- [Discussion about this training can be found here](https://github.com/SWivid/F5-TTS/issues/434).
|
| 78 |
+
|
| 79 |
+
|
| 80 |
+
## Japanese
|
| 81 |
+
|
| 82 |
+
#### F5-TTS Japanese @ pretrain/finetune @ ja
|
| 83 |
+
|Model|🤗Hugging Face|Data (Hours)|Model License|
|
| 84 |
+
|:---:|:------------:|:-----------:|:-------------:|
|
| 85 |
+
|F5-TTS Japanese|[ckpt & vocab](https://huggingface.co/Jmica/F5TTS/tree/main/JA_8500000)|[Emilia 1.7k JA](https://huggingface.co/datasets/amphion/Emilia-Dataset/tree/fc71e07) & [Galgame Dataset 5.4k](https://huggingface.co/datasets/OOPPEENN/Galgame_Dataset)|cc-by-nc-4.0|
|
| 86 |
+
|
| 87 |
+
```bash
|
| 88 |
+
MODEL_CKPT: hf://Jmica/F5TTS/JA_8500000/model_8499660.pt
|
| 89 |
+
VOCAB_FILE: hf://Jmica/F5TTS/JA_8500000/vocab_updated.txt
|
| 90 |
+
```
|
| 91 |
+
|
| 92 |
+
|
| 93 |
+
## Mandarin
|
| 94 |
+
|
| 95 |
+
|
| 96 |
+
## Spanish
|
| 97 |
+
|
| 98 |
+
#### F5-TTS Spanish @ pretrain/finetune @ es
|
| 99 |
+
|Model|🤗Hugging Face|Data (Hours)|Model License|
|
| 100 |
+
|:---:|:------------:|:-----------:|:-------------:|
|
| 101 |
+
|F5-TTS Spanish|[ckpt & vocab](https://huggingface.co/jpgallegoar/F5-Spanish)|[Voxpopuli](https://huggingface.co/datasets/facebook/voxpopuli) & Crowdsourced & TEDx, 218 hours|cc0-1.0|
|
| 102 |
+
|
| 103 |
+
- @jpgallegoar [GitHub repo](https://github.com/jpgallegoar/Spanish-F5), Jupyter Notebook and Gradio usage for Spanish model.
|