ashishkblink commited on
Commit
80716e0
·
verified ·
1 Parent(s): 9898207

Upload f5_tts/infer/SHARED.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. f5_tts/infer/SHARED.md +103 -0
f5_tts/infer/SHARED.md ADDED
@@ -0,0 +1,103 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ <!-- omit in toc -->
2
+ # Shared Model Cards
3
+
4
+ <!-- omit in toc -->
5
+ ### **Prerequisites of using**
6
+ - This document is serving as a quick lookup table for the community training/finetuning result, with various language support.
7
+ - The models in this repository are open source and are based on voluntary contributions from contributors.
8
+ - The use of models must be conditioned on respect for the respective creators. The convenience brought comes from their efforts.
9
+
10
+ <!-- omit in toc -->
11
+ ### **Welcome to share here**
12
+ - Have a pretrained/finetuned result: model checkpoint (pruned best to facilitate inference, i.e. leave only `ema_model_state_dict`) and corresponding vocab file (for tokenization).
13
+ - Host a public [huggingface model repository](https://huggingface.co/new) and upload the model related files.
14
+ - Make a pull request adding a model card to the current page, i.e. `src\f5_tts\infer\SHARED.md`.
15
+
16
+ <!-- omit in toc -->
17
+ ### Supported Languages
18
+ - [Multilingual](#multilingual)
19
+ - [F5-TTS Base @ pretrain @ zh \& en](#f5-tts-base--pretrain--zh--en)
20
+ - [English](#english)
21
+ - [Finnish](#finnish)
22
+ - [Finnish Common\_Voice Vox\_Populi @ finetune @ fi](#finnish-common_voice-vox_populi--finetune--fi)
23
+ - [French](#french)
24
+ - [French LibriVox @ finetune @ fr](#french-librivox--finetune--fr)
25
+ - [Japanese](#japanese)
26
+ - [F5-TTS Japanese @ pretrain/finetune @ ja](#f5-tts-japanese--pretrainfinetune--ja)
27
+ - [Mandarin](#mandarin)
28
+ - [Spanish](#spanish)
29
+ - [F5-TTS Spanish @ pretrain/finetune @ es](#f5-tts-spanish--pretrainfinetune--es)
30
+
31
+
32
+ ## Multilingual
33
+
34
+ #### F5-TTS Base @ pretrain @ zh & en
35
+ |Model|🤗Hugging Face|Data (Hours)|Model License|
36
+ |:---:|:------------:|:-----------:|:-------------:|
37
+ |F5-TTS Base|[ckpt & vocab](https://huggingface.co/SWivid/F5-TTS/tree/main/F5TTS_Base)|[Emilia 95K zh&en](https://huggingface.co/datasets/amphion/Emilia-Dataset/tree/fc71e07)|cc-by-nc-4.0|
38
+
39
+ ```bash
40
+ MODEL_CKPT: hf://SWivid/F5-TTS/F5TTS_Base/model_1200000.safetensors
41
+ VOCAB_FILE: hf://SWivid/F5-TTS/F5TTS_Base/vocab.txt
42
+ ```
43
+
44
+ *Other infos, e.g. Author info, Github repo, Link to some sampled results, Usage instruction, Tutorial (Blog, Video, etc.) ...*
45
+
46
+
47
+ ## English
48
+
49
+
50
+ ## Finnish
51
+
52
+ #### Finnish Common_Voice Vox_Populi @ finetune @ fi
53
+ |Model|🤗Hugging Face|Data|Model License|
54
+ |:---:|:------------:|:-----------:|:-------------:|
55
+ |F5-TTS Finnish|[ckpt & vocab](https://huggingface.co/AsmoKoskinen/F5-TTS_Finnish_Model)|[Common Voice](https://huggingface.co/datasets/mozilla-foundation/common_voice_17_0), [Vox Populi](https://huggingface.co/datasets/facebook/voxpopuli)|cc-by-nc-4.0|
56
+
57
+ ```bash
58
+ MODEL_CKPT: hf://AsmoKoskinen/F5-TTS_Finish_Model/model_common_voice_fi_vox_populi_fi_20241206.safetensors
59
+ VOCAB_FILE: hf://AsmoKoskinen/F5-TTS_Finish_Model/vocab.txt
60
+ ```
61
+
62
+
63
+ ## French
64
+
65
+ #### French LibriVox @ finetune @ fr
66
+ |Model|🤗Hugging Face|Data (Hours)|Model License|
67
+ |:---:|:------------:|:-----------:|:-------------:|
68
+ |F5-TTS French|[ckpt & vocab](https://huggingface.co/RASPIAUDIO/F5-French-MixedSpeakers-reduced)|[LibriVox](https://librivox.org/)|cc-by-nc-4.0|
69
+
70
+ ```bash
71
+ MODEL_CKPT: hf://RASPIAUDIO/F5-French-MixedSpeakers-reduced/model_last_reduced.pt
72
+ VOCAB_FILE: hf://RASPIAUDIO/F5-French-MixedSpeakers-reduced/vocab.txt
73
+ ```
74
+
75
+ - [Online Inference with Hugging Face Space](https://huggingface.co/spaces/RASPIAUDIO/f5-tts_french).
76
+ - [Tutorial video to train a new language model](https://www.youtube.com/watch?v=UO4usaOojys).
77
+ - [Discussion about this training can be found here](https://github.com/SWivid/F5-TTS/issues/434).
78
+
79
+
80
+ ## Japanese
81
+
82
+ #### F5-TTS Japanese @ pretrain/finetune @ ja
83
+ |Model|🤗Hugging Face|Data (Hours)|Model License|
84
+ |:---:|:------------:|:-----------:|:-------------:|
85
+ |F5-TTS Japanese|[ckpt & vocab](https://huggingface.co/Jmica/F5TTS/tree/main/JA_8500000)|[Emilia 1.7k JA](https://huggingface.co/datasets/amphion/Emilia-Dataset/tree/fc71e07) & [Galgame Dataset 5.4k](https://huggingface.co/datasets/OOPPEENN/Galgame_Dataset)|cc-by-nc-4.0|
86
+
87
+ ```bash
88
+ MODEL_CKPT: hf://Jmica/F5TTS/JA_8500000/model_8499660.pt
89
+ VOCAB_FILE: hf://Jmica/F5TTS/JA_8500000/vocab_updated.txt
90
+ ```
91
+
92
+
93
+ ## Mandarin
94
+
95
+
96
+ ## Spanish
97
+
98
+ #### F5-TTS Spanish @ pretrain/finetune @ es
99
+ |Model|🤗Hugging Face|Data (Hours)|Model License|
100
+ |:---:|:------------:|:-----------:|:-------------:|
101
+ |F5-TTS Spanish|[ckpt & vocab](https://huggingface.co/jpgallegoar/F5-Spanish)|[Voxpopuli](https://huggingface.co/datasets/facebook/voxpopuli) & Crowdsourced & TEDx, 218 hours|cc0-1.0|
102
+
103
+ - @jpgallegoar [GitHub repo](https://github.com/jpgallegoar/Spanish-F5), Jupyter Notebook and Gradio usage for Spanish model.