LeeSangHoon commited on
Commit
daea196
·
verified ·
1 Parent(s): fa23adb

Group EN and ZH metrics and add Emilia SOTA statement

Browse files
Files changed (1) hide show
  1. README.md +54 -16
README.md CHANGED
@@ -55,25 +55,63 @@ CFG 0, inference bottleneck dropout 0, waveform temperature 1, **initial Mel
55
  temperature 0**, and seed 0. It uses the same original test prompts and
56
  FP32-weight/BF16-inference precision. Prompt states interpolate from their
57
  initial noise toward the reference at each step; the initial Mel noise is
58
- scaled by the Mel temperature. The Flash rows below use the new default
59
  temperature 0. WER/CER and UTMOS are truncated to two decimal places,
60
  and SIM to three decimal places (not rounded).
61
 
62
- ### Seed-en (1,088 utterances)
63
-
64
- | Model | WER (%) ↓ | SIM ↑ | UTMOS ↑ |
65
- |---|---:|---:|---:|
66
- | WaveGen (Pre-trained, 1300k EMA) | 1.47 | 0.755 | 3.68 |
67
- | WaveGen V-Spec (1400k EMA) | 1.39 | 0.743 | 3.59 |
68
- | WaveGen-Flash (48k EMA, 4 steps) | 1.49 | 0.727 | 3.53 |
69
-
70
- ### Seed-zh (2,020 utterances)
71
-
72
- | Model | CER (%) ↓ | SIM ↑ | UTMOS ↑ |
73
- |---|---:|---:|---:|
74
- | WaveGen (Pre-trained, 1300k EMA) | 1.75 | 0.805 | 2.87 |
75
- | WaveGen V-Spec (1400k EMA) | 1.65 | 0.783 | 2.79 |
76
- | WaveGen-Flash (48k EMA, 4 steps) | 1.59 | 0.768 | 2.74 |
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
77
 
78
  WER is reported for English and CER for Chinese. Error rates are percentages;
79
  all metrics are macro-averaged over utterances. The Safetensors exports preserve
 
55
  temperature 0**, and seed 0. It uses the same original test prompts and
56
  FP32-weight/BF16-inference precision. Prompt states interpolate from their
57
  initial noise toward the reference at each step; the initial Mel noise is
58
+ scaled by the Mel temperature. The Flash results below use the new default
59
  temperature 0. WER/CER and UTMOS are truncated to two decimal places,
60
  and SIM to three decimal places (not rounded).
61
 
62
+ The complete test sets contain 1,088 English and 2,020 Chinese utterances.
63
+
64
+ <table>
65
+ <colgroup span="1"></colgroup>
66
+ <colgroup span="3"></colgroup>
67
+ <colgroup span="3"></colgroup>
68
+ <thead>
69
+ <tr>
70
+ <th rowspan="2" scope="col" align="left">Model</th>
71
+ <th colspan="3" scope="colgroup" align="center">EN</th>
72
+ <th colspan="3" scope="colgroup" align="center">ZH</th>
73
+ </tr>
74
+ <tr>
75
+ <th scope="col" align="center">WER (%) ↓</th>
76
+ <th scope="col" align="center">SIM ↑</th>
77
+ <th scope="col" align="center">UTMOS ↑</th>
78
+ <th scope="col" align="center">CER (%) ↓</th>
79
+ <th scope="col" align="center">SIM ↑</th>
80
+ <th scope="col" align="center">UTMOS ↑</th>
81
+ </tr>
82
+ </thead>
83
+ <tbody>
84
+ <tr>
85
+ <th scope="row" align="left"><strong>WaveGen</strong><br><sub>Pre-trained · 1300k EMA</sub></th>
86
+ <td align="center">1.47</td>
87
+ <td align="center">0.755</td>
88
+ <td align="center">3.68</td>
89
+ <td align="center">1.75</td>
90
+ <td align="center">0.805</td>
91
+ <td align="center">2.87</td>
92
+ </tr>
93
+ <tr>
94
+ <th scope="row" align="left"><strong>WaveGen V-Spec</strong><br><sub>1400k EMA · Recommended</sub></th>
95
+ <td align="center">1.39</td>
96
+ <td align="center">0.743</td>
97
+ <td align="center">3.59</td>
98
+ <td align="center">1.65</td>
99
+ <td align="center">0.783</td>
100
+ <td align="center">2.79</td>
101
+ </tr>
102
+ <tr>
103
+ <th scope="row" align="left"><strong>WaveGen-Flash</strong><br><sub>48k EMA · 4 steps</sub></th>
104
+ <td align="center">1.49</td>
105
+ <td align="center">0.727</td>
106
+ <td align="center">3.53</td>
107
+ <td align="center">1.59</td>
108
+ <td align="center">0.768</td>
109
+ <td align="center">2.74</td>
110
+ </tr>
111
+ </tbody>
112
+ </table>
113
+
114
+ **WaveGen achieves state-of-the-art performance among TTS models trained on the Emilia dataset.**
115
 
116
  WER is reported for English and CER for Chinese. Error rates are percentages;
117
  all metrics are macro-averaged over utterances. The Safetensors exports preserve