Hugging Face's logo

ASLP-lab
/
CN-MultiDialect-ASR

Automatic Speech Recognition
Transformers
Safetensors
Chinese
Yue Chinese
English
qwen3_asr
asr
speech-recognition
chinese
dialect
qwen3-asr
audio
Model card Files
xet
 Community
ASLP-lab commited on
Commit
c2f8e1f
·
verified ·
1 Parent(s): d5572ec

Upload README.md

Browse files
Files changed (1) hide show
  1. README.md +98 -40
README.md CHANGED
@@ -159,52 +159,110 @@ At inference time, only the student pathway is used.
159
 
160
  ### Public Dialect CER (%)
161
 
162
- | Evaluation set | Dialect | Qwen3-ASR | CN-MultiDialect-ASR |
163
- |:--------------:|:-------:|:---------:|:--------------------:|
164
- | WenetSpeech-Yue Long | Cantonese | 9.99 | **8.80** |
165
- | WenetSpeech-Yue Short | Cantonese | 6.93 | **5.31** |
166
- | WenetSpeech-Chuan Easy | Sichuan | 12.38 | **11.86** |
167
- | WenetSpeech-Chuan Hard | Sichuan | 21.79 | **21.74** |
168
- | WenetSpeech-Wu | Wu | 25.74 | **16.26** |
169
- | **Dialect Avg.** | | 15.37 | **12.79** |
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
170
 
171
  ### Internal Dialect CER (%)
172
 
173
- | Dialect | Qwen3-ASR | CN-MultiDialect-ASR |
174
- |:-------:|:---------:|:--------------------:|
175
- | Anhui | 18.95 | **13.08** |
176
- | Cantonese | 10.06 | **7.74** |
177
- | Changsha | 14.79 | **10.23** |
178
- | Chaoshan | 45.59 | **25.21** |
179
- | Dongbei | 6.45 | **5.80** |
180
- | Henan | 8.46 | **5.99** |
181
- | Kejia | 60.47 | **28.60** |
182
- | Minnan | 30.03 | **18.59** |
183
- | Nanchang | 33.41 | **15.58** |
184
- | Nanjing | 13.37 | **9.33** |
185
- | Shanxi | 28.53 | **18.69** |
186
- | Shaanxi | 9.68 | **6.28** |
187
- | Shandong | 8.78 | **7.64** |
188
- | Shanghai | 15.78 | 12.07 |
189
- | Sichuan | 5.99 | 5.38 |
190
- | Suzhou | 50.35 | **20.73** |
191
- | Wuhan | 11.30 | **7.59** |
192
- | Xuzhou | 6.12 | **5.04** |
193
- | **Internal Avg.** | 21.01 | **12.42** |
 
 
 
 
 
 
 
 
 
194
 
195
  ### Mandarin CER (%)
196
 
197
- | Evaluation set | Qwen3-ASR | CN-MultiDialect-ASR |
198
- |:--------------:|:---------:|:-------------------:|
199
- | AISHELL-1 | 1.57 | **1.38** |
200
- | AISHELL-2 | 2.79 | **2.52** |
201
- | KeSpeech | 5.11 | **4.56** |
202
- | SpeechIO-1 | **0.75** | 0.86 |
203
- | SpeechIO-2 | 3.83 | **3.39** |
204
- | SpeechIO-3 | 1.39 | **1.27** |
205
- | Test_Meeting | **6.74** | 6.85 |
206
- | Test_Net | 5.46 | **5.30** |
207
- | Mandarin Avg. | 3.46 | **3.27** |
 
 
 
 
 
 
 
 
 
208
 
209
  ## Citation
210
 
 
159
 
160
  ### Public Dialect CER (%)
161
 
162
+ <table>
163
+ <thead>
164
+ <tr>
165
+ <th align="center">Evaluation set</th>
166
+ <th align="center">Dialect</th>
167
+ <th align="center">Qwen3-ASR</th>
168
+ <th align="center">CN-MultiDialect-ASR</th>
169
+ </tr>
170
+ </thead>
171
+ <tbody>
172
+ <tr>
173
+ <td align="center">WenetSpeech-Yue Long</td>
174
+ <td align="center">Cantonese</td>
175
+ <td align="center">9.99</td>
176
+ <td align="center"><b>8.80</b></td>
177
+ </tr>
178
+ <tr>
179
+ <td align="center">WenetSpeech-Yue Short</td>
180
+ <td align="center">Cantonese</td>
181
+ <td align="center">6.93</td>
182
+ <td align="center"><b>5.31</b></td>
183
+ </tr>
184
+ <tr>
185
+ <td align="center">WenetSpeech-Chuan Easy</td>
186
+ <td align="center">Sichuan</td>
187
+ <td align="center">12.38</td>
188
+ <td align="center"><b>11.86</b></td>
189
+ </tr>
190
+ <tr>
191
+ <td align="center">WenetSpeech-Chuan Hard</td>
192
+ <td align="center">Sichuan</td>
193
+ <td align="center">21.79</td>
194
+ <td align="center"><b>21.74</b></td>
195
+ </tr>
196
+ <tr>
197
+ <td align="center">WenetSpeech-Wu</td>
198
+ <td align="center">Wu</td>
199
+ <td align="center">25.74</td>
200
+ <td align="center"><b>16.26</b></td>
201
+ </tr>
202
+ <tr>
203
+ <td align="center"><b>Dialect Avg.</b></td>
204
+ <td align="center"></td>
205
+ <td align="center">15.37</td>
206
+ <td align="center"><b>12.79</b></td>
207
+ </tr>
208
+ </tbody>
209
+ </table>
210
 
211
  ### Internal Dialect CER (%)
212
 
213
+ <table>
214
+ <thead>
215
+ <tr>
216
+ <th align="center">Dialect</th>
217
+ <th align="center">Qwen3-ASR</th>
218
+ <th align="center">CN-MultiDialect-ASR</th>
219
+ </tr>
220
+ </thead>
221
+ <tbody>
222
+ <tr><td align="center">Anhui</td><td align="center">18.95</td><td align="center"><b>13.08</b></td></tr>
223
+ <tr><td align="center">Cantonese</td><td align="center">10.06</td><td align="center"><b>7.74</b></td></tr>
224
+ <tr><td align="center">Changsha</td><td align="center">14.79</td><td align="center"><b>10.23</b></td></tr>
225
+ <tr><td align="center">Chaoshan</td><td align="center">45.59</td><td align="center"><b>25.21</b></td></tr>
226
+ <tr><td align="center">Dongbei</td><td align="center">6.45</td><td align="center"><b>5.80</b></td></tr>
227
+ <tr><td align="center">Henan</td><td align="center">8.46</td><td align="center"><b>5.99</b></td></tr>
228
+ <tr><td align="center">Kejia</td><td align="center">60.47</td><td align="center"><b>28.60</b></td></tr>
229
+ <tr><td align="center">Minnan</td><td align="center">30.03</td><td align="center"><b>18.59</b></td></tr>
230
+ <tr><td align="center">Nanchang</td><td align="center">33.41</td><td align="center"><b>15.58</b></td></tr>
231
+ <tr><td align="center">Nanjing</td><td align="center">13.37</td><td align="center"><b>9.33</b></td></tr>
232
+ <tr><td align="center">Shanxi</td><td align="center">28.53</td><td align="center"><b>18.69</b></td></tr>
233
+ <tr><td align="center">Shaanxi</td><td align="center">9.68</td><td align="center"><b>6.28</b></td></tr>
234
+ <tr><td align="center">Shandong</td><td align="center">8.78</td><td align="center"><b>7.64</b></td></tr>
235
+ <tr><td align="center">Shanghai</td><td align="center">15.78</td><td align="center">12.07</td></tr>
236
+ <tr><td align="center">Sichuan</td><td align="center">5.99</td><td align="center">5.38</td></tr>
237
+ <tr><td align="center">Suzhou</td><td align="center">50.35</td><td align="center"><b>20.73</b></td></tr>
238
+ <tr><td align="center">Wuhan</td><td align="center">11.30</td><td align="center"><b>7.59</b></td></tr>
239
+ <tr><td align="center">Xuzhou</td><td align="center">6.12</td><td align="center"><b>5.04</b></td></tr>
240
+ <tr><td align="center"><b>Internal Avg.</b></td><td align="center">21.01</td><td align="center"><b>12.42</b></td></tr>
241
+ </tbody>
242
+ </table>
243
 
244
  ### Mandarin CER (%)
245
 
246
+ <table>
247
+ <thead>
248
+ <tr>
249
+ <th align="center">Evaluation set</th>
250
+ <th align="center">Qwen3-ASR</th>
251
+ <th align="center">CN-MultiDialect-ASR</th>
252
+ </tr>
253
+ </thead>
254
+ <tbody>
255
+ <tr><td align="center">AISHELL-1</td><td align="center">1.57</td><td align="center"><b>1.38</b></td></tr>
256
+ <tr><td align="center">AISHELL-2</td><td align="center">2.79</td><td align="center"><b>2.52</b></td></tr>
257
+ <tr><td align="center">KeSpeech</td><td align="center">5.11</td><td align="center"><b>4.56</b></td></tr>
258
+ <tr><td align="center">SpeechIO-1</td><td align="center"><b>0.75</b></td><td align="center">0.86</td></tr>
259
+ <tr><td align="center">SpeechIO-2</td><td align="center">3.83</td><td align="center"><b>3.39</b></td></tr>
260
+ <tr><td align="center">SpeechIO-3</td><td align="center">1.39</td><td align="center"><b>1.27</b></td></tr>
261
+ <tr><td align="center">Test_Meeting</td><td align="center"><b>6.74</b></td><td align="center">6.85</td></tr>
262
+ <tr><td align="center">Test_Net</td><td align="center">5.46</td><td align="center"><b>5.30</b></td></tr>
263
+ <tr><td align="center"><b>Mandarin Avg.</b></td><td align="center">3.46</td><td align="center"><b>3.27</b></td></tr>
264
+ </tbody>
265
+ </table>
266
 
267
  ## Citation
268