File size: 10,188 Bytes
85f9e70 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 | ---
language:
- zh
pipeline_tag: other
library_name: montreal-forced-aligner
tags:
- montreal-forced-aligner
- forced-alignment
license: cc-by-4.0
---
# Model Card for mandarin_mfa
<!-- Provide a quick summary of what the model is/does. -->
This MFA model is for aligning Mandarin speech.
- [Model details](#model-details)
- [Uses](#uses)
- [Performance Factors](#how-to-get-started-with-the-model)
- [Dictionary Details](#dictionary-details)
- [Training Details](#training-details)
- [Evaluation](#evaluation)
- [Contact](#contact)
## Model Details
### Model Description
<!-- Provide a longer summary of what this model is. -->
- **Developed by:** Michael McAuliffe
- **Funded by:** N/A
- **Model type:** Montreal Forced Aligner model
- **Language(s) (NLP):** Mandarin
- **License:** cc-by-4.0
## Uses
<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
### Direct Use
<!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
This model is intended to be used for forced alignment of Mandarin speech. Please see https://montreal-forced-aligner.readthedocs.io/en/latest/user_guide/troubleshooting.html for details on common fixes. If using Pinyin transcripts, use the G2P models either directly or via the `--use_g2p --language unknown` flags. Otherwise, MFA will assume Chinese characters and use a tokenizer to split up words and generate pronunciations for unknown words based on their Pinyin conversion.
### Out-of-Scope Use
<!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
This model cannot provide accurate assessments of goodness of pronunciations or provide transcripts as it is trained to be accepting of variation in pronunciation to provide a reasonable alignment for Mandarin speech.
## Bias, Risks, and Limitations
<!-- This section is meant to convey both technical and sociotechnical limitations. -->
This model will perform best on the variety of speech that it was trained on. The speakers in the training data are all adult speakers, so child speech alignment may not be accurate.
### Recommendations
<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
When using this model on a variety that it was not trained on, better results can be attained by adapting the model to the data to be aligned first. See https://montreal-forced-aligner.readthedocs.io/en/latest/user_guide/workflows/adapt_acoustic_model.html and https://github.com/mmcauliffe/mfa-adaptation for example usage and scripts.
## How to Get Started with the Model
Use the code below to get started with the model.
To get started, follow the instructions for [installing MFA](https://montreal-forced-aligner.readthedocs.io/en/latest/getting_started.html). To align files using this model, use the [mfa align](https://montreal-forced-aligner.readthedocs.io/en/latest/user_guide/workflows/alignment.html) command.
## Dictionary Details
#### Details for mandarin_taiwan_mfa dictionary and G2P model
- **Source:** wikipron
- **Orthography:** Hanzi and Pinyin
- **Phone set:** MFA
- **Words:** 156,093
* **Phones:** 51
* **Graphemes:** 18,170
##### IPA chart
###### Consonants
| Manner | Labial | Labiodental | Alveolar | Retroflex | Palatal | Velar | Glottal |
| :----: | :----: | :----: | :----: | :----: | :----: | :----: | :----: |
| **Nasal** | m | | n n̩ | | ɲ | ŋ ŋ̍ | |
| Palatalized | mʲ | | | | | | |
| **Stop** | p | | t | | | k | ʔ|
| Aspirated | pʰ | | tʰ | | | kʰ | |
| Labialized | pʷ | | tʷ | | | kʷ | |
| Palatalized | pʲ | | tʲ | | | | |
| **Affricate** | | | ts | ʈʂ | tɕ | | |
| Aspirated | | | tsʰ | ʈʂʰ | tɕʰ | | |
| Labialized | | | | | tɕʷ | | |
| **Sibilant** | | | s z̩ | ʂ ʐ ʐ̩ | ɕ | | |
| Labialized | | | | | ɕʷ | | |
| **Fricative** | | f | | | | | |
| **Approximant** | w | | | ɻ | j ɥ | | |
| **Lateral** | | | l | | ʎ | | |
###### Vowels
| | Front | Near-Front | Central | Near-Back | Back |
| :----: | :----: | :----: | :----: | :----: | :----: |
| **Close** | i y | | | | u|
| | | | | | |
| **Close-Mid** | e ej | | | | o ow|
| | | | ə | | |
| **Open-Mid** | | | | | |
| | | | | | |
| **Open** | | | a | | |
##### Diphthongs
* aw
* aj
* ej
* ow
#### Details for mandarin_china_mfa dictionary and G2P model
- **Source:** wikipron
- **Orthography:** Hanzi and Pinyin
- **Phone set:** MFA
- **Words:** 286,218
* **Phones:** 52
* **Graphemes:** 18,043
##### IPA chart
###### Consonants
| Manner | Labial | Labiodental | Alveolar | Retroflex | Palatal | Velar | Glottal |
| :----: | :----: | :----: | :----: | :----: | :----: | :----: | :----: |
| **Nasal** | m m̩ | | n n̩ | | ɲ | ŋ ŋ̍ | |
| Palatalized | mʲ | | | | | | |
| **Stop** | p | | t | | | k | ʔ|
| Aspirated | pʰ | | tʰ | | | kʰ | |
| Labialized | pʷ | | tʷ | | | kʷ | |
| Palatalized | pʲ | | tʲ | | | | |
| **Affricate** | | | ts | ʈʂ | tɕ | | |
| Aspirated | | | tsʰ | ʈʂʰ | tɕʰ | | |
| Labialized | | | | | tɕʷ | | |
| **Sibilant** | | | s z̩ | ʂ ʐ ʐ̩ | ɕ | | |
| Labialized | | | | | ɕʷ | | |
| **Fricative** | | f | | | | | |
| **Approximant** | w | | | ɻ | j ɥ | | |
| **Lateral** | | | l | | ʎ | | |
###### Vowels
| | Front | Near-Front | Central | Near-Back | Back |
| :----: | :----: | :----: | :----: | :----: | :----: |
| **Close** | i y | | | | u|
| | | | | | |
| **Close-Mid** | e ej | | | | o ow|
| | | | ə | | |
| **Open-Mid** | | | | | |
| | | | | | |
| **Open** | | | a | | |
##### Diphthongs
* aw
* aj
* ej
* ow
## Training Details
### Training Data
<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
#### AI-DataTang Corpus
- **Source:** https://openslr.org/62/
- **License:** [CC BY-NC-ND 4.0](https://creativecommons.org/licenses/by-nc-nd/4.0/)
- **Dialects:** china, erhua
- **Number of hours:** 200.38
- **Number of utterances:** 237,264
- **Number of speakers:** 600
- **Female speakers:** 0
- **Male speakers:** 0
- **Unknown speakers:** 420
#### Common Voice Chinese (China)
- **Source:** https://voice.mozilla.org/en/datasets
- **License:** [CC-0](https://creativecommons.org/publicdomain/zero/1.0/)
- **Dialects:** china, erhua
- **Number of hours:** 238.57
- **Number of utterances:** 169,114
- **Number of speakers:** 4,462
- **Female speakers:** 152
- **Male speakers:** 748
- **Unknown speakers:** 3,562
#### Common Voice Chinese (Taiwan)
- **Source:** https://voice.mozilla.org/en/datasets
- **License:** [CC-0](https://creativecommons.org/publicdomain/zero/1.0/)
- **Dialects:** taiwan
- **Number of hours:** 72.75
- **Number of utterances:** 82,137
- **Number of speakers:** 1,706
- **Female speakers:** 191
- **Male speakers:** 458
- **Unknown speakers:** 1,054
#### AISHELL-3
- **Source:** https://openslr.org/93/
- **License:** [Apache 2.0](https://www.apache.org/licenses/LICENSE-2.0)
- **Dialects:** china, erhua
- **Number of hours:** 160.88
- **Number of utterances:** 127,274
- **Number of speakers:** 360
- **Female speakers:** 0
- **Male speakers:** 0
- **Unknown speakers:** 360
#### THCHS-30
- **Source:** https://openslr.org/18/
- **License:** [Apache 2.0](https://www.apache.org/licenses/LICENSE-2.0)
- **Dialects:** china, erhua
- **Number of hours:** 34.16
- **Number of utterances:** 13,387
- **Number of speakers:** 60
- **Female speakers:** 0
- **Male speakers:** 0
- **Unknown speakers:** 60
#### GlobalPhone Chinese-Mandarin
- **Source:** https://catalogue.elra.info/en-us/repository/browse/ELRA-S0193/
- **License:** [ELRA](https://www.elra.info/en/services-around-lrs/distribution/licensing/)
- **Dialects:** china, erhua
- **Number of hours:** 31.09
- **Number of utterances:** 10,225
- **Number of speakers:** 132
- **Female speakers:** 68
- **Male speakers:** 64
- **Unknown speakers:** 0
### Training Procedure
<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
#### Preprocessing
Preprocessing include fixes and orthographic standardization to various corpora.
#### Training Hyperparameters
- **Training regime:** [Training configuration](config.yaml)
## Evaluation
<!-- This section describes the evaluation protocols and provides the results. -->
### Testing Data, Factors & Metrics
#### Testing Data
<!-- This should link to a Dataset Card if possible. -->
N/A
#### Factors
<!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
N/A
#### Metrics
<!-- These are the evaluation metrics being used, ideally with a description of why. -->
N/A
### Results
N/A
#### Summary
## Technical Specifications
### Model Architecture and Objective
HMM-GMM model
#### Software
This model was trained via the [Montreal Forced Aligner](https://montreal-forced-aligner.readthedocs.io/).
## Citation
<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
**BibTeX:**
```
@techreport{mfa_mandarin_mfa_acoustic_2026,
author={McAuliffe, Michael and Sonderegger, Morgan},
title={Mandarin MFA acoustic model v3.3.0},
address={\url{https://huggingface.co/MontrealCorpusTools/mandarin_mfa}},
year={2026},
month={Jun},
}
```
**APA:**
```
McAuliffe, M. & Sonderegger, M. (2026). Mandarin MFA acoustic model v3.3.0. Available at https://huggingface.co/MontrealCorpusTools/mandarin_mfa.
```
## Contact
For questions and issues, please file an issue either for this model at https://huggingface.co/MontrealCorpusTools/mandarin_mfa/discussions or for larger MFA issues at https://github.com/MontrealCorpusTools/Montreal-Forced-Aligner/issues. |