| --- |
| license: cc-by-nc-4.0 |
| tags: |
| - automatic-speech-recognition |
| - mms |
| - pytorch |
| metrics: |
| - wer |
| --- |
| |
| ## Shared Task: Mozilla Common Voice Spontaneous Speech ASR |
|
|
| https://www.codabench.org/competitions/10820/ |
| |
| **Inference code and weights of the 1st place solution in 3 of 4 subtasks:** |
| - Multilingual General |
| - Best small model |
| - Unseen Languages |
|
|
| Please see `paper.pdf` and `solution.ipynb` for the details and code entry point. |
|
|
| Training code is available in the following repository: |
| [https://huggingface.co/vecxoz/mozilla-shared-task-1st-place-mms-training](https://huggingface.co/vecxoz/mozilla-shared-task-1st-place-mms-training) |
|
|
| Author: Igor Ivanov (team "vecxoz") |
|
|
| This repository contains both fine-tuned model weights and |
| the inference code used to obtain the winning scores. |
| Code and weights are licensed separately. |
| License for code: MIT |
| License for weights: CC-BY-NC-4.0 |
| License for `SCTK` distribution can be found in the corresponding subdirectory. |
|
|
| The model weights are a derivative work of the following models, |
| obtained by fine-tuning on the Common Voice datasets. |
| https://huggingface.co/facebook/mms-1b-fl102 |
| https://huggingface.co/facebook/mms-1b-l1107 |
| https://huggingface.co/facebook/mms-1b-all |
|
|
| The test dataset is not included according to the Common Voice requirements. It is available via the link: |
| [https://datacollective.mozillafoundation.org/datasets/cminc35no007no707hql26lzk](https://datacollective.mozillafoundation.org/datasets/cminc35no007no707hql26lzk) |
|
|
| Directory structure of the dataset is the following: |
|
|
| ``` |
| mozilla-shared-task-1st-place-mms-inference |
| | |
| |-- mdc_asr_shared_task_test_data |
| | |
| |-- audios |
| | |-- spontaneous-speech-ady-67085.mp3 |
| | |-- ... |
| | |-- spontaneous-speech-ush-39974.mp3 |
| | |
| |-- multilingual-general |
| | |-- aln.tsv |
| | |-- ... |
| | |-- ukv.tsv |
| | |
| |-- small-model |
| | |-- ady.tsv |
| | |-- ... |
| | |-- ush.tsv |
| | |
| |-- unseen-langs |
| |-- ady.tsv |
| |-- ... |
| |-- ush.tsv |
| ``` |
|
|
