Add Samples section: 5 playable clips with reference text and Dynamic ASR output
Browse files
README.md
CHANGED
|
@@ -100,6 +100,60 @@ Any wav is mixed to mono and resampled to 16 kHz; clips over ~20 s are cut at qu
|
|
| 100 |
|
| 101 |
Pocket shares the limitations listed below, with higher error than the 1B models.
|
| 102 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 103 |
## Results
|
| 104 |
|
| 105 |
All test data is held out (never trained on). Scores are WER / CER after lower-casing and stripping punctuation; "no-diacritic" CER folds tone marks and dots. Decoding: greedy CTC with a Latin-script logit mask (the duplex setting).
|
|
|
|
| 100 |
|
| 101 |
Pocket shares the limitations listed below, with higher error than the 1B models.
|
| 102 |
|
| 103 |
+
## Samples
|
| 104 |
+
|
| 105 |
+
Hear the input and read what the model wrote. The input clips are **synthetic speech** from our [Dynamic Accent](https://huggingface.co/Modularcomputing/dynamic-accent-pro-v1.1) Flash-DPO TTS (female `waxal_ibo_5` or male anchor voice), not real recordings, so they are cleaner than real-world audio. The transcripts come from an internal Dynamic ASR checkpoint newer than `real/` (it adds a Yoruba tone-mark fix and is not one of the files in this repository yet): **with LM** = decoding with a 4-gram KenLM, as the [Duplex](https://huggingface.co/Modularcomputing/dynamic-accent-duplex) agent uses on final segments; **greedy** = plain CTC, no LM. Output is lower-case with no punctuation, and Igbo has no tone marks by design. Audio: mono MP3, CC-BY-SA-4.0.
|
| 106 |
+
|
| 107 |
+
**1. Igbo** (female TTS voice)
|
| 108 |
+
|
| 109 |
+
<audio controls src="https://huggingface.co/Modularcomputing/dynamic-asr/resolve/main/samples/tts_01_igbo_female_waxal_ibo5.mp3"></audio>
|
| 110 |
+
|
| 111 |
+
| | text |
|
| 112 |
+
|---|---|
|
| 113 |
+
| reference | Ndewo, kedụ ka ị mere? Anyị ga-aga ahịa echi n'ụtụtụ. |
|
| 114 |
+
| Dynamic ASR, with LM | nde wo kedu ka i mere anyị ga agaghi echi n'ụtụtụ |
|
| 115 |
+
| Dynamic ASR, greedy | ndewo kedu ka ị mere anyị ga aga ahị echi n'ụtụtụ |
|
| 116 |
+
|
| 117 |
+
**2. Yoruba** (female TTS voice)
|
| 118 |
+
|
| 119 |
+
<audio controls src="https://huggingface.co/Modularcomputing/dynamic-asr/resolve/main/samples/tts_02_yoruba_tones_female_waxal_ibo5.mp3"></audio>
|
| 120 |
+
|
| 121 |
+
| | text |
|
| 122 |
+
|---|---|
|
| 123 |
+
| reference | Ẹ káàárọ̀! Ṣé dáadáa ni ẹ wà? Mo fẹ́ lọ sí ọjà lọ́la. |
|
| 124 |
+
| Dynamic ASR, with LM | ẹkáàárọ̀ ṣé dáadáa ni ẹwà mo fẹ́ lọ sí ọjà lọ́lá |
|
| 125 |
+
| Dynamic ASR, greedy | ẹká àrọ̀ ṣé dáadá ni ẹwà mo fẹ́ lọ sí ọjà lọla |
|
| 126 |
+
|
| 127 |
+
**3. Hausa** (male TTS voice)
|
| 128 |
+
|
| 129 |
+
<audio controls src="https://huggingface.co/Modularcomputing/dynamic-asr/resolve/main/samples/tts_03_hausa_flash_default_male.mp3"></audio>
|
| 130 |
+
|
| 131 |
+
| | text |
|
| 132 |
+
|---|---|
|
| 133 |
+
| reference | Sannu da zuwa. Yaya aiki? Zan tafi Kano gobe da safe. |
|
| 134 |
+
| Dynamic ASR, with LM | sannu da zuwa yaya aiki zan tafi kano gobe a safe |
|
| 135 |
+
| Dynamic ASR, greedy | sanuda zuwa yaya aiki zan tafi kano gube da safe |
|
| 136 |
+
|
| 137 |
+
**4. Pidgin** (female TTS voice)
|
| 138 |
+
|
| 139 |
+
<audio controls src="https://huggingface.co/Modularcomputing/dynamic-asr/resolve/main/samples/tts_04_pidgin_female_waxal_ibo5.mp3"></audio>
|
| 140 |
+
|
| 141 |
+
| | text |
|
| 142 |
+
|---|---|
|
| 143 |
+
| reference | How far, my guy? Abeg make we see for evening, I dey come. |
|
| 144 |
+
| Dynamic ASR, with LM | how far my guy abeg make we see for evenin i dey come |
|
| 145 |
+
| Dynamic ASR, greedy | how far my guy abeg make we see for evening i dey come |
|
| 146 |
+
|
| 147 |
+
**5. Igbo + English (code-switch)** (male TTS voice)
|
| 148 |
+
|
| 149 |
+
<audio controls src="https://huggingface.co/Modularcomputing/dynamic-asr/resolve/main/samples/tts_06_cs_igbo_english_flash_default_male.mp3"></audio>
|
| 150 |
+
|
| 151 |
+
| | text |
|
| 152 |
+
|---|---|
|
| 153 |
+
| reference | Biko, can you send me the report before Friday? Daalụ. |
|
| 154 |
+
| Dynamic ASR, with LM | biko can you send me the report before friday talo |
|
| 155 |
+
| Dynamic ASR, greedy | biko can you send me the report before friday daalo |
|
| 156 |
+
|
| 157 |
## Results
|
| 158 |
|
| 159 |
All test data is held out (never trained on). Scores are WER / CER after lower-casing and stripping punctuation; "no-diacritic" CER folds tone marks and dots. Decoding: greedy CTC with a Latin-script logit mask (the duplex setting).
|
samples/tts_01_igbo_female_waxal_ibo5.mp3
ADDED
|
Binary file (38.8 kB). View file
|
|
|
samples/tts_02_yoruba_tones_female_waxal_ibo5.mp3
ADDED
|
Binary file (41.7 kB). View file
|
|
|
samples/tts_03_hausa_flash_default_male.mp3
ADDED
|
Binary file (37.1 kB). View file
|
|
|
samples/tts_04_pidgin_female_waxal_ibo5.mp3
ADDED
|
Binary file (36.5 kB). View file
|
|
|
samples/tts_06_cs_igbo_english_flash_default_male.mp3
ADDED
|
Binary file (35.6 kB). View file
|
|
|