UncleanCode commited on
Commit
88d7887
·
verified ·
1 Parent(s): 19eb87a

Add Samples section: 5 playable clips with reference text and Dynamic ASR output

Browse files
README.md CHANGED
@@ -100,6 +100,60 @@ Any wav is mixed to mono and resampled to 16 kHz; clips over ~20 s are cut at qu
100
 
101
  Pocket shares the limitations listed below, with higher error than the 1B models.
102
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
103
  ## Results
104
 
105
  All test data is held out (never trained on). Scores are WER / CER after lower-casing and stripping punctuation; "no-diacritic" CER folds tone marks and dots. Decoding: greedy CTC with a Latin-script logit mask (the duplex setting).
 
100
 
101
  Pocket shares the limitations listed below, with higher error than the 1B models.
102
 
103
+ ## Samples
104
+
105
+ Hear the input and read what the model wrote. The input clips are **synthetic speech** from our [Dynamic Accent](https://huggingface.co/Modularcomputing/dynamic-accent-pro-v1.1) Flash-DPO TTS (female `waxal_ibo_5` or male anchor voice), not real recordings, so they are cleaner than real-world audio. The transcripts come from an internal Dynamic ASR checkpoint newer than `real/` (it adds a Yoruba tone-mark fix and is not one of the files in this repository yet): **with LM** = decoding with a 4-gram KenLM, as the [Duplex](https://huggingface.co/Modularcomputing/dynamic-accent-duplex) agent uses on final segments; **greedy** = plain CTC, no LM. Output is lower-case with no punctuation, and Igbo has no tone marks by design. Audio: mono MP3, CC-BY-SA-4.0.
106
+
107
+ **1. Igbo** (female TTS voice)
108
+
109
+ <audio controls src="https://huggingface.co/Modularcomputing/dynamic-asr/resolve/main/samples/tts_01_igbo_female_waxal_ibo5.mp3"></audio>
110
+
111
+ | | text |
112
+ |---|---|
113
+ | reference | Ndewo, kedụ ka ị mere? Anyị ga-aga ahịa echi n'ụtụtụ. |
114
+ | Dynamic ASR, with LM | nde wo kedu ka i mere anyị ga agaghi echi n'ụtụtụ |
115
+ | Dynamic ASR, greedy | ndewo kedu ka ị mere anyị ga aga ahị echi n'ụtụtụ |
116
+
117
+ **2. Yoruba** (female TTS voice)
118
+
119
+ <audio controls src="https://huggingface.co/Modularcomputing/dynamic-asr/resolve/main/samples/tts_02_yoruba_tones_female_waxal_ibo5.mp3"></audio>
120
+
121
+ | | text |
122
+ |---|---|
123
+ | reference | Ẹ káàárọ̀! Ṣé dáadáa ni ẹ wà? Mo fẹ́ lọ sí ọjà lọ́la. |
124
+ | Dynamic ASR, with LM | ẹkáàárọ̀ ṣé dáadáa ni ẹwà mo fẹ́ lọ sí ọjà lọ́lá |
125
+ | Dynamic ASR, greedy | ẹká àrọ̀ ṣé dáadá ni ẹwà mo fẹ́ lọ sí ọjà lọla |
126
+
127
+ **3. Hausa** (male TTS voice)
128
+
129
+ <audio controls src="https://huggingface.co/Modularcomputing/dynamic-asr/resolve/main/samples/tts_03_hausa_flash_default_male.mp3"></audio>
130
+
131
+ | | text |
132
+ |---|---|
133
+ | reference | Sannu da zuwa. Yaya aiki? Zan tafi Kano gobe da safe. |
134
+ | Dynamic ASR, with LM | sannu da zuwa yaya aiki zan tafi kano gobe a safe |
135
+ | Dynamic ASR, greedy | sanuda zuwa yaya aiki zan tafi kano gube da safe |
136
+
137
+ **4. Pidgin** (female TTS voice)
138
+
139
+ <audio controls src="https://huggingface.co/Modularcomputing/dynamic-asr/resolve/main/samples/tts_04_pidgin_female_waxal_ibo5.mp3"></audio>
140
+
141
+ | | text |
142
+ |---|---|
143
+ | reference | How far, my guy? Abeg make we see for evening, I dey come. |
144
+ | Dynamic ASR, with LM | how far my guy abeg make we see for evenin i dey come |
145
+ | Dynamic ASR, greedy | how far my guy abeg make we see for evening i dey come |
146
+
147
+ **5. Igbo + English (code-switch)** (male TTS voice)
148
+
149
+ <audio controls src="https://huggingface.co/Modularcomputing/dynamic-asr/resolve/main/samples/tts_06_cs_igbo_english_flash_default_male.mp3"></audio>
150
+
151
+ | | text |
152
+ |---|---|
153
+ | reference | Biko, can you send me the report before Friday? Daalụ. |
154
+ | Dynamic ASR, with LM | biko can you send me the report before friday talo |
155
+ | Dynamic ASR, greedy | biko can you send me the report before friday daalo |
156
+
157
  ## Results
158
 
159
  All test data is held out (never trained on). Scores are WER / CER after lower-casing and stripping punctuation; "no-diacritic" CER folds tone marks and dots. Decoding: greedy CTC with a Latin-script logit mask (the duplex setting).
samples/tts_01_igbo_female_waxal_ibo5.mp3 ADDED
Binary file (38.8 kB). View file
 
samples/tts_02_yoruba_tones_female_waxal_ibo5.mp3 ADDED
Binary file (41.7 kB). View file
 
samples/tts_03_hausa_flash_default_male.mp3 ADDED
Binary file (37.1 kB). View file
 
samples/tts_04_pidgin_female_waxal_ibo5.mp3 ADDED
Binary file (36.5 kB). View file
 
samples/tts_06_cs_igbo_english_flash_default_male.mp3 ADDED
Binary file (35.6 kB). View file