elmadany commited on
Commit
99f4a0d
Β·
verified Β·
1 Parent(s): f9cc242

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +176 -0
README.md CHANGED
@@ -1,3 +1,179 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  <div align="center">
2
 
3
  <img src="https://africa.dlnlp.ai/simba/images/VoC_simba" alt="VoC Simba Models Logo">
 
1
+ ---
2
+ language:
3
+ - am # Amharic
4
+ - ar # Arabic
5
+ - tw # Asante Twi
6
+ - bm # Bambara
7
+ - fr # French
8
+ - lg # Ganda
9
+ - ha # Hausa
10
+ - ig # Igbo
11
+ - rw # Kinyarwanda
12
+ - kg # Kongo
13
+ - ln # Lingala
14
+ - lu # Luba-Katanga
15
+ - mg # Malagasy
16
+ - nso # Northern Sotho
17
+ - ny # Nyanja
18
+ - om # Oromo
19
+ - pt # Portuguese
20
+ - sn # Shona
21
+ - so # Somali
22
+ - st # Southern Sotho
23
+ - sw # Swahili
24
+ - ss # Swati
25
+ - ti # Tigrinya
26
+ - ts # Tsonga
27
+ - tn # Tswana
28
+ - ak # Twi
29
+ - ve # Venda
30
+ - wo # Wolof
31
+ - xh # Xhosa
32
+ - yo # Yoruba
33
+ - zu # Zulu
34
+ - tzm # Tamazight
35
+ - sg # Sango
36
+ - din # Dinka
37
+ - ee # Ewe
38
+ - fo # Fon
39
+ - luo # Luo
40
+ - mos # Mossi
41
+ - umb # Umbundu
42
+ license: cc-by-4.0
43
+ tags:
44
+ - automatic-speech-recognition
45
+ - audio
46
+ - speech
47
+ - african-languages
48
+ - multilingual
49
+ - simba
50
+ - low-resource
51
+ - speech-recognition
52
+ - asr
53
+ datasets:
54
+ - UBC-NLP/SimbaBench
55
+ metrics:
56
+ - wer
57
+ - cer
58
+ library_name: transformers
59
+ pipeline_tag: automatic-speech-recognition
60
+ ---
61
+ <div align="center">
62
+
63
+ <img src="https://africa.dlnlp.ai/simba/images/VoC_simba" alt="VoC Simba Models Logo">
64
+
65
+
66
+ [![EMNLP 2025 Paper](https://img.shields.io/badge/EMNLP_2025-Paper-B31B1B?style=for-the-badge&logo=arxiv&logoColor=B31B1B&labelColor=FFCDD2)](https://aclanthology.org/2025.emnlp-main.559/)
67
+ [![Official Website](https://img.shields.io/badge/Official-Website-2EA44F?style=for-the-badge&logo=googlechrome&logoColor=2EA44F&labelColor=C8E6C9)](https://africa.dlnlp.ai/simba/)
68
+ [![SimbaBench](https://img.shields.io/badge/SimbaBench-Benchmark-8A2BE2?style=for-the-badge&logo=googlecharts&logoColor=8A2BE2&labelColor=E1BEE7)](#simbabench)
69
+ [![Hugging Face](https://img.shields.io/badge/%F0%9F%A4%97%20Hugging%20Face-Models-FFD21E?style=for-the-badge&logoColor=black&labelColor=FFF9C4)](https://huggingface.co/collections/UBC-NLP/simba-speech-series)
70
+ [![YouTube Video](https://img.shields.io/badge/YouTube-Video-FF0000?style=for-the-badge&logo=youtube&logoColor=FF0000&labelColor=FFCCBC)](#demo)
71
+
72
+ </div>
73
+
74
+ ## *Bridging the Digital Divide for African AI*
75
+
76
+ **Voice of a Continent** is a comprehensive open-source ecosystem designed to bring African languages to the forefront of artificial intelligence. By providing a unified suite of benchmarking tools and state-of-the-art models, we ensure that the future of speech technology is inclusive, representative, and accessible to over a billion people.
77
+
78
+ ## Best-in-Class Multilingual Models
79
+
80
+ Introduced in our EMNLP 2025 paper *[Voice of a Continent](https://aclanthology.org/2025.emnlp-main.559/)*, the **Simba Series** represents the current state-of-the-art for African speech AI.
81
+
82
+ - **Unified Suite:** Models optimized for African languages.
83
+ - **Superior Accuracy:** Outperforms generic multilingual models by leveraging SimbaBench's high-quality, domain-diverse datasets.
84
+ - **Multitask Capability:** Designed for high performance in ASR (Automatic Speech Recognition) and TTS (Text-to-Speech).
85
+ - **Inclusion-First:** Specifically built to mitigate the "digital divide" by empowering speakers of underrepresented languages.
86
+
87
+ The **Simba** family consists of state-of-the-art models fine-tuned using SimbaBench. These models achieve superior performance by leveraging dataset quality, domain diversity, and language family relationships.
88
+
89
+ ### πŸ—£οΈβœοΈ Simba-ASR
90
+ > **The New Standard for African Speech-to-Text**
91
+
92
+ **🎯 Task** `Automatic Speech Recognition` β€” Powering high-accuracy transcription across the continent.
93
+
94
+ **🌍 Language Coverage (43 African languages)**
95
+ > **Amharic** (`amh`), **Arabic** (`ara`), **Asante Twi** (`asanti`), **Bambara** (`bam`), **BaoulΓ©** (`bau`), **Bemba** (`bem`), **Ewe** (`ewe`), **Fanti** (`fat`), **Fon** (`fon`), **French** (`fra`), **Ganda** (`lug`), **Hausa** (`hau`), **Igbo** (`ibo`), **Kabiye** (`kab`), **Kinyarwanda** (`kin`), **Kongo** (`kon`), **Lingala** (`lin`), **Luba-Katanga** (`lub`), **Luo** (`luo`), **Malagasy** (`mlg`), **Mossi** (`mos`), **Northern Sotho** (`nso`), **Nyanja** (`nya`), **Oromo** (`orm`), **Portuguese** (`por`), **Shona** (`sna`), **Somali** (`som`), **Southern Sotho** (`sot`), **Swahili** (`swa`), **Swati** (`ssw`), **Tigrinya** (`tir`), **Tsonga** (`tso`), **Tswana** (`tsn`), **Twi** (`twi`), **Umbundu** (`umb`), **Venda** (`ven`), **Wolof** (`wol`), **Xhosa** (`xho`), **Yoruba** (`yor`), **Zulu** (`zul`), **Tamazight** (`tzm`), **Sango** (`sag`), **Dinka** (`din`).
96
+
97
+ **πŸ—οΈ Base Architectures**
98
+
99
+ - **Simba-S** (SeamlessM4T-v2-MT) β€” *Top Performer*
100
+ - **Simba-W** (Whisper-v3-large)
101
+ - **Simba-X** (Wav2Vec2-XLS-R-2b)
102
+ - **Simba-M** (MMS-1b-all)
103
+ - **Simba-H** (AfriHuBERT)
104
+
105
+ | **ASR Models** | **Architecture** | **πŸ€— Hugging Face Model Card** | **Status** |
106
+ |---------|:------------------:| :------------------:| :------------------:|
107
+ | πŸ”₯**Simba-S**πŸ”₯| SeamlessM4T-v2 | πŸ€— [https://huggingface.co/UBC-NLP/Simba-S](https://huggingface.co/UBC-NLP/Simba-S) | βœ… Released |
108
+ | πŸ”₯**Simba-W**πŸ”₯| Whisper | πŸ€— [https://huggingface.co/UBC-NLP/Simba-W](https://huggingface.co/UBC-NLP/Simba-W) | βœ… Released |
109
+ | πŸ”₯**Simba-X**πŸ”₯| Wav2Vec2 | πŸ€— [https://huggingface.co/UBC-NLP/Simba-X](https://huggingface.co/UBC-NLP/Simba-X) | βœ… Released |
110
+ | πŸ”₯**Simba-M**πŸ”₯| MMS | πŸ€— [https://huggingface.co/UBC-NLP/Simba-M](https://huggingface.co/UBC-NLP/Simba-M) | βœ… Released |
111
+ | πŸ”₯**Simba-H**πŸ”₯| HuBERT | πŸ€— [https://huggingface.co/UBC-NLP/Simba-H](https://huggingface.co/UBC-NLP/Simba-H) | βœ… Released |
112
+
113
+ * **Simba-S** (based on SeamlessM4T-v2-MT) emerged as the best-performing ASR model overall.
114
+
115
+ **🧩 Usage Example**
116
+
117
+ You can easily run inference using the Hugging Face `transformers` library.
118
+
119
+ ```python
120
+ from transformers import pipeline
121
+
122
+ # Load Simba-S for ASR
123
+ asr_pipeline = pipeline(
124
+ "automatic-speech-recognition",
125
+ model="UBC-NLP/Simba-S" #Simba mdoels `UBC-NLP/Simba-S`, `UBC-NLP/Simba-W`, `UBC-NLP/Simba-X`, `UBC-NLP/Simba-H`, `UBC-NLP/Simba-M`
126
+ )
127
+
128
+ asr_pipeline.model.load_adapter("multilingual_african") # Only for `UBC-NLP/Simba-M`
129
+
130
+ # Transcribe audio from file
131
+ result = asr_pipeline("https://africa.dlnlp.ai/simba/audio/afr_Lwazi_afr_test_idx3889.wav")
132
+ print(result["text"])
133
+
134
+
135
+ # Transcribe audio from audio array
136
+ result = asr_pipeline({
137
+ "array": audio_array,
138
+ "sampling_rate": 16_000
139
+ })
140
+ print(result["text"])
141
+
142
+ ```
143
+ Get started with Simba models in minutes using our interactive Colab notebook: [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://github.com/UBC-NLP/simba/edit/main/simba_models.ipynb)
144
+
145
+
146
+ ## Citation
147
+
148
+ If you use the Simba models or SimbaBench benchmark for your scientific publication, or if you find the resources in this website useful, please cite our paper.
149
+
150
+ ```bibtex
151
+
152
+ @inproceedings{elmadany-etal-2025-voice,
153
+ title = "Voice of a Continent: Mapping {A}frica{'}s Speech Technology Frontier",
154
+ author = "Elmadany, AbdelRahim A. and
155
+ Kwon, Sang Yun and
156
+ Toyin, Hawau Olamide and
157
+ Alcoba Inciarte, Alcides and
158
+ Aldarmaki, Hanan and
159
+ Abdul-Mageed, Muhammad",
160
+ editor = "Christodoulopoulos, Christos and
161
+ Chakraborty, Tanmoy and
162
+ Rose, Carolyn and
163
+ Peng, Violet",
164
+ booktitle = "Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing",
165
+ month = nov,
166
+ year = "2025",
167
+ address = "Suzhou, China",
168
+ publisher = "Association for Computational Linguistics",
169
+ url = "https://aclanthology.org/2025.emnlp-main.559/",
170
+ doi = "10.18653/v1/2025.emnlp-main.559",
171
+ pages = "11039--11061",
172
+ ISBN = "979-8-89176-332-6",
173
+ }
174
+
175
+ ```
176
+
177
  <div align="center">
178
 
179
  <img src="https://africa.dlnlp.ai/simba/images/VoC_simba" alt="VoC Simba Models Logo">