AbelWa commited on
Commit
8406653
·
verified ·
1 Parent(s): 9f6fb99

Upload folder using huggingface_hub

Browse files
.gitattributes CHANGED
@@ -33,3 +33,8 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ tokenizer.json filter=lfs diff=lfs merge=lfs -text
37
+ Audar-ASR-V1-Turbo-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
38
+ Audar-ASR-V1-Turbo-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
39
+ Audar-ASR-V1-Turbo.gguf filter=lfs diff=lfs merge=lfs -text
40
+ mmproj-Audar-ASR-V1-Turbo.gguf filter=lfs diff=lfs merge=lfs -text
Audar-ASR-V1-Turbo-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c55e3c28225ef6e9b56906a6463af62d34ed417803c45f3b7b20f463af2e8cf4
3
+ size 1282434912
Audar-ASR-V1-Turbo-Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0a91ab40f6a30db06c4186e2f621f504f4625ba6058e639cc09f1cbefded10d2
3
+ size 2165034848
Audar-ASR-V1-Turbo.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:35ccb4204f3d1abbe6b2511ff9449a2268f175e5bc0b176b0f065915db5ea793
3
+ size 4069674848
README.md ADDED
@@ -0,0 +1,240 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: other
3
+ license_name: audarai-community-license-v1.0
4
+ license_link: https://www.audarai.com/license/audarai-community-license-v1.0/
5
+ language:
6
+ - ar
7
+ - en
8
+ pipeline_tag: automatic-speech-recognition
9
+ inference: false
10
+ tags:
11
+ - automatic-speech-recognition
12
+ - asr
13
+ - speech-recognition
14
+ - arabic
15
+ - arabic-asr
16
+ - dialectal-arabic
17
+ - emirati
18
+ - gulf-arabic
19
+ - streaming
20
+ - realtime
21
+ - gguf
22
+ - llama-cpp
23
+ - audar
24
+ ---
25
+
26
+ <div align="center">
27
+
28
+ # Audar-ASR-V1-Turbo · GGUF
29
+
30
+ ### Audar's proprietary Arabic speech-recognition model — leaderboard-grade, dialect-aware.
31
+
32
+ **From Arabic to the world.**
33
+
34
+ ![License](https://img.shields.io/badge/license-AudarAI%20Community%20v1.0-6f42c1)
35
+ ![Task](https://img.shields.io/badge/task-ASR-blue)
36
+ ![Format](https://img.shields.io/badge/format-GGUF-blue)
37
+ ![Params](https://img.shields.io/badge/params-2.35B%20total-f59e0b)
38
+ ![Open-AR-ASR](https://img.shields.io/badge/Open--AR--ASR%20avg-24.7%25%20WER%20(full--test)-brightgreen)
39
+ ![CommonVoice](https://img.shields.io/badge/CommonVoice--ar-3.55%25%20WER-brightgreen)
40
+ ![Emirati](https://img.shields.io/badge/Emirati-19.4%25%20WER%20%2F%207.3%25%20CER-brightgreen)
41
+
42
+ <p><a href="#-what-it-is"><b>🧭 Overview</b></a> · <a href="#-benchmarks"><b>📊 Benchmarks</b></a> · <a href="#-gguf-inference-llamacpp"><b>💻 GGUF Deploy</b></a> · <a href="#-real-time-streaming"><b>🎙️ Streaming</b></a> · <a href="https://www.audarai.com"><b>☁️ Audar API</b></a> · <a href="https://www.audarai.com/license/audarai-community-license-v1.0/"><b>📜 License</b></a></p>
43
+
44
+ </div>
45
+
46
+ ---
47
+
48
+ ## 🧭 What it is
49
+
50
+ **Audar-ASR-V1-Turbo** is **Audar's proprietary Arabic speech-recognition model** — the accuracy tier of
51
+ the Audar-ASR family. It recasts transcription as **audio-conditioned next-token prediction** over a
52
+ unified text vocabulary (a language-model decoder rather than a CTC or transducer objective), and is
53
+ developed **in-house** through a proprietary Arabic training program:
54
+
55
+ - 🧱 **Large-scale dialectal pretraining** — 300,000+ hours of Arabic audio spanning MSA, Gulf,
56
+ Egyptian, Levantine and Maghrebi speech, code-switching, and diverse acoustic channels.
57
+ - 🎯 **Dialect-targeted fine-tuning** — hardness sampling and multi-task conditioning focused on proper
58
+ nouns, code-switching, and dialect-faithful orthography.
59
+ - 🧠 **GRPO reinforcement-learning alignment** — preference optimization against Arabic-native failure
60
+ modes (diacritization, code-switching, named-entity preservation, formatting) with trained native
61
+ annotators.
62
+
63
+ The result is **state-of-the-art dialectal Arabic ASR** — the lowest average WER of any evaluated
64
+ system on the *Open Universal Arabic ASR Leaderboard*. It transcribes MSA and every major Arabic
65
+ dialect, code-switched Arabic–English, and English, across **30 languages** in total. For real-time,
66
+ edge, or high-throughput deployment, see the smaller
67
+ [**Audar-ASR-V1-Flash**](https://huggingface.co/audarai/Audar-ASR-V1-Flash).
68
+
69
+ > Distributed in the widely-supported **Qwen3-ASR architecture format** for turnkey tooling
70
+ > (llama.cpp / GGUF). The **model** — data, training curriculum, and alignment — is Audar's.
71
+
72
+ ## Model summary
73
+
74
+ <table>
75
+ <tbody>
76
+ <tr><td width="200"><b>Model</b></td><td>Audar-ASR-V1-Turbo — proprietary Arabic ASR (accuracy tier)</td></tr>
77
+ <tr><td><b>Task</b></td><td>Automatic speech recognition (audio → text)</td></tr>
78
+ <tr><td><b>Approach</b></td><td>Generative ASR — audio encoder + language-model decoder (audio-conditioned next-token prediction)</td></tr>
79
+ <tr><td><b>Training</b></td><td>300k+ hrs dialectal pretraining → dialect-targeted SFT → GRPO alignment</td></tr>
80
+ <tr><td><b>Decoder parameters</b></td><td>2,031,739,904 (2.03B)</td></tr>
81
+ <tr><td><b>Audio encoder parameters</b></td><td>317,477,504 (0.32B)</td></tr>
82
+ <tr><td><b>Total parameters</b></td><td>2,349,217,408 (2.35B, bf16)</td></tr>
83
+ <tr><td><b>Audio input</b></td><td>16 kHz mono; 30 s context (longer audio is chunked/streamed)</td></tr>
84
+ <tr><td><b>Languages</b></td><td>Arabic (MSA + Gulf/Egyptian/Levantine/Maghrebi dialects) + English + 28 more</td></tr>
85
+ <tr><td><b>Runtime</b></td><td>GGUF / llama.cpp — CPU · GPU · edge</td></tr>
86
+ <tr><td><b>License</b></td><td>AudarAI Community License v1.0</td></tr>
87
+ </tbody>
88
+ </table>
89
+
90
+ ## 📊 Benchmarks
91
+
92
+ Arabic dialectal ASR is **hard** — heavily dialectal, conversational, code-switched speech is the
93
+ frontier for every system. On the *Open Universal Arabic ASR Leaderboard*, Audar-ASR-V1-Turbo posts the
94
+ **lowest average WER of any evaluated system on the full test sets — 24.7 %, best on four of the six** —
95
+ and **3.55 % WER on CommonVoice-18 Arabic**. The per-dataset development-protocol results (100
96
+ utterances/benchmark) are below.
97
+
98
+ ### Open Universal Arabic ASR Leaderboard — WER % (lower is better)
99
+
100
+ *Per-dataset WER (%), development protocol (100 utterances/benchmark); baselines are the leaderboard's
101
+ published full-test scores. Best per column in **bold**. Authoritative full-test-set average: 24.7 %.*
102
+
103
+ | System | CommonVoice-18 | MASC-clean | MASC-noisy | MGB-2 | SADA | Casablanca | **Avg** |
104
+ |---|---|---|---|---|---|---|---|
105
+ | **Audar-ASR-V1-Turbo** | **3.55** | **9.13** | **16.84** | **14.01** | **35.22** | **62.87** | **23.60** |
106
+ | ElevenLabs Scribe v1 | 5.74 | 9.87 | 19.78 | 15.15 | 40.87 | 66.93 | 26.39 |
107
+ | Qwen3-ASR-1.7B (base) | 10.86 | 15.07 | 21.12 | 29.21 | 50.54 | 85.25 | 35.34 |
108
+ | Whisper-Large-v3 | 17.83 | 24.66 | 34.63 | 16.26 | 55.96 | 71.81 | 36.86 |
109
+
110
+ ### Emirati Arabic
111
+
112
+ | Set | WER % | CER % |
113
+ |---|---|---|
114
+ | **Emirati** (Mixat, full 1,585-clip test) | **19.4** | **7.3** |
115
+
116
+ On Emirati, the **real recognition error is ≈ 7.3 %** — near-parity with spontaneous English — while the
117
+ residual up to 19.4 % WER is largely **orthographic convention** (near-miss spelling of the *same*
118
+ word, e.g. انتو↔انتوا, and Latin-vs-Arabic rendering of English loanwords), not misrecognition.
119
+
120
+ ### Measured on an internal dialectal validation sample
121
+
122
+ *Same sample and harness as the [Flash card](https://huggingface.co/audarai/Audar-ASR-V1-Flash#-benchmarks)
123
+ — useful for a direct Flash-vs-Turbo comparison (WER/CER %, N clips per set).*
124
+
125
+ | Set (dialect) | N | WER % | CER % |
126
+ |---|---|---|---|
127
+ | SawtArabi (Gulf) | 23 | 13.7 | 2.7 |
128
+ | ArzEn (Egyptian ⇄ English code-switch) | 40 | 19.9 | 9.2 |
129
+ | MGB-3 (Egyptian broadcast) | 40 | 27.3 | 10.5 |
130
+ | Casablanca (Maghrebi / Moroccan Darija) | 40 | 61.9 | 28.6 |
131
+
132
+ Casablanca 61.9 WER ≈ the official leaderboard's 62.87 (reproduced in-house) — the numbers line up.
133
+
134
+ ## 💻 GGUF inference (llama.cpp)
135
+
136
+ Turbo runs on **llama.cpp** via the multimodal (`mtmd`) path — a quantized **decoder** GGUF plus a
137
+ **BF16 audio projector** (`mmproj`). Build a recent llama.cpp (with Qwen3-ASR support), then:
138
+
139
+ ```bash
140
+ ./llama-mtmd-cli \
141
+ -m Audar-ASR-V1-Turbo-Q8_0.gguf \
142
+ --mmproj mmproj-Audar-ASR-V1-Turbo.gguf \
143
+ --audio clip.wav \
144
+ -sys "فرّغ الكلام العربي التالي." \
145
+ --temp 0
146
+ ```
147
+
148
+ > ⚠️ The **audio projector (`mmproj`) must stay BF16** (its `ClippableLinear` is numerically
149
+ > sensitive). The **decoder** quantizes normally.
150
+
151
+ Prefer a managed endpoint? The Audar-ASR family is also available via the
152
+ [**Audar API/SDK**](https://www.audarai.com) — streaming, speaker-attributed transcription, and
153
+ diarization, production-hosted.
154
+
155
+ ### GGUF variants
156
+
157
+ | File | Approx. size | Notes |
158
+ |---|---|---|
159
+ | `Audar-ASR-V1-Turbo-Q4_K_M.gguf` | ~1.28 GB | Smallest; constrained hardware |
160
+ | `Audar-ASR-V1-Turbo-Q8_0.gguf` | ~2.16 GB | Near-lossless (recommended) |
161
+ | `Audar-ASR-V1-Turbo.gguf` (BF16) | ~4.07 GB | Full precision decoder |
162
+ | `mmproj-Audar-ASR-V1-Turbo.gguf` | ~0.64 GB | **BF16 audio encoder — required, keep BF16** |
163
+
164
+ ## 🎙️ Real-time streaming
165
+
166
+ Audar-ASR streams via **LocalAgreement-2**: as audio arrives the trailing window is re-decoded each hop
167
+ and a word is **committed** only once two consecutive decodes agree on it — giving stable, low-latency
168
+ incremental output over the GGUF runtime. Audar's production realtime engine serves the same policy over
169
+ an OpenAI-Realtime-compatible WebSocket with model-based endpointing and ≥64 concurrent streams on a
170
+ single A100-80GB.
171
+
172
+ ## 🌍 Languages, dialects & tasks
173
+
174
+ - **Primary**: Arabic — MSA and dialectal (Gulf/Emirati, Egyptian, Levantine, Maghrebi), plus
175
+ **code-switched Arabic–English**; emits dialect-faithful orthography from audio alone.
176
+ - **Also**: English + 28 additional languages.
177
+ - **Task**: transcription (audio → UTF-8 text), prompt-steerable for language and formatting.
178
+
179
+ ## Intended use & limitations
180
+
181
+ **Intended use.** Broadcast/media transcription, meeting & contact-center intelligence, voice agents,
182
+ captioning, and accessibility — cloud or on-prem.
183
+
184
+ **Limitations.**
185
+ - **Maghrebi / Moroccan Darija (Casablanca)** remains the hardest condition (~63 % WER) for all systems.
186
+ - Heavily code-switched telephony and low-SNR audio degrade accuracy relative to clean MSA.
187
+ - Long-form audio can drift on very long recordings.
188
+ - Not evaluated for, and must **not** be used for, covert speaker identification.
189
+
190
+ ## 📜 License
191
+
192
+ Released under the **AudarAI Community License v1.0** — research and limited commercial use for
193
+ qualifying Community Entities; enterprise / large-scale / MaaS use requires an AudarAI Enterprise
194
+ License. See
195
+ [audarai.com/license/audarai-community-license-v1.0](https://www.audarai.com/license/audarai-community-license-v1.0/).
196
+
197
+ ## Citation
198
+
199
+ ```bibtex
200
+ @misc{audar-asr-turbo-2026,
201
+ title = {Audar-ASR: Dialect-Aware Arabic Speech Recognition},
202
+ author = {AudarAI},
203
+ year = {2026},
204
+ note = {Audar-ASR-V1-Turbo},
205
+ url = {https://huggingface.co/audarai/Audar-ASR-V1-Turbo}
206
+ }
207
+ ```
208
+
209
+ ---
210
+
211
+ ## About AudarAI
212
+
213
+ <div align="center">
214
+
215
+ ### Leading Arabic-First Multilingual Audio Intelligence
216
+
217
+ *AudarAI starts with Arabic — and expands to the world.*
218
+
219
+ </div>
220
+
221
+ We are building advanced multilingual audio intelligence that helps individuals, enterprises, and
222
+ governments communicate across languages, cultures, and borders. By combining Arabic-first speech
223
+ technology with global multilingual AI, AudarAI transforms voice into understanding, interaction,
224
+ and connection.
225
+
226
+ Our work spans speech recognition, speech understanding, voice-enabled digital assistants,
227
+ human-computer interaction, and intelligent audio systems designed for real-world impact. From
228
+ empowering people to access technology in their native language to helping organizations
229
+ communicate globally, AudarAI is shaping a future where every voice can be heard, understood, and
230
+ connected.
231
+
232
+ **Arabic-first. Multilingual by design. Human-centered at heart.**
233
+
234
+ <div align="center">
235
+
236
+ **[🌐 www.audarai.com](https://www.audarai.com)** · [🤗 Hugging Face](https://huggingface.co/audarai) · [GitHub](https://github.com/AudarAI) · contact@audarai.com
237
+
238
+ © 2026 AUDARAI PTE. LTD. · Licensed under the AudarAI Community License v1.0
239
+
240
+ </div>
mmproj-Audar-ASR-V1-Turbo.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:190459e806938175711779847eb62ea609cd78b8d2ec06fb96a94d69ab37a9be
3
+ size 641773856