Dragonhead commited on
Commit
ea262c4
·
verified ·
1 Parent(s): cabc19d

Card: align framing to the technical report (open-weight foundation, adaptation-not-proprietary), add report link

Browse files
Files changed (2) hide show
  1. README.md +11 -11
  2. vllm-w4a16/configuration_audar_asr.py +6 -6
README.md CHANGED
@@ -27,7 +27,7 @@ tags:
27
 
28
  # Audar-ASR-V1-Turbo · GGUF
29
 
30
- ### Audar's proprietary Arabic speech-recognition model — leaderboard-grade, dialect-aware.
31
 
32
  **From Arabic to the world.**
33
 
@@ -40,7 +40,7 @@ tags:
40
  ![Emirati](https://img.shields.io/badge/Emirati-19.4%25%20WER%20%2F%207.3%25%20CER-brightgreen)
41
  [![GitHub](https://img.shields.io/badge/GitHub-Audar--ASR--V1-181717?logo=github)](https://github.com/AudarAI/Audar-ASR-V1)
42
 
43
- <p><a href="#-what-it-is"><b>🧭 Overview</b></a> · <a href="#-benchmarks"><b>📊 Benchmarks</b></a> · <a href="#-gguf-inference-llamacpp"><b>💻 GGUF Deploy</b></a> · <a href="#-real-time-streaming"><b>🎙️ Streaming</b></a> · <a href="#-vllm-inference-gpu-serving"><b>⚡ vLLM</b></a> · <a href="https://github.com/AudarAI/Audar-ASR-V1"><b>🐙 GitHub</b></a> · <a href="https://www.audarai.com"><b>☁️ Audar API</b></a> · <a href="https://www.audarai.com/license/audarai-community-license-v1.0/"><b>📜 License</b></a></p>
44
 
45
  </div>
46
 
@@ -48,12 +48,12 @@ tags:
48
 
49
  ## 🧭 What it is
50
 
51
- **Audar-ASR-V1-Turbo** is **Audar's proprietary Arabic speech-recognition model** — the accuracy tier of
52
  the Audar-ASR family. It recasts transcription as **audio-conditioned next-token prediction** over a
53
  unified text vocabulary (a language-model decoder rather than a CTC or transducer objective), and is
54
- developed **in-house** through a proprietary Arabic training program:
55
 
56
- - 🧱 **Large-scale dialectal pretraining** — 300,000+ hours of Arabic audio spanning MSA, Gulf,
57
  Egyptian, Levantine and Maghrebi speech, code-switching, and diverse acoustic channels.
58
  - 🎯 **Dialect-targeted fine-tuning** — hardness sampling and multi-task conditioning focused on proper
59
  nouns, code-switching, and dialect-faithful orthography.
@@ -66,17 +66,17 @@ The result is **state-of-the-art dialectal Arabic ASR** — the lowest average W
66
  evaluated system on the *Open Universal Arabic ASR Leaderboard*. It transcribes MSA and every major
67
  Arabic dialect, code-switched Arabic–English, and English, across **30 languages** in total.
68
 
69
- > Distributed in the widely-supported **Qwen3-ASR architecture format** for turnkey tooling
70
- > (llama.cpp / GGUF). The **model** — data, training curriculum, and alignment is Audar's.
71
 
72
  ## Model summary
73
 
74
  <table>
75
  <tbody>
76
- <tr><td width="200"><b>Model</b></td><td>Audar-ASR-V1-Turbo — proprietary Arabic ASR (accuracy tier)</td></tr>
77
  <tr><td><b>Task</b></td><td>Automatic speech recognition (audio → text)</td></tr>
78
  <tr><td><b>Approach</b></td><td>Generative ASR — audio encoder + language-model decoder (audio-conditioned next-token prediction)</td></tr>
79
- <tr><td><b>Training</b></td><td>300k+ hrs dialectal pretraining → dialect-targeted SFTKTO preference alignment</td></tr>
80
  <tr><td><b>Decoder parameters</b></td><td>2,031,739,904 (2.03B)</td></tr>
81
  <tr><td><b>Audio encoder parameters</b></td><td>317,477,504 (0.32B)</td></tr>
82
  <tr><td><b>Total parameters</b></td><td>2,349,217,408 (2.35B, bf16)</td></tr>
@@ -325,11 +325,11 @@ License. See
325
 
326
  ```bibtex
327
  @misc{audar-asr-turbo-2026,
328
- title = {Audar-ASR: Dialect-Aware Arabic Speech Recognition},
329
  author = {AudarAI},
330
  year = {2026},
331
  note = {Audar-ASR-V1-Turbo},
332
- url = {https://huggingface.co/audarai/Audar-ASR-V1-Turbo}
333
  }
334
  ```
335
 
 
27
 
28
  # Audar-ASR-V1-Turbo · GGUF
29
 
30
+ ### Audar's Arabic-first speech-recognition model — leaderboard-grade, dialect-aware.
31
 
32
  **From Arabic to the world.**
33
 
 
40
  ![Emirati](https://img.shields.io/badge/Emirati-19.4%25%20WER%20%2F%207.3%25%20CER-brightgreen)
41
  [![GitHub](https://img.shields.io/badge/GitHub-Audar--ASR--V1-181717?logo=github)](https://github.com/AudarAI/Audar-ASR-V1)
42
 
43
+ <p><a href="#-what-it-is"><b>🧭 Overview</b></a> · <a href="#-benchmarks"><b>📊 Benchmarks</b></a> · <a href="#-gguf-inference-llamacpp"><b>💻 GGUF Deploy</b></a> · <a href="#-real-time-streaming"><b>🎙️ Streaming</b></a> · <a href="#-vllm-inference-gpu-serving"><b>⚡ vLLM</b></a> · <a href="https://github.com/AudarAI/Audar-ASR-V1/blob/main/report/Audar-ASR-V1-Technical-Report.pdf"><b>📄 Tech Report</b></a> · <a href="https://github.com/AudarAI/Audar-ASR-V1"><b>🐙 GitHub</b></a> · <a href="https://www.audarai.com"><b>☁️ Audar API</b></a> · <a href="https://www.audarai.com/license/audarai-community-license-v1.0/"><b>📜 License</b></a></p>
44
 
45
  </div>
46
 
 
48
 
49
  ## 🧭 What it is
50
 
51
+ **Audar-ASR-V1-Turbo** is an **Arabic-first generative speech-recognition model** — the accuracy tier of
52
  the Audar-ASR family. It recasts transcription as **audio-conditioned next-token prediction** over a
53
  unified text vocabulary (a language-model decoder rather than a CTC or transducer objective), and is
54
+ built on a permissively-licensed open-weight audio-LLM foundation and adapted in-house the contribution is the adaptation (the data curriculum and the alignment rubric), not the foundation:
55
 
56
+ - 🧱 **Large-scale bilingual pretraining** — 300,000+ hours of labeled audio, primarily Arabic and English, spanning MSA, Gulf,
57
  Egyptian, Levantine and Maghrebi speech, code-switching, and diverse acoustic channels.
58
  - 🎯 **Dialect-targeted fine-tuning** — hardness sampling and multi-task conditioning focused on proper
59
  nouns, code-switching, and dialect-faithful orthography.
 
66
  evaluated system on the *Open Universal Arabic ASR Leaderboard*. It transcribes MSA and every major
67
  Arabic dialect, code-switched Arabic–English, and English, across **30 languages** in total.
68
 
69
+ > Built on a **permissively-licensed open-weight audio-LLM foundation**; the adaptation, data, and
70
+ > alignment are Audar's. Full method and results: [Audar-ASR-V1 Technical Report](https://github.com/AudarAI/Audar-ASR-V1/blob/main/report/Audar-ASR-V1-Technical-Report.pdf).
71
 
72
  ## Model summary
73
 
74
  <table>
75
  <tbody>
76
+ <tr><td width="200"><b>Model</b></td><td>Audar-ASR-V1-Turbo — Arabic-first generative ASR (accuracy tier)</td></tr>
77
  <tr><td><b>Task</b></td><td>Automatic speech recognition (audio → text)</td></tr>
78
  <tr><td><b>Approach</b></td><td>Generative ASR — audio encoder + language-model decoder (audio-conditioned next-token prediction)</td></tr>
79
+ <tr><td><b>Training</b></td><td>built on an open-weight audio-LLM foundation; adapted via a 4-stage curriculum — 300k+ hrs bilingual pretraining → multi-task fine-tuningdialect PEFT → KTO alignment</td></tr>
80
  <tr><td><b>Decoder parameters</b></td><td>2,031,739,904 (2.03B)</td></tr>
81
  <tr><td><b>Audio encoder parameters</b></td><td>317,477,504 (0.32B)</td></tr>
82
  <tr><td><b>Total parameters</b></td><td>2,349,217,408 (2.35B, bf16)</td></tr>
 
325
 
326
  ```bibtex
327
  @misc{audar-asr-turbo-2026,
328
+ title = {Audar-ASR-V1: A Multilingual, Arabic-First Generative Speech Recognition Foundation Model},
329
  author = {AudarAI},
330
  year = {2026},
331
  note = {Audar-ASR-V1-Turbo},
332
+ url = {https://github.com/AudarAI/Audar-ASR-V1/blob/main/report/Audar-ASR-V1-Technical-Report.pdf}
333
  }
334
  ```
335
 
vllm-w4a16/configuration_audar_asr.py CHANGED
@@ -23,10 +23,10 @@ class Qwen3ASRAudioEncoderConfig(PretrainedConfig):
23
  r"""
24
  This is the configuration class to store the configuration of a [`Qwen3ASRAudioEncoder`]. It is used to instantiate a
25
  Qwen3-ASR audio encoder according to the specified arguments, defining the model architecture. Instantiating a
26
- configuration with the defaults will yield a similar configuration to that of the audio encoder of the Qwen2-Audio
27
  architecture.
28
 
29
- e.g. [Qwen/Qwen3-ASR-1.7B](https://huggingface.co/Qwen/Qwen3-ASR-1.7B)
30
 
31
  Configuration objects inherit from [`PretrainedConfig`] and can be used to control the model outputs. Read the
32
  documentation from [`PretrainedConfig`] for more information.
@@ -128,7 +128,7 @@ class Qwen3ASRTextConfig(PretrainedConfig):
128
  This is the configuration class to store the configuration of a [`Qwen3ASRTextModel`]. It is used to instantiate a
129
  Qwen3-ASR model according to the specified arguments, defining the model architecture. Instantiating a configuration
130
  with the defaults will yield a similar configuration to that of
131
- Qwen3-ASR-1.7B [Qwen/Qwen3-ASR-1.7B](https://huggingface.co/Qwen/Qwen3-ASR-1.7B)
132
 
133
  Configuration objects inherit from [`PretrainedConfig`] and can be used to control the model outputs. Read the
134
  documentation from [`PretrainedConfig`] for more information.
@@ -281,10 +281,10 @@ class Qwen3ASRThinkerConfig(PretrainedConfig):
281
  r"""
282
  This is the configuration class to store the configuration of a [`Qwen3ASRThinker`]. It is used to instantiate a
283
  Qwen3-ASR-Thinker model according to the specified arguments, defining the model architecture. Instantiating a
284
- configuration with the defaults will yield a similar configuration to that of the thinker component of the Qwen3-Omni
285
  architecture.
286
 
287
- e.g. [Qwen/Qwen3-ASR-1.7B](https://huggingface.co/Qwen/Qwen3-ASR-1.7B)
288
 
289
  Configuration objects inherit from [`PretrainedConfig`] and can be used to control the model outputs. Read the
290
  documentation from [`PretrainedConfig`] for more information.
@@ -361,7 +361,7 @@ class Qwen3ASRConfig(PretrainedConfig):
361
  model according to the specified sub-models configurations, defining the model architecture.
362
 
363
  Instantiating a configuration with the defaults will yield a similar configuration to that of the
364
- [Qwen/Qwen3-ASR-1.7B](https://huggingface.co/Qwen/Qwen3-ASR-1.7B) architecture.
365
 
366
  Configuration objects inherit from [`PretrainedConfig`] and can be used to control the model outputs. Read the
367
  documentation from [`PretrainedConfig`] for more information.
 
23
  r"""
24
  This is the configuration class to store the configuration of a [`Qwen3ASRAudioEncoder`]. It is used to instantiate a
25
  Qwen3-ASR audio encoder according to the specified arguments, defining the model architecture. Instantiating a
26
+ configuration with the defaults will yield a similar configuration to that of the audio encoder of Audar-ASR-V1-Turbo
27
  architecture.
28
 
29
+ e.g. Audar-ASR-V1-Turbo
30
 
31
  Configuration objects inherit from [`PretrainedConfig`] and can be used to control the model outputs. Read the
32
  documentation from [`PretrainedConfig`] for more information.
 
128
  This is the configuration class to store the configuration of a [`Qwen3ASRTextModel`]. It is used to instantiate a
129
  Qwen3-ASR model according to the specified arguments, defining the model architecture. Instantiating a configuration
130
  with the defaults will yield a similar configuration to that of
131
+ Audar-ASR-V1-Turbo
132
 
133
  Configuration objects inherit from [`PretrainedConfig`] and can be used to control the model outputs. Read the
134
  documentation from [`PretrainedConfig`] for more information.
 
281
  r"""
282
  This is the configuration class to store the configuration of a [`Qwen3ASRThinker`]. It is used to instantiate a
283
  Qwen3-ASR-Thinker model according to the specified arguments, defining the model architecture. Instantiating a
284
+ configuration with the defaults will yield a similar configuration to that of the decoder component of Audar-ASR-V1-Turbo
285
  architecture.
286
 
287
+ e.g. Audar-ASR-V1-Turbo
288
 
289
  Configuration objects inherit from [`PretrainedConfig`] and can be used to control the model outputs. Read the
290
  documentation from [`PretrainedConfig`] for more information.
 
361
  model according to the specified sub-models configurations, defining the model architecture.
362
 
363
  Instantiating a configuration with the defaults will yield a similar configuration to that of the
364
+ Audar-ASR-V1-Turbo architecture.
365
 
366
  Configuration objects inherit from [`PretrainedConfig`] and can be used to control the model outputs. Read the
367
  documentation from [`PretrainedConfig`] for more information.