Automatic Speech Recognition
Transformers
Safetensors
PyTorch
arkasr
text-generation
speech
audio
ark-asr
custom_code
Eval Results
Instructions to use Audio8/ARK-ASR-0.6B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Audio8/ARK-ASR-0.6B with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("automatic-speech-recognition", model="Audio8/ARK-ASR-0.6B", trust_remote_code=True)# Load model directly from transformers import AutoModelForCausalLM model = AutoModelForCausalLM.from_pretrained("Audio8/ARK-ASR-0.6B", trust_remote_code=True, device_map="auto") - Notebooks
- Google Colab
- Kaggle
Upload README.md
Browse files
README.md
CHANGED
|
@@ -43,7 +43,7 @@ repository: https://github.com/AutoArk/open-audio-opd
|
|
| 43 |
|
| 44 |
</div>
|
| 45 |
|
| 46 |
-
> **TL;DR** ARK-ASR-0.6B is
|
| 47 |
|
| 48 |
## Abstract
|
| 49 |
|
|
@@ -65,7 +65,7 @@ Chinese, English, German, Japanese, French, Korean, Spanish, Polish, Italian, Ro
|
|
| 65 |
<p><strong>Figure 1: ARK-ASR architecture.</strong> Audio is encoded by a Whisper-style encoder with RoPE, merged through an MLP adapter, and injected into a Qwen2 decoder by replacing audio placeholder token embeddings before transcript generation.</p>
|
| 66 |
</div>
|
| 67 |
|
| 68 |
-
- **Model size:** 0.6B parameters
|
| 69 |
- **Task:** automatic speech recognition
|
| 70 |
- **Architecture:** audio-capable autoregressive Transformers model with custom `arkasr` remote code
|
| 71 |
- **Checkpoint format:** `safetensors`
|
|
@@ -94,7 +94,7 @@ The following results are from the `open-audio-opd` evaluation. Lower CER/WER is
|
|
| 94 |
| Qwen3-ASR-0.6B | 2.07% | 5.57% | 5.45% | 4.36% |
|
| 95 |
| Qwen3-ASR-1.7B | 1.50% | 4.69% | 4.55% | 3.58% |
|
| 96 |
|
| 97 |
-
`Ark-ASR` is the 0.6B ASR checkpoint trained with teacher-data adaptation and on-policy distillation from `open-audio-opd`.
|
| 98 |
|
| 99 |
## Inference
|
| 100 |
|
|
|
|
| 43 |
|
| 44 |
</div>
|
| 45 |
|
| 46 |
+
> **TL;DR** ARK-ASR-0.6B is an automatic speech recognition model trained with teacher-data adaptation and on-policy distillation, using a compact 0.6B-scale decoder LLM together with a dedicated audio encoder and adapter. The accompanying training, inference, and evaluation code is available at [AutoArk/open-audio-opd](https://github.com/AutoArk/open-audio-opd).
|
| 47 |
|
| 48 |
## Abstract
|
| 49 |
|
|
|
|
| 65 |
<p><strong>Figure 1: ARK-ASR architecture.</strong> Audio is encoded by a Whisper-style encoder with RoPE, merged through an MLP adapter, and injected into a Qwen2 decoder by replacing audio placeholder token embeddings before transcript generation.</p>
|
| 66 |
</div>
|
| 67 |
|
| 68 |
+
- **Model size:** 0.6B decoder LLM parameters, with a separate 0.6B-scale Whisper-style audio encoder and MLP adapter
|
| 69 |
- **Task:** automatic speech recognition
|
| 70 |
- **Architecture:** audio-capable autoregressive Transformers model with custom `arkasr` remote code
|
| 71 |
- **Checkpoint format:** `safetensors`
|
|
|
|
| 94 |
| Qwen3-ASR-0.6B | 2.07% | 5.57% | 5.45% | 4.36% |
|
| 95 |
| Qwen3-ASR-1.7B | 1.50% | 4.69% | 4.55% | 3.58% |
|
| 96 |
|
| 97 |
+
`Ark-ASR` is the 0.6B-scale ASR checkpoint trained with teacher-data adaptation and on-policy distillation from `open-audio-opd`.
|
| 98 |
|
| 99 |
## Inference
|
| 100 |
|