bupalinyu commited on
Commit
3a856e3
·
verified ·
1 Parent(s): 623b352

Upload README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -3
README.md CHANGED
@@ -43,7 +43,7 @@ repository: https://github.com/AutoArk/open-audio-opd
43
 
44
  </div>
45
 
46
- > **TL;DR** ARK-ASR-0.6B is a 0.6B-parameter automatic speech recognition model trained with teacher-data adaptation and on-policy distillation. The accompanying training, inference, and evaluation code is available at [AutoArk/open-audio-opd](https://github.com/AutoArk/open-audio-opd).
47
 
48
  ## Abstract
49
 
@@ -65,7 +65,7 @@ Chinese, English, German, Japanese, French, Korean, Spanish, Polish, Italian, Ro
65
  <p><strong>Figure 1: ARK-ASR architecture.</strong> Audio is encoded by a Whisper-style encoder with RoPE, merged through an MLP adapter, and injected into a Qwen2 decoder by replacing audio placeholder token embeddings before transcript generation.</p>
66
  </div>
67
 
68
- - **Model size:** 0.6B parameters
69
  - **Task:** automatic speech recognition
70
  - **Architecture:** audio-capable autoregressive Transformers model with custom `arkasr` remote code
71
  - **Checkpoint format:** `safetensors`
@@ -94,7 +94,7 @@ The following results are from the `open-audio-opd` evaluation. Lower CER/WER is
94
  | Qwen3-ASR-0.6B | 2.07% | 5.57% | 5.45% | 4.36% |
95
  | Qwen3-ASR-1.7B | 1.50% | 4.69% | 4.55% | 3.58% |
96
 
97
- `Ark-ASR` is the 0.6B ASR checkpoint trained with teacher-data adaptation and on-policy distillation from `open-audio-opd`.
98
 
99
  ## Inference
100
 
 
43
 
44
  </div>
45
 
46
+ > **TL;DR** ARK-ASR-0.6B is an automatic speech recognition model trained with teacher-data adaptation and on-policy distillation, using a compact 0.6B-scale decoder LLM together with a dedicated audio encoder and adapter. The accompanying training, inference, and evaluation code is available at [AutoArk/open-audio-opd](https://github.com/AutoArk/open-audio-opd).
47
 
48
  ## Abstract
49
 
 
65
  <p><strong>Figure 1: ARK-ASR architecture.</strong> Audio is encoded by a Whisper-style encoder with RoPE, merged through an MLP adapter, and injected into a Qwen2 decoder by replacing audio placeholder token embeddings before transcript generation.</p>
66
  </div>
67
 
68
+ - **Model size:** 0.6B decoder LLM parameters, with a separate 0.6B-scale Whisper-style audio encoder and MLP adapter
69
  - **Task:** automatic speech recognition
70
  - **Architecture:** audio-capable autoregressive Transformers model with custom `arkasr` remote code
71
  - **Checkpoint format:** `safetensors`
 
94
  | Qwen3-ASR-0.6B | 2.07% | 5.57% | 5.45% | 4.36% |
95
  | Qwen3-ASR-1.7B | 1.50% | 4.69% | 4.55% | 3.58% |
96
 
97
+ `Ark-ASR` is the 0.6B-scale ASR checkpoint trained with teacher-data adaptation and on-policy distillation from `open-audio-opd`.
98
 
99
  ## Inference
100