Update README.md
Browse files
README.md
CHANGED
|
@@ -42,22 +42,29 @@ Model evaluation metrics and results.
|
|
| 42 |
[LibriSpeech]: https://huggingface.co/datasets/fixie-ai/librispeech_asr
|
| 43 |
[Fleurs]: https://huggingface.co/datasets/google/fleurs
|
| 44 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 45 |
#### ASR
|
| 46 |
|
| 47 |
-
| Benchmark | Task | BLEU ↑ | CER ↓ | WER ↓ |
|
| 48 |
-
| -------------------------------- |----------------|:-------------:|:------------:|:------------:|
|
| 49 |
-
| [Covost2][Covost2] | ASR (English) | **86.09** | **4.12** | **7.83** |
|
| 50 |
-
| [Fleurs][Fleurs] | ASR (English) | **89.61** | **2.28** | **5.23** |
|
| 51 |
-
| [LibriSpeech-Clean][LibriSpeech] | ASR (English) | **94.28** | **0.98** | **2.91** |
|
| 52 |
-
| [LibriSpeech-Other][LibriSpeech] | ASR (English) | **87.60** | **3.10** | **6.55** |
|
| 53 |
|
| 54 |
|
| 55 |
#### AST
|
| 56 |
|
| 57 |
-
| Benchmark | Task | BLEU ↑ |
|
| 58 |
-
| ------------------------------ |-------------------------------|:-------------:|
|
| 59 |
-
| [Covost2][Covost2] | AST (0-shot, English-Korean) | 31.55 |
|
| 60 |
-
| [Fleurs][Fleurs] | AST (0-shot, English-Korean) | 11.05 |
|
| 61 |
|
| 62 |
|
| 63 |
## Model Details
|
|
|
|
| 42 |
[LibriSpeech]: https://huggingface.co/datasets/fixie-ai/librispeech_asr
|
| 43 |
[Fleurs]: https://huggingface.co/datasets/google/fleurs
|
| 44 |
|
| 45 |
+
[Link1]: https://huggingface.co/junnei/gemma-3-4b-it-speech/blob/main/eval_result/asr_en_us_to_ko_kr.json
|
| 46 |
+
[Link2]: https://huggingface.co/junnei/gemma-3-4b-it-speech/blob/main/eval_result/asr_Fleurs_en_us_to_ko_kr.json
|
| 47 |
+
[Link3]: https://huggingface.co/junnei/gemma-3-4b-it-speech/blob/main/eval_result/asr_LibriSpeech_clean_en_us_to_ko_kr.json
|
| 48 |
+
[Link4]: https://huggingface.co/junnei/gemma-3-4b-it-speech/blob/main/eval_result/asr_LibriSpeech_other_en_us_to_ko_kr.json
|
| 49 |
+
[Link5]: https://huggingface.co/junnei/gemma-3-4b-it-speech/blob/main/eval_result/translation_en_us_to_ko_kr.json
|
| 50 |
+
[Link6]: https://huggingface.co/junnei/gemma-3-4b-it-speech/blob/main/eval_result/translation_Fleurs_en_us_to_ko_kr.json
|
| 51 |
+
|
| 52 |
#### ASR
|
| 53 |
|
| 54 |
+
| Benchmark | Task | BLEU ↑ | CER ↓ | WER ↓ | Result |
|
| 55 |
+
| -------------------------------- |----------------|:-------------:|:------------:|:------------:|:-------------:|
|
| 56 |
+
| [Covost2][Covost2] | ASR (English) | **86.09** | **4.12** | **7.83** | [Link][Link1] |
|
| 57 |
+
| [Fleurs][Fleurs] | ASR (English) | **89.61** | **2.28** | **5.23** | [Link][Link2] |
|
| 58 |
+
| [LibriSpeech-Clean][LibriSpeech] | ASR (English) | **94.28** | **0.98** | **2.91** | [Link][Link3] |
|
| 59 |
+
| [LibriSpeech-Other][LibriSpeech] | ASR (English) | **87.60** | **3.10** | **6.55** | [Link][Link4] |
|
| 60 |
|
| 61 |
|
| 62 |
#### AST
|
| 63 |
|
| 64 |
+
| Benchmark | Task | BLEU ↑ | Result |
|
| 65 |
+
| ------------------------------ |-------------------------------|:-------------:|:-------------:|
|
| 66 |
+
| [Covost2][Covost2] | AST (0-shot, English-Korean) | 31.55 | [Link][Link5] |
|
| 67 |
+
| [Fleurs][Fleurs] | AST (0-shot, English-Korean) | 11.05 | [Link][Link6] |
|
| 68 |
|
| 69 |
|
| 70 |
## Model Details
|