File size: 1,763 Bytes
5a3f95c 092adb5 5a3f95c 092adb5 5a3f95c 0d4084c ba6b366 0d4084c ba6b366 0d4084c ba6b366 5774768 0d4084c ba6b366 0d4084c ba6b366 0d4084c ba6b366 0d4084c ba6b366 0d4084c 1adf249 0d6ecd8 1adf249 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 | ---
license: apache-2.0
language:
- kk
base_model:
- microsoft/VibeVoice-ASR
tags:
- automatic-speech-recognition
- kazakh
- vibevoice
- lora
- ksc2
datasets:
- InflexionLab/ISSAI-KSC2-Structured
metrics:
model-index:
- name: VibeVoice-ASR-Kazakh
results:
- task:
type: ASR
dataset:
type: AudioDataset
name: ISSAI KSC2
metrics:
- type: WER
value: 22%
---
# VibeVoice ASR — Kazakh
## Model Description
This is **VibeVoice ASR** fine-tuned on the Kazakh language using the [ISSAI KSC2
Structured](https://huggingface.co/datasets/InflexionLab/ISSAI-KSC2-Structured) dataset (~1,200 hours of diverse Kazakh speech). Fine-tuning was performed
using LoRA (Low-Rank Adaptation) and the weights were merged into the base model for efficient inference. Model demonstrated **22%** WER on test set of ISSAI KSC2.
The base VibeVoice ASR model had no prior Kazakh knowledge. This fine-tuned version produces punctuated and capitalized Kazakh transcriptions.
## Training Dataset
[InflexionLab/ISSAI-KSC2-Structured](https://huggingface.co/datasets/InflexionLab/ISSAI-KSC2-Structured) — an enhanced version of the ISSAI KSC2 corpus
with punctuation and capitalization restored using Gemma 27B. Covers 6 domains: TV News, Crowdsourced, Parliament, Talkshow, Podcasts, and Radio.
## Evaluation Results
Evaluated on the KSC2 Test split (9,351 samples) and farabi-lab/kazakh-stt 30K samples. Farabi-Lab dataset was not included in training.
| Dataset | WER | CER |
|----------------------------|-----------------|-----------------|
| ISSAI_KSC2 | ~22% | ~9.6% |
| farabi-lab/kazakh-stt | 17.6% | 4.25% | |