asierhv commited on
Commit
323307b
·
verified ·
1 Parent(s): 7c31afb

added description and "how to use" example

Browse files
Files changed (1) hide show
  1. README.md +144 -42
README.md CHANGED
@@ -28,48 +28,108 @@ model-index:
28
  value: 5.008278145695364
29
  ---
30
 
31
- <!-- This model card has been generated automatically according to the information the Trainer had access to. You
32
- should probably proofread and complete it, then remove this comment. -->
33
-
34
  # Whisper Large-V3 Galician
35
 
36
- This model is a fine-tuned version of [openai/whisper-large-v3](https://huggingface.co/openai/whisper-large-v3) on the mozilla-foundation/common_voice_13_0 gl dataset.
37
- It achieves the following results on the evaluation set:
38
- - Loss: 0.2940
39
- - Wer: 5.0083
 
 
 
40
 
41
  ## Model description
42
 
43
- More information needed
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
44
 
45
- ## Intended uses & limitations
46
 
47
- More information needed
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
48
 
49
  ## Training and evaluation data
50
 
51
- More information needed
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
52
 
53
  ## Training procedure
54
 
55
  ### Training hyperparameters
56
 
57
- The following hyperparameters were used during training:
58
- - learning_rate: 1e-05
59
- - train_batch_size: 32
60
- - eval_batch_size: 16
61
- - seed: 42
62
- - gradient_accumulation_steps: 2
63
- - total_train_batch_size: 64
64
- - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
65
- - lr_scheduler_type: linear
66
- - lr_scheduler_warmup_steps: 500
67
- - training_steps: 20000
68
- - mixed_precision_training: Native AMP
69
-
70
- ### Training results
71
-
72
- | Training Loss | Epoch | Step | Validation Loss | Wer |
73
  |:-------------:|:-----:|:-----:|:---------------:|:------:|
74
  | 0.0176 | 5.0 | 1000 | 0.1563 | 5.2514 |
75
  | 0.004 | 10.0 | 2000 | 0.1884 | 5.5653 |
@@ -92,27 +152,57 @@ The following hyperparameters were used during training:
92
  | 0.0 | 95.0 | 19000 | 0.2927 | 5.0014 |
93
  | 0.0 | 100.0 | 20000 | 0.2940 | 5.0083 |
94
 
 
95
 
96
- ### Framework versions
 
 
 
 
 
 
 
97
 
98
- - Transformers 4.37.2
99
- - Pytorch 2.2.0+cu121
100
- - Datasets 2.16.1
101
- - Tokenizers 0.15.1
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
102
 
103
  ## Citation
104
 
105
- If you use these models in your research, please cite:
106
 
107
  ```bibtex
108
  @misc{dezuazo2025whisperlmimprovingasrmodels,
109
- title={Whisper-LM: Improving ASR Models with Language Models for Low-Resource Languages},
110
- author={Xabier de Zuazo and Eva Navas and Ibon Saratxaga and Inma Hernáez Rioja},
111
- year={2025},
112
- eprint={2503.23542},
113
- archivePrefix={arXiv},
114
- primaryClass={cs.CL},
115
- url={https://arxiv.org/abs/2503.23542},
116
  }
117
  ```
118
 
@@ -120,9 +210,21 @@ Please, check the related paper preprint in
120
  [arXiv:2503.23542](https://arxiv.org/abs/2503.23542)
121
  for more details.
122
 
123
- ## Licensing
 
 
124
 
125
  This model is available under the
126
  [Apache-2.0 License](https://www.apache.org/licenses/LICENSE-2.0).
127
  You are free to use, modify, and distribute this model as long as you credit
128
- the original creators.
 
 
 
 
 
 
 
 
 
 
 
28
  value: 5.008278145695364
29
  ---
30
 
 
 
 
31
  # Whisper Large-V3 Galician
32
 
33
+ ## Model summary
34
+
35
+ **Whisper Large-V3 Galician** is an automatic speech recognition (ASR) model for **Galician (gl)** speech. It is fine-tuned from [openai/whisper-large-v3] on the **Galician portion of Mozilla Common Voice 13.0**, achieving a **Word Error Rate (WER) of 5.01%** on the evaluation split.
36
+
37
+ This model is intended for high-accuracy transcription of Galician audio in research, media, and accessibility applications.
38
+
39
+ ---
40
 
41
  ## Model description
42
 
43
+ * **Architecture:** Transformer-based encoder–decoder (Whisper)
44
+ * **Base model:** openai/whisper-large-v3
45
+ * **Language:** Galician (gl)
46
+ * **Task:** Automatic Speech Recognition (ASR)
47
+ * **Output:** Text transcription in Galician
48
+ * **Decoding:** Autoregressive sequence-to-sequence decoding
49
+
50
+ Fine-tuned on Galician speech data, leveraging Whisper’s multilingual pretraining for low-resource language transcription.
51
+
52
+ ---
53
+
54
+ ## Intended use
55
+
56
+ ### Primary use cases
57
+
58
+ * High-quality transcription of Galician audio recordings
59
+ * Offline or batch ASR pipelines
60
+ * Research and development in Galician ASR
61
+ * Media, educational, and accessibility tasks
62
+
63
+ ### Intended users
64
+
65
+ * Researchers working on Galician or low-resource ASR
66
+ * Developers building Galician speech applications
67
+ * Academic and institutional users
68
 
69
+ ### Out-of-scope use
70
 
71
+ * Real-time or low-latency ASR without optimization
72
+ * Speech translation tasks
73
+ * Safety-critical applications without additional validation
74
+
75
+ ---
76
+
77
+ ## Limitations and known issues
78
+
79
+ * Performance may degrade on:
80
+ * Noisy or low-quality recordings
81
+ * Conversational or spontaneous speech
82
+ * Accents underrepresented in Common Voice
83
+ * Dataset biases may be reflected in outputs
84
+ * Occasional transcription errors can occur under difficult acoustic conditions
85
+
86
+ ---
87
 
88
  ## Training and evaluation data
89
 
90
+ ### Training data
91
+
92
+ * **Dataset:** Mozilla Common Voice 13.0 (Galician subset)
93
+ * **Data type:** Crowd-sourced, read speech
94
+ * **Preprocessing:**
95
+ * Audio resampled to 16 kHz
96
+ * Text normalized using Whisper tokenizer
97
+ * Filtering of invalid or problematic samples
98
+
99
+ ### Evaluation data
100
+
101
+ * **Dataset:** Mozilla Common Voice 13.0 (Galician evaluation split)
102
+ * **Metric:** Word Error Rate (WER)
103
+
104
+ ---
105
+
106
+ ## Evaluation results
107
+
108
+ | Metric | Value |
109
+ | ---------- | ---------- |
110
+ | WER (eval) | **5.01%** |
111
+
112
+ ---
113
 
114
  ## Training procedure
115
 
116
  ### Training hyperparameters
117
 
118
+ * Learning rate: 1e-5
119
+ * Optimizer: Adam (β1=0.9, β2=0.999, ε=1e-8)
120
+ * LR scheduler: Linear
121
+ * Warmup steps: 500
122
+ * Training steps: 20,000
123
+ * Train batch size: 32
124
+ * Eval batch size: 16
125
+ * Gradient accumulation steps: 2
126
+ * Total train batch size: 64
127
+ * Seed: 42
128
+ * Mixed precision: Native AMP
129
+
130
+ ### Training results (summary)
131
+
132
+ | Training Loss | Epoch | Step | Validation Loss | WER |
 
133
  |:-------------:|:-----:|:-----:|:---------------:|:------:|
134
  | 0.0176 | 5.0 | 1000 | 0.1563 | 5.2514 |
135
  | 0.004 | 10.0 | 2000 | 0.1884 | 5.5653 |
 
152
  | 0.0 | 95.0 | 19000 | 0.2927 | 5.0014 |
153
  | 0.0 | 100.0 | 20000 | 0.2940 | 5.0083 |
154
 
155
+ ---
156
 
157
+ ## Framework versions
158
+
159
+ - Transformers 4.37.2
160
+ - PyTorch 2.2.0+cu121
161
+ - Datasets 2.16.1
162
+ - Tokenizers 0.15.1
163
+
164
+ ---
165
 
166
+ ## How to use
167
+
168
+ ```python
169
+ from transformers import pipeline
170
+
171
+ hf_model = "HiTZ/whisper-large-v3-gl" # replace with actual repo ID
172
+ device = 0 # set to -1 for CPU
173
+
174
+ pipe = pipeline(
175
+ task="automatic-speech-recognition",
176
+ model=hf_model,
177
+ device=device
178
+ )
179
+
180
+ result = pipe("audio.wav")
181
+ print(result["text"])
182
+ ```
183
+
184
+ ---
185
+
186
+ ## Ethical considerations and risks
187
+
188
+ * This model transcribes speech and may process personal data.
189
+ * Users should ensure compliance with applicable data protection laws (e.g., GDPR).
190
+ * The model should not be used for surveillance or non-consensual audio processing.
191
+
192
+ ---
193
 
194
  ## Citation
195
 
196
+ If you use this model in your research, please cite:
197
 
198
  ```bibtex
199
  @misc{dezuazo2025whisperlmimprovingasrmodels,
200
+ title={Whisper-LM: Improving ASR Models with Language Models for Low-Resource Languages},
201
+ author={Xabier de Zuazo and Eva Navas and Ibon Saratxaga and Inma Hernáez Rioja},
202
+ year={2025},
203
+ eprint={2503.23542},
204
+ archivePrefix={arXiv},
205
+ primaryClass={cs.CL}
 
206
  }
207
  ```
208
 
 
210
  [arXiv:2503.23542](https://arxiv.org/abs/2503.23542)
211
  for more details.
212
 
213
+ ---
214
+
215
+ ## License
216
 
217
  This model is available under the
218
  [Apache-2.0 License](https://www.apache.org/licenses/LICENSE-2.0).
219
  You are free to use, modify, and distribute this model as long as you credit
220
+ the original creators.
221
+
222
+ ---
223
+
224
+ ## Contact and attribution
225
+
226
+ * Fine-tuning and evaluation: HiTZ/Aholab - Basque Center for Language Technology
227
+ * Base model: OpenAI Whisper
228
+ * Dataset: Mozilla Common Voice
229
+
230
+ For questions or issues, please open an issue in the model repository.