mozilla-foundation/common_voice_17_0
Updated • 6.15k • 18
How to use dearyoungjo/whisper_base_it with Transformers:
# Use a pipeline as a high-level helper
from transformers import pipeline
pipe = pipeline("automatic-speech-recognition", model="dearyoungjo/whisper_base_it") # Load model directly
from transformers import AutoProcessor, AutoModelForSpeechSeq2Seq
processor = AutoProcessor.from_pretrained("dearyoungjo/whisper_base_it")
model = AutoModelForSpeechSeq2Seq.from_pretrained("dearyoungjo/whisper_base_it")This model is a fine-tuned version of openai/whisper-base on the Common Voice 17.0 dataset. It achieves the following results on the evaluation set:
More information needed
More information needed
More information needed
The following hyperparameters were used during training:
| Training Loss | Epoch | Step | Validation Loss | Wer |
|---|---|---|---|---|
| 0.9703 | 0.0159 | 1 | 1.1724 | 42.1492 |
| 1.0107 | 0.0317 | 2 | 1.1724 | 42.1492 |
| 1.1515 | 0.0476 | 3 | 1.1724 | 42.1492 |
| 0.843 | 0.0635 | 4 | 1.1530 | 41.2624 |
Base model
openai/whisper-base