mudler commited on
Commit
75c62f1
·
verified ·
1 Parent(s): 9c9ff75

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +64 -0
README.md ADDED
@@ -0,0 +1,64 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language: it
3
+ license: mit
4
+ tags:
5
+ - whisper
6
+ - automatic-speech-recognition
7
+ - italian
8
+ - localai
9
+ datasets:
10
+ - mozilla-foundation/common_voice_25_0
11
+ base_model: openai/whisper-medium
12
+ pipeline_tag: automatic-speech-recognition
13
+ ---
14
+
15
+ # whisper-medium-it
16
+
17
+ Fine-tuned [openai/whisper-medium](https://huggingface.co/openai/whisper-medium) (769M params) for Italian ASR.
18
+
19
+ **Author:** Ettore Di Giacinto
20
+
21
+ Brought to you by the [LocalAI](https://github.com/mudler/LocalAI) team. This model can be used directly with [LocalAI](https://localai.io).
22
+
23
+ ## Results
24
+
25
+ Evaluated on Common Voice 25.0 Italian test set (15,184 samples):
26
+
27
+ | Step | WER |
28
+ |------|-----|
29
+ | 1000 | 14.61% |
30
+ | 3000 | 13.77% |
31
+ | 5000 | 12.42% |
32
+ | 7000 | 11.58% |
33
+ | 9000 | 10.66% |
34
+ | 10000 | **10.47%** |
35
+
36
+ ## Training Details
37
+
38
+ - **Base model:** openai/whisper-medium (769M parameters)
39
+ - **Dataset:** Common Voice 25.0 Italian (173k train, 15k dev, 15k test)
40
+ - **Steps:** 10,000
41
+ - **Precision:** bf16 on NVIDIA GB10
42
+
43
+ ## Usage
44
+
45
+ ### Transformers
46
+
47
+ ```python
48
+ from transformers import pipeline
49
+
50
+ pipe = pipeline("automatic-speech-recognition", model="LocalAI-io/whisper-medium-it")
51
+ result = pipe("audio.mp3", generate_kwargs={"language": "it", "task": "transcribe"})
52
+ print(result["text"])
53
+ ```
54
+
55
+ ### CTranslate2 / faster-whisper
56
+
57
+ For optimized CPU inference: [LocalAI-io/whisper-medium-it-ct2-int8](https://huggingface.co/LocalAI-io/whisper-medium-it-ct2-int8)
58
+
59
+ ## Links
60
+
61
+ - **Multi-dataset version:** [LocalAI-io/whisper-medium-it-multi](https://huggingface.co/LocalAI-io/whisper-medium-it-multi) (WER 12.4%)
62
+ - **CTranslate2 INT8:** [LocalAI-io/whisper-medium-it-ct2-int8](https://huggingface.co/LocalAI-io/whisper-medium-it-ct2-int8)
63
+ - **Code:** [github.com/localai-org/whisper-it](https://github.com/localai-org/whisper-it)
64
+ - **LocalAI:** [github.com/mudler/LocalAI](https://github.com/mudler/LocalAI)