mudler commited on
Commit
b6bc6ea
·
verified ·
1 Parent(s): 24d64cd

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +64 -0
README.md ADDED
@@ -0,0 +1,64 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language: it
3
+ license: mit
4
+ tags:
5
+ - whisper
6
+ - automatic-speech-recognition
7
+ - italian
8
+ - ctranslate2
9
+ - faster-whisper
10
+ - whisperx
11
+ - localai
12
+ - int8
13
+ datasets:
14
+ - mozilla-foundation/common_voice_25_0
15
+ base_model: openai/whisper-tiny
16
+ pipeline_tag: automatic-speech-recognition
17
+ ---
18
+
19
+ # whisper-tiny-it-ct2-int8
20
+
21
+ [CTranslate2](https://github.com/OpenNMT/CTranslate2) INT8 quantized version of [LocalAI-io/whisper-tiny-it](https://huggingface.co/LocalAI-io/whisper-tiny-it) for fast CPU inference.
22
+
23
+ **Author:** Ettore Di Giacinto
24
+
25
+ Brought to you by the [LocalAI](https://github.com/mudler/LocalAI) team. This model can be used directly with [LocalAI](https://localai.io).
26
+
27
+ ## Model Details
28
+
29
+ - **Base model:** openai/whisper-tiny, fine-tuned on Common Voice 25.0 Italian
30
+ - **Quantization:** INT8 via CTranslate2
31
+ - **Size:** 39MB (vs 578MB for the original fp32 model)
32
+ - **WER:** 27.1% on Common Voice 25.0 Italian test set
33
+
34
+ ## Usage
35
+
36
+ ### faster-whisper
37
+
38
+ ```python
39
+ from faster_whisper import WhisperModel
40
+
41
+ model = WhisperModel("LocalAI-io/whisper-tiny-it-ct2-int8", device="cpu", compute_type="int8")
42
+ segments, info = model.transcribe("audio.mp3", language="it")
43
+ for segment in segments:
44
+ print(f"[{segment.start:.1f}s - {segment.end:.1f}s] {segment.text}")
45
+ ```
46
+
47
+ ### WhisperX
48
+
49
+ ```python
50
+ import whisperx
51
+
52
+ model = whisperx.load_model("LocalAI-io/whisper-tiny-it-ct2-int8", device="cpu", compute_type="int8")
53
+ result = model.transcribe("audio.mp3", language="it")
54
+ ```
55
+
56
+ ### LocalAI
57
+
58
+ This model is compatible with [LocalAI](https://github.com/mudler/LocalAI) for local, self-hosted AI inference.
59
+
60
+ ## Links
61
+
62
+ - **HF Safetensors version:** [LocalAI-io/whisper-tiny-it](https://huggingface.co/LocalAI-io/whisper-tiny-it)
63
+ - **Code:** [github.com/localai-org/whisper-it](https://github.com/localai-org/whisper-it)
64
+ - **LocalAI:** [github.com/mudler/LocalAI](https://github.com/mudler/LocalAI)