--- language: it license: mit tags: - whisper - automatic-speech-recognition - italian - ctranslate2 - faster-whisper - whisperx - localai - int8 datasets: - mozilla-foundation/common_voice_25_0 - facebook/multilingual_librispeech - facebook/voxpopuli base_model: openai/whisper-tiny pipeline_tag: automatic-speech-recognition --- # whisper-tiny-it-multi-ct2-int8 [CTranslate2](https://github.com/OpenNMT/CTranslate2) INT8 quantized version of [LocalAI-io/whisper-tiny-it-multi](https://huggingface.co/LocalAI-io/whisper-tiny-it-multi) for fast CPU inference. **Author:** Ettore Di Giacinto Brought to you by the [LocalAI](https://github.com/mudler/LocalAI) team. This model can be used directly with [LocalAI](https://localai.io). ## Usage with LocalAI This model is ready to use with [LocalAI](https://localai.io) via the `whisperx` backend. Save the following as `whisperx-tiny-it-multi.yaml` in your LocalAI models directory: ```yaml name: whisperx-tiny-it-multi backend: whisperx known_usecases: - transcript parameters: model: LocalAI-io/whisper-tiny-it-multi-ct2-int8 language: it ``` Then transcribe audio via the OpenAI-compatible endpoint: ```bash curl http://localhost:8080/v1/audio/transcriptions \ -H "Content-Type: multipart/form-data" \ -F file="@audio.mp3" \ -F model="whisperx-tiny-it-multi" ``` ## Usage ### faster-whisper ```python from faster_whisper import WhisperModel model = WhisperModel("LocalAI-io/whisper-tiny-it-multi-ct2-int8", device="cpu", compute_type="int8") segments, info = model.transcribe("audio.mp3", language="it") for segment in segments: print(f"[{segment.start:.1f}s - {segment.end:.1f}s] {segment.text}") ``` ### WhisperX ```python import whisperx model = whisperx.load_model("LocalAI-io/whisper-tiny-it-multi-ct2-int8", device="cpu", compute_type="int8") result = model.transcribe("audio.mp3", language="it") ``` ## Links - **HF Safetensors:** [LocalAI-io/whisper-tiny-it-multi](https://huggingface.co/LocalAI-io/whisper-tiny-it-multi) - **Code:** [github.com/localai-org/italian-whisper](https://github.com/localai-org/italian-whisper) - **LocalAI:** [github.com/mudler/LocalAI](https://github.com/mudler/LocalAI)