Instructions to use Demonthos/candle-quantized-whisper-distil-v3 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Demonthos/candle-quantized-whisper-distil-v3 with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("automatic-speech-recognition", model="Demonthos/candle-quantized-whisper-distil-v3")# Load model directly from transformers import AutoProcessor, AutoModelForSpeechSeq2Seq processor = AutoProcessor.from_pretrained("Demonthos/candle-quantized-whisper-distil-v3") model = AutoModelForSpeechSeq2Seq.from_pretrained("Demonthos/candle-quantized-whisper-distil-v3", device_map="auto") - Notebooks
- Google Colab
- Kaggle
This is a quantized form of https://huggingface.co/distil-whisper/distil-large-v3 for rwhisper
- Downloads last month
- 66
Hardware compatibility
Log In to add your hardware
We're not able to determine the quantization variants.