Instructions to use openai/whisper-large-v3 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use openai/whisper-large-v3 with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("automatic-speech-recognition", model="openai/whisper-large-v3")# Load model directly from transformers import AutoProcessor, AutoModelForSpeechSeq2Seq processor = AutoProcessor.from_pretrained("openai/whisper-large-v3") model = AutoModelForSpeechSeq2Seq.from_pretrained("openai/whisper-large-v3", device_map="auto") - Inference
- Notebooks
- Google Colab
- Kaggle
Whisper openai vs hugging face question
https://github.com/openai/whisper/blob/main/whisper/model.py
https://github.com/huggingface/transformers/blob/main/src/transformers/models/whisper/modeling_whisper.py
The Hugging Face implementation, while undoubtedly valuable for accessibility and integration, diverges so significantly from the original OpenAI Whisper model that it raises the question if it should even be labeled as 'Whisper'?"
These are two entirely different architectural philosophies, differing even at the level of foundational components. I know that it is a common practice in the field and certainly within the scope of the open source community that models are adapted to fit the needs of a particular library or framework, but this is a bit of a stretch even for that isn't it?