Automatic Speech Recognition
Transformers
PyTorch
TensorFlow
JAX
Safetensors
whisper
audio
hf-asr-leaderboard
Eval Results (legacy)
Instructions to use openai/whisper-base with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use openai/whisper-base with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("automatic-speech-recognition", model="openai/whisper-base")# Load model directly from transformers import AutoProcessor, AutoModelForSpeechSeq2Seq processor = AutoProcessor.from_pretrained("openai/whisper-base") model = AutoModelForSpeechSeq2Seq.from_pretrained("openai/whisper-base") - Notebooks
- Google Colab
- Kaggle
Closed bracket in whisper-base
#6
by cupofsanity - opened
README.md
CHANGED
|
@@ -227,7 +227,7 @@ The "<|en|>" token is used to specify that the speech is in english and should b
|
|
| 227 |
>>> input_features = processor(ds[0]["audio"]["array"], return_tensors="pt").input_features
|
| 228 |
|
| 229 |
>>> # Generate logits
|
| 230 |
-
>>> logits = model(input_features, decoder_input_ids = torch.tensor([[50258]]).logits
|
| 231 |
>>> # take argmax and decode
|
| 232 |
>>> predicted_ids = torch.argmax(logits, dim=-1)
|
| 233 |
>>> transcription = processor.batch_decode(predicted_ids)
|
|
|
|
| 227 |
>>> input_features = processor(ds[0]["audio"]["array"], return_tensors="pt").input_features
|
| 228 |
|
| 229 |
>>> # Generate logits
|
| 230 |
+
>>> logits = model(input_features, decoder_input_ids = torch.tensor([[50258]])).logits
|
| 231 |
>>> # take argmax and decode
|
| 232 |
>>> predicted_ids = torch.argmax(logits, dim=-1)
|
| 233 |
>>> transcription = processor.batch_decode(predicted_ids)
|