Automatic Speech Recognition
Transformers
rotorquant
kv-cache-quantization
voxtral
mistral
audio
realtime
asr
quantized
Instructions to use majentik/Voxtral-Mini-4B-Realtime-2602-RotorQuant with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use majentik/Voxtral-Mini-4B-Realtime-2602-RotorQuant with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("automatic-speech-recognition", model="majentik/Voxtral-Mini-4B-Realtime-2602-RotorQuant")# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("majentik/Voxtral-Mini-4B-Realtime-2602-RotorQuant", dtype="auto") - Notebooks
- Google Colab
- Kaggle
Ctrl+K