File size: 480 Bytes
42fd178 b24a733 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 | ---
license: mit
base_model:
- microsoft/VibeVoice-ASR
---
# VibeVoice-ASR-4-bit
4-bit quantization of the VibeVoice-ASR model making it possible to run on 16gb and even 12gb VRAM GPUs.
## Usage example
1. [Follow VibeVoice-ASR installation instructions in Microsoft's VibeVoice repo](https://github.com/microsoft/VibeVoice/blob/main/docs/vibevoice-asr.md#installation)
2. pip install bitsandbytes
3. python ./demo/vibevoice_asr_gradio_demo.py --model_path ./VibeVoice-ASR-4bit |