---
license: mit
base_model:
- microsoft/VibeVoice-ASR
---

# VibeVoice-ASR-4-bit

4-bit quantization of the VibeVoice-ASR model making it possible to run on 16gb and even 12gb VRAM GPUs.

## Usage example
1. [Follow VibeVoice-ASR installation instructions in Microsoft's VibeVoice repo](https://github.com/microsoft/VibeVoice/blob/main/docs/vibevoice-asr.md#installation)
2. pip install bitsandbytes
3. python ./demo/vibevoice_asr_gradio_demo.py --model_path ./VibeVoice-ASR-4bit