README.md

metadata

license: mit
base_model:
  - microsoft/VibeVoice-ASR

VibeVoice-ASR-4-bit

4-bit quantization of the VibeVoice-ASR model making it possible to run on 16gb and even 12gb VRAM GPUs.

Usage example

1. Follow VibeVoice-ASR installation instructions in Microsoft's VibeVoice repo
2. pip install bitsandbytes
3. python ./demo/vibevoice_asr_gradio_demo.py --model_path ./VibeVoice-ASR-4bit