| license: mit | |
| base_model: | |
| - microsoft/VibeVoice-ASR | |
| # VibeVoice-ASR-4-bit | |
| 4-bit quantization of the VibeVoice-ASR model making it possible to run on 16gb and even 12gb VRAM GPUs. | |
| ## Usage example | |
| 1. [Follow VibeVoice-ASR installation instructions in Microsoft's VibeVoice repo](https://github.com/microsoft/VibeVoice/blob/main/docs/vibevoice-asr.md#installation) | |
| 2. pip install bitsandbytes | |
| 3. python ./demo/vibevoice_asr_gradio_demo.py --model_path ./VibeVoice-ASR-4bit |