VibeVoice
Collection
5 items • Updated
How to use mlx-community/VibeVoice-Realtime-0.5B-4bit with Transformers:
# Use a pipeline as a high-level helper
from transformers import pipeline
pipe = pipeline("text-to-speech", model="mlx-community/VibeVoice-Realtime-0.5B-4bit") # Load model directly
from transformers import VibeVoiceStreamingForConditionalGenerationInference
model = VibeVoiceStreamingForConditionalGenerationInference.from_pretrained("mlx-community/VibeVoice-Realtime-0.5B-4bit", dtype="auto")How to use mlx-community/VibeVoice-Realtime-0.5B-4bit with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] huggingface-cli download --local-dir VibeVoice-Realtime-0.5B-4bit mlx-community/VibeVoice-Realtime-0.5B-4bit
This model was converted to MLX format from microsoft/VibeVoice-Realtime-0.5B using mlx-audio version 0.2.6.
Refer to the original model card for more details on the model.
pip install -U mlx-audio
python -m mlx_audio.tts.generate --model mlx-community/VibeVoice-Realtime-0.5B-4bit --text "Hello, this is VibeVoice real-time 0.5B model." --voice en-Emma_woman
4-bit
Base model
Qwen/Qwen2.5-0.5B