Text-to-Speech
Transformers
Safetensors
English
vibevoice_streaming
Realtime TTS
Streaming text input
Long-form speech generation
Instructions to use microsoft/VibeVoice-Realtime-0.5B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use microsoft/VibeVoice-Realtime-0.5B with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-to-speech", model="microsoft/VibeVoice-Realtime-0.5B")# Load model directly from transformers import VibeVoiceStreamingForConditionalGenerationInference model = VibeVoiceStreamingForConditionalGenerationInference.from_pretrained("microsoft/VibeVoice-Realtime-0.5B", dtype="auto") - Notebooks
- Google Colab
- Kaggle
How can we get the position of text in the generated audio?
#12
by maifeeulasad - opened
It's really cool that we can now generate audio in realtime with microsoft/VibeVoice-Realtime-0.5B. I was thinking about integrating it to my application. And then I found a critical UX requirement, if we could highlight the text with the current audio that would be great.
Does vibe voice support this?
Opened an issue: https://github.com/microsoft/VibeVoice/issues/144
Thank you for your interest. Currently, the model cannot provide alignment information between generated speech and text.