Instructions to use Audio8/Audio8-TTS-Preview-0.6b with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Audio8/Audio8-TTS-Preview-0.6b with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-to-speech", model="Audio8/Audio8-TTS-Preview-0.6b", trust_remote_code=True)# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("Audio8/Audio8-TTS-Preview-0.6b", trust_remote_code=True, device_map="auto") - Notebooks
- Google Colab
- Kaggle
Cantonese awful quality
I've tried register 20sec .mp3 with complete typescript. The testing results is awful. The speech combining Mandarin with cantonese, full sentence mostly are"mandarin accent" with some "characters" is speaking as Mandarin. it's like expecting American English but output is like in movies hearing native Spanish/Italian/Russian speaking English.
Thank you for the detailed feedback. We’ve observed this issue as well. Cantonese and Mandarin share many of the same character tokens, while Mandarin currently has far more training data, so the model can strongly favor Mandarin pronunciation.
As a potential solution, we may introduce a configurable language selector as part of the context in a future version. In the meantime, using Cantonese reference audio can help mitigate the issue and improve the generation success rate.