|
|
--- |
|
|
license: apache-2.0 |
|
|
datasets: |
|
|
- pnnbao-ump/VieNeu-TTS-1000h |
|
|
- pnnbao-ump/VieNeuCodec-dataset |
|
|
- pnnbao-ump/VieNeu-TTS-140h |
|
|
language: |
|
|
- vi |
|
|
base_model: |
|
|
- neuphonic/neutts-air |
|
|
pipeline_tag: text-to-speech |
|
|
--- |
|
|
|
|
|
## Overview |
|
|
|
|
|
**VieNeu-TTS** is an advanced on-device Vietnamese Text-to-Speech (TTS) model with **instant voice cloning**. |
|
|
|
|
|
Trained on ~1000 hours of high-quality Vietnamese speech, this model represents a significant upgrade from VieNeu-TTS-140h with the following improvements: |
|
|
|
|
|
- **Enhanced pronunciation**: More accurate and stable Vietnamese pronunciation |
|
|
- **Code-switching support**: Seamless transitions between Vietnamese and English |
|
|
- **Better voice cloning**: Higher fidelity and speaker consistency |
|
|
- **Real-time synthesis**: 24 kHz waveform generation on CPU or GPU |
|
|
|
|
|
VieNeu-TTS-1000h delivers production-ready speech synthesis fully offline. |
|
|
|
|
|
**Author:** Phạm Nguyễn Ngọc Bảo |
|
|
|
|
|
## Support This Project |
|
|
|
|
|
Training high-quality TTS models requires significant GPU resources and compute time. If you find this model useful, please consider supporting the development: |
|
|
|
|
|
[](https://buymeacoffee.com/pnnbao) |
|
|
|
|
|
Your support helps maintain and improve VieNeu-TTS! 🙏 |
|
|
|
|
|
--- |
|
|
|
|
|
## Reference Voices |
|
|
|
|
|
| File | Gender | Accent | Description | |
|
|
|-------------------------|--------|--------|--------------------| |
|
|
| Bình (nam miền Bắc) | Male | North | Male voice, North accent | |
|
|
| Tuyên (nam miền Bắc) | Male | North | Male voice, North accent | |
|
|
| Nguyên (nam miền Nam) | Male | South | Male voice, South accent | |
|
|
| Sơn (nam miền Nam) | Male | South | Male voice, South accent | |
|
|
| Vĩnh (nam miền Nam) | Male | South | Male voice, South accent | |
|
|
| Hương (nữ miền Bắc) | Female | North | Female voice, North accent | |
|
|
| Ly (nữ miền Bắc) | Female | North | Female voice, North accent | |
|
|
| Ngọc (nữ miền Bắc) | Female | North | Female voice, North accent | |
|
|
| Đoan (nữ miền Nam) | Female | South | Female voice, South accent | |
|
|
| Dung (nữ miền Nam) | Female | South | Female voice, South accent | |
|
|
|
|
|
--- |
|
|
|
|
|
## Model Architecture |
|
|
|
|
|
| Component | Description | |
|
|
|----------|-------------| |
|
|
| Backbone | Qwen 0.5B (chat-format LM) | |
|
|
| Codec | NeuCodec (supports ONNX + quantization) | |
|
|
| Output | 24 kHz waveform synthesis | |
|
|
| Context Window | 2048 tokens shared text + speech | |
|
|
| Watermark | Enabled | |
|
|
| Training Data | VieNeuCodec-dataset + Emilia dataset pretraining | |
|
|
|
|
|
## Features |
|
|
|
|
|
- High-quality Vietnamese speech |
|
|
- Instant **voice cloning** (3–5 second reference audio) |
|
|
- Fully **offline** |
|
|
- Runs real-time or faster |
|
|
- Multi-voice reference support |
|
|
- Python API + CLI + Gradio |
|
|
|
|
|
## Troubleshooting |
|
|
|
|
|
| Issue | Cause | Solution | |
|
|
|------|-------|----------| |
|
|
| Missing `libespeak` | System dependency | Install eSpeak NG | |
|
|
| GPU OOM | VRAM too small | Use CPU or quantized model | |
|
|
| Poor voice match | Bad reference sample | Try a clearer reference clip | |
|
|
|
|
|
## License |
|
|
|
|
|
Apache 2.0 |
|
|
|
|
|
## Citation |
|
|
|
|
|
```bibtex |
|
|
@misc{vieneutts2025, |
|
|
title = {VieNeu-TTS: Vietnamese Text-to-Speech with Instant Voice Cloning}, |
|
|
author = {Pham Nguyen Ngoc Bao}, |
|
|
year = {2025}, |
|
|
publisher = {Hugging Face}, |
|
|
howpublished = {\url{https://huggingface.co/pnnbao-ump/VieNeu-TTS}} |
|
|
} |
|
|
``` |
|
|
|
|
|
Please also cite the base model: |
|
|
|
|
|
```bibtex |
|
|
@misc{neuttsair2025, |
|
|
title = {NeuTTS Air: On-Device Speech Language Model with Instant Voice Cloning}, |
|
|
author = {Neuphonic}, |
|
|
year = {2025}, |
|
|
publisher = {Hugging Face}, |
|
|
howpublished = {\url{https://huggingface.co/neuphonic/neutts-air}} |
|
|
} |
|
|
``` |
