ABBNDZ commited on
Commit
d0ca1fd
·
verified ·
1 Parent(s): d5e3aa0

README.md

Browse files

---
language:
- en
- es
- fr
- de
- it
- pt
- pl
- tr
- ru
- nl
- cs
- ar
- zh
- ja
- hu
- ko
- hi
pipeline_tag: text-to-speech
tags:
- text-to-speech
- tts
- ggml
- vulkan
- c++
- on-device
license: coqui-public-model-license
base_model: coqui/XTTS-v2
---

# ATTS1HG1: High-Performance GGML Implementation of XTTS-v2

**ATTS1HG1** is a high-speed, native C++ implementation of the Coqui XTTS-v2 model, utilizing the **GGML** tensor library. It features a custom integrated HiFiGAN vocoder optimized for **Vulkan** and **CPU** inference.

<div align="center">

| **Source Code & GUI** | **Base Model** | **Backend** |
|:---:|:---:|:---:|
| [**GitHub: ATTS1HG1**](https://github.com/abbndz/ATTS1HG1) | [Coqui XTTS-v2](https://huggingface.co/coqui/XTTS-v2) | GGML / Vulkan |

</div>

## 🚀 Key Features

* **Blazing Fast:** Generates audio in **< 0.5s** on consumer GPUs (RTX 3090) and **~1.0s** on CPU.
* **Vulkan Support:** Fully optimized HiFiGAN vocoder running on Vulkan (compatible with NVIDIA, AMD, Intel iGPUs).
* **Lightweight:** Native C++ application, no heavy Python dependencies (PyTorch/TensorFlow not required at runtime).
* **Multi-Language:** Supports 17 languages.
* **Voice :** Supports 58 speaker (similar to XTTS).

## 🌍 Supported Languages

The model supports the following 17 languages:

| Code | Language | Native Name |
| :--- | :--- | :--- |
| **en** | English | English |
| **es** | Spanish | Español |
| **fr** | French | Français |
| **de** | German | Deutsch |
| **it** | Italian | Italiano |
| **pt** | Portuguese | Português |
| **pl** | Polish | Polski |
| **tr** | Turkish | Türkçe |
| **ru** | Russian | Русский |
| **nl** | Dutch | Nederlands |
| **cs** | Czech | Čeština |
| **ar** | Arabic | العربية |
| **zh** | Chinese | 中文 |
| **ja** | Japanese | 日本語 |
| **hu** | Hungarian | Magyar |
| **ko** | Korean | 한국어 |
| **hi** | Hindi | हिन्दी |

## ⚡ Performance

Benchmarks based on standard text generation ("Bonjour le monde") using the C++ client:

| Device | Backend | Latency (Total) | Note |
| :--- | :--- | :--- | :--- |
| **NVIDIA RTX 3090** | **Vulkan** | **~0.47s** | 🚀 **Recommended** |
| **Intel iGPU** | Vulkan | ~1.40s | Good for laptops |
| **CPU (Ryzen/Intel)**| CPU (AVX2)| ~1.02s | Solid fallback |
| **NVIDIA RTX 3090** | CUDA | ~1.45s | Slower on HiFiGAN due to kernel overhead |

> **Note:** The Vulkan backend is significantly faster for the HiFiGAN part of the pipeline compared to CUDA due to optimized command buffers and reduced kernel launch overhead for small convolutions.

## 🛠️ Usage

This repository contains the converted `.bin` / `.gguf` weights required by the ATTS1HG1 software.

1. Download the model files from this repository.
2. Clone and compile the software from GitHub:
```bash
git clone [https://github.com/abbndz/ATTS1HG1](https://github.com/abbndz/ATTS1HG1)
```
3. Load the model in the GUI or CLI and select **Vulkan** for best performance.



---
*Credits: Based on the excellent work by Coqui.ai and the GGML library by ggerganov.*

Files changed (1) hide show
  1. README.md +112 -5
README.md CHANGED
@@ -1,5 +1,112 @@
1
- ---
2
- pipeline_tag: text-to-speech
3
- tags:
4
- - TTS
5
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language:
3
+ - en
4
+ - es
5
+ - fr
6
+ - de
7
+ - it
8
+ - pt
9
+ - pl
10
+ - tr
11
+ - ru
12
+ - nl
13
+ - cs
14
+ - ar
15
+ - zh
16
+ - ja
17
+ - hu
18
+ - ko
19
+ - hi
20
+ pipeline_tag: text-to-speech
21
+ tags:
22
+ - text-to-speech
23
+ - tts
24
+ - ggml
25
+ - vulkan
26
+ - c++
27
+ - on-device
28
+ license: other
29
+ license_name: coqui-public-model-license
30
+ license_link: https://coqui.ai/cpml
31
+ base_model: coqui/XTTS-v2
32
+ ---
33
+
34
+
35
+ # ATTS1HG1: High-Performance GGML Implementation of XTTS-v2
36
+
37
+ **ATTS1HG1** is a high-speed, native C++ implementation of the Coqui XTTS-v2 model, utilizing the **GGML** tensor library. It features a custom integrated HiFiGAN vocoder optimized for **Vulkan** and **CPU** inference.
38
+
39
+ <div align="center">
40
+
41
+ | **Source Code & GUI** | **Base Model** | **Backend** |
42
+ |:---:|:---:|:---:|
43
+ | [**GitHub: ATTS1HG1**](https://github.com/abbndz/ATTS1HG1) | [Coqui XTTS-v2](https://huggingface.co/coqui/XTTS-v2) | GGML / Vulkan |
44
+
45
+ </div>
46
+
47
+ ## 🚀 Key Features
48
+
49
+ * **Blazing Fast:** Generates audio in **< 0.5s** on consumer GPUs (RTX 3090) and **~1.0s** on CPU.
50
+ * **Vulkan Support:** Fully optimized HiFiGAN vocoder running on Vulkan (compatible with NVIDIA, AMD, Intel iGPUs).
51
+ * **Lightweight:** Native C++ application, no heavy Python dependencies (PyTorch/TensorFlow not required at runtime).
52
+ * **Multi-Language:** Supports 17 languages.
53
+ * **Voice :** Supports 58 speaker (similar to XTTS).
54
+
55
+ ## 🌍 Supported Languages
56
+
57
+ The model supports the following 17 languages:
58
+
59
+ | Code | Language | Native Name |
60
+ | :--- | :--- | :--- |
61
+ | **en** | English | English |
62
+ | **es** | Spanish | Español |
63
+ | **fr** | French | Français |
64
+ | **de** | German | Deutsch |
65
+ | **it** | Italian | Italiano |
66
+ | **pt** | Portuguese | Português |
67
+ | **pl** | Polish | Polski |
68
+ | **tr** | Turkish | Türkçe |
69
+ | **ru** | Russian | Русский |
70
+ | **nl** | Dutch | Nederlands |
71
+ | **cs** | Czech | Čeština |
72
+ | **ar** | Arabic | العربية |
73
+ | **zh** | Chinese | 中文 |
74
+ | **ja** | Japanese | 日本語 |
75
+ | **hu** | Hungarian | Magyar |
76
+ | **ko** | Korean | 한국어 |
77
+ | **hi** | Hindi | हिन्दी |
78
+
79
+ ## ⚡ Performance
80
+
81
+ Benchmarks based on standard text generation ("Bonjour le monde") using the C++ client:
82
+
83
+ | Device | Backend | Latency (Total) | Note |
84
+ | :--- | :--- | :--- | :--- |
85
+ | **NVIDIA RTX 3090** | **Vulkan** | **~0.47s** | 🚀 **Recommended** |
86
+ | **Intel iGPU** | Vulkan | ~1.40s | Good for laptops |
87
+ | **CPU (Ryzen/Intel)**| CPU (AVX2)| ~1.02s | Solid fallback |
88
+ | **NVIDIA RTX 3090** | CUDA | ~1.45s | Slower on HiFiGAN due to kernel overhead |
89
+
90
+ > **Note:** The Vulkan backend is significantly faster for the HiFiGAN part of the pipeline compared to CUDA due to optimized command buffers and reduced kernel launch overhead for small convolutions.
91
+
92
+ ## 🛠️ Usage
93
+
94
+ This repository contains the converted `.bin` / `.gguf` weights required by the ATTS1HG1 software.
95
+
96
+ 1. Download the model files from this repository.
97
+ 2. Clone and compile the software from GitHub:
98
+ ```bash
99
+ git clone [https://github.com/abbndz/ATTS1HG1](https://github.com/abbndz/ATTS1HG1)
100
+ ```
101
+ 3. Load the model in the GUI or CLI and select **Vulkan** for best performance.
102
+
103
+ ## 📜 License
104
+
105
+ This project uses the weights from **Coqui XTTS-v2**, which is licensed under the **Coqui Public Model License (CPML)**.
106
+ * **Non-commercial use:** You can use this model for personal, educational, and non-commercial projects.
107
+ * **Commercial use:** Requires a license from Coqui (check their repository for details).
108
+
109
+ The C++ code (inference engine) is available under the MIT License (see GitHub).
110
+
111
+ ---
112
+ *Credits: Based on the excellent work by Coqui.ai and the GGML library by ggerganov.*