Fix grammar in README.md
Browse files
README.md
CHANGED
|
@@ -10,7 +10,7 @@ tags:
|
|
| 10 |
|
| 11 |
# StyleTTS2 — Basque Multispeaker TTS
|
| 12 |
|
| 13 |
-
This is a
|
| 14 |
|
| 15 |
Examples (playable):
|
| 16 |
|
|
@@ -24,7 +24,7 @@ Examples (playable):
|
|
| 24 |
|
| 25 |
Main modifications:
|
| 26 |
- [PL-BERT-eu](https://huggingface.co/HiTZ/PL-BERT-wp-eu): PL-BERT model trained with WordPiece tokenizer for phonemized Basque text.
|
| 27 |
-
- ASR-eu: ASR model trained with a subset of multispeaker speech corpus.
|
| 28 |
- Phonemizer: We used code developed by [Aholab](https://aholab.ehu.eus/aholab/) to generate IPA phonemes for training the model. You can see a demo of the Basque phonemizer at [arrandi/phonemizer-eus-esp](https://huggingface.co/spaces/arrandi/phonemizer-eus-esp). Likewise, the code used to generate IPA phonemes can be found in the `phonemizer` directory. We collapsed multi-character phonemes into single-character phonemes for better grapheme–phoneme alignment.
|
| 29 |
|
| 30 |
|
|
@@ -45,14 +45,14 @@ Main modifications:
|
|
| 45 |
## Training dataset
|
| 46 |
|
| 47 |
[Sonora](https://zenodo.org/records/17952596) multispeaker Basque speech dataset.
|
| 48 |
-
- Number of
|
| 49 |
-
-
|
| 50 |
-
- Dataset
|
| 51 |
-
- OOD dataset: We use a different
|
| 52 |
|
| 53 |
## Training
|
| 54 |
|
| 55 |
-
|
| 56 |
|
| 57 |
- **Device:** cuda
|
| 58 |
- **Stages:** 1st-stage epochs = 50; 2nd-stage epochs = 30
|
|
|
|
| 10 |
|
| 11 |
# StyleTTS2 — Basque Multispeaker TTS
|
| 12 |
|
| 13 |
+
This is a Basque text-to-speech (TTS) model based on the [StyleTTS2](https://github.com/yl4579/StyleTTS2) architecture, specifically adapted for Basque language synthesis. The model achieves good-quality Basque speech synthesis. The model was trained from scratch on the Basque multispeaker [Sonora](https://zenodo.org/records/17952596) speech corpus.
|
| 14 |
|
| 15 |
Examples (playable):
|
| 16 |
|
|
|
|
| 24 |
|
| 25 |
Main modifications:
|
| 26 |
- [PL-BERT-eu](https://huggingface.co/HiTZ/PL-BERT-wp-eu): PL-BERT model trained with WordPiece tokenizer for phonemized Basque text.
|
| 27 |
+
- ASR-eu: ASR model trained with a subset of the multispeaker speech corpus. It uses the same architecture as the original [ASR](https://github.com/yl4579/AuxiliaryASR) from StyleTTS2.
|
| 28 |
- Phonemizer: We used code developed by [Aholab](https://aholab.ehu.eus/aholab/) to generate IPA phonemes for training the model. You can see a demo of the Basque phonemizer at [arrandi/phonemizer-eus-esp](https://huggingface.co/spaces/arrandi/phonemizer-eus-esp). Likewise, the code used to generate IPA phonemes can be found in the `phonemizer` directory. We collapsed multi-character phonemes into single-character phonemes for better grapheme–phoneme alignment.
|
| 29 |
|
| 30 |
|
|
|
|
| 45 |
## Training dataset
|
| 46 |
|
| 47 |
[Sonora](https://zenodo.org/records/17952596) multispeaker Basque speech dataset.
|
| 48 |
+
- Number of speakers: two speakers
|
| 49 |
+
- Audio: 13,500 utterances per speaker, totalling 34 hours and 18 minutes.
|
| 50 |
+
- Dataset split: We used 100 samples for validation and 500 for testing.
|
| 51 |
+
- OOD dataset: We use a different text dataset as the Out-of-Distribution (OOD) dataset.
|
| 52 |
|
| 53 |
## Training
|
| 54 |
|
| 55 |
+
Brief summary of training parameters used (from `config_basque_multispeaker_phoneme_wavlm_800.yml`):
|
| 56 |
|
| 57 |
- **Device:** cuda
|
| 58 |
- **Stages:** 1st-stage epochs = 50; 2nd-stage epochs = 30
|