Instructions to use ryota-komatsu/SylReg-Decoder with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use ryota-komatsu/SylReg-Decoder with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-to-speech", model="ryota-komatsu/SylReg-Decoder")# Load model directly from transformers import FlowMatchingWithBigVGan model = FlowMatchingWithBigVGan.from_pretrained("ryota-komatsu/SylReg-Decoder", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Add pipeline tag, paper link, and citation to model card
#1
by nielsr HF Staff - opened
README.md
CHANGED
|
@@ -1,24 +1,24 @@
|
|
| 1 |
---
|
| 2 |
-
library_name: transformers
|
| 3 |
-
license: cc-by-nc-sa-4.0
|
| 4 |
-
language:
|
| 5 |
-
- en
|
| 6 |
base_model:
|
| 7 |
- ryota-komatsu/SylReg-Decoder-Base
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 8 |
---
|
| 9 |
|
| 10 |
# SylReg-Decoder
|
| 11 |
|
| 12 |
-
|
| 13 |
-
|
| 14 |
|
|
|
|
|
|
|
| 15 |
|
| 16 |
## Model Details
|
| 17 |
|
| 18 |
### Model Description
|
| 19 |
|
| 20 |
-
<!-- Provide a longer summary of what this model is. -->
|
| 21 |
-
|
| 22 |
- **Model type:** Flow-matching-based Diffusion Transformer (DiT) with BigVGAN-v2
|
| 23 |
- **Language(s) (NLP):** English
|
| 24 |
- **License:** CC BY-NC-SA 4.0
|
|
@@ -26,8 +26,6 @@ base_model:
|
|
| 26 |
|
| 27 |
### Model Sources
|
| 28 |
|
| 29 |
-
<!-- Provide the basic links for the model. -->
|
| 30 |
-
|
| 31 |
- **Repository:** [Code](https://github.com/ryota-komatsu/speaker_disentangled_hubert)
|
| 32 |
- **Demo:** [Project page](https://ryota-komatsu.github.io/speaker_disentangled_hubert)
|
| 33 |
|
|
@@ -80,8 +78,6 @@ generated_speech = decoder(units.unsqueeze(0)).waveform.cpu()
|
|
| 80 |
|
| 81 |
### Training Data
|
| 82 |
|
| 83 |
-
<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
|
| 84 |
-
|
| 85 |
| | License | Provider |
|
| 86 |
| --- | --- | --- |
|
| 87 |
| [LibriTTS-R](https://www.openslr.org/141/) | CC BY 4.0 | Y. Koizumi *et al.* |
|
|
@@ -93,4 +89,17 @@ generated_speech = decoder(units.unsqueeze(0)).waveform.cpu()
|
|
| 93 |
|
| 94 |
## Hardware
|
| 95 |
|
| 96 |
-
2 x A6000
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
| 2 |
base_model:
|
| 3 |
- ryota-komatsu/SylReg-Decoder-Base
|
| 4 |
+
language:
|
| 5 |
+
- en
|
| 6 |
+
library_name: transformers
|
| 7 |
+
license: cc-by-nc-sa-4.0
|
| 8 |
+
pipeline_tag: text-to-speech
|
| 9 |
---
|
| 10 |
|
| 11 |
# SylReg-Decoder
|
| 12 |
|
| 13 |
+
This repository contains the decoder model presented in the paper [Speaker-Disentangled Chunk-Wise Regression for Syllabic Tokenization](https://huggingface.co/papers/2607.04064).
|
|
|
|
| 14 |
|
| 15 |
+
- **Project Page:** https://ryota-komatsu.github.io/speaker_disentangled_hubert
|
| 16 |
+
- **Repository:** https://github.com/ryota-komatsu/speaker_disentangled_hubert
|
| 17 |
|
| 18 |
## Model Details
|
| 19 |
|
| 20 |
### Model Description
|
| 21 |
|
|
|
|
|
|
|
| 22 |
- **Model type:** Flow-matching-based Diffusion Transformer (DiT) with BigVGAN-v2
|
| 23 |
- **Language(s) (NLP):** English
|
| 24 |
- **License:** CC BY-NC-SA 4.0
|
|
|
|
| 26 |
|
| 27 |
### Model Sources
|
| 28 |
|
|
|
|
|
|
|
| 29 |
- **Repository:** [Code](https://github.com/ryota-komatsu/speaker_disentangled_hubert)
|
| 30 |
- **Demo:** [Project page](https://ryota-komatsu.github.io/speaker_disentangled_hubert)
|
| 31 |
|
|
|
|
| 78 |
|
| 79 |
### Training Data
|
| 80 |
|
|
|
|
|
|
|
| 81 |
| | License | Provider |
|
| 82 |
| --- | --- | --- |
|
| 83 |
| [LibriTTS-R](https://www.openslr.org/141/) | CC BY 4.0 | Y. Koizumi *et al.* |
|
|
|
|
| 89 |
|
| 90 |
## Hardware
|
| 91 |
|
| 92 |
+
2 x A6000
|
| 93 |
+
|
| 94 |
+
## Citation
|
| 95 |
+
|
| 96 |
+
```bibtex
|
| 97 |
+
@article{Komatsu_SylReg_2026,
|
| 98 |
+
author = {Komatsu, Ryota and Kawakita, Kota and Okamoto, Takuma and Shinozaki, Takahiro},
|
| 99 |
+
title = {Speaker-Disentangled Chunk-Wise Regression for Syllabic Tokenization},
|
| 100 |
+
year = {2026},
|
| 101 |
+
volume = {7},
|
| 102 |
+
journal = {IEEE Open Journal of Signal Processing},
|
| 103 |
+
pages = {},
|
| 104 |
+
}
|
| 105 |
+
```
|