Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
|
@@ -3,19 +3,19 @@
|
|
| 3 |
Complete R16 speech tokenizer stack. Paired SLM: `Streamalign-SLM-R16`
|
| 4 |
(reported metrics: SALMon 69.1, StoryCloze 72.1).
|
| 5 |
|
| 6 |
-
## Contents &
|
| 7 |
|
| 8 |
| Path | Role |
|
| 9 |
|------|------|
|
| 10 |
-
| `rvq_teacher/
|
| 11 |
-
| `alignment_model/` | Char-level streaming Conformer-Transducer
|
| 12 |
-
| `streaming_asr/` | Word-level streaming Conformer-Transducer
|
| 13 |
| `boundary_classifier/` | Word-boundary detector for streaming chunking; consumes `streaming_asr`. R-independent. |
|
| 14 |
-
| `alignment.yaml` |
|
| 15 |
|
| 16 |
## Pipeline
|
| 17 |
audio -> `streaming_asr` (word chunks + TextGrids) + `boundary_classifier`
|
| 18 |
-> `alignment_model` scaffold + `rvq_teacher` encoder -> R16 RVQ units.
|
| 19 |
|
| 20 |
-
Only `rvq_teacher
|
| 21 |
-
|
|
|
|
| 3 |
Complete R16 speech tokenizer stack. Paired SLM: `Streamalign-SLM-R16`
|
| 4 |
(reported metrics: SALMon 69.1, StoryCloze 72.1).
|
| 5 |
|
| 6 |
+
## Contents & roles
|
| 7 |
|
| 8 |
| Path | Role |
|
| 9 |
|------|------|
|
| 10 |
+
| `rvq_teacher/` | The acoustic tokenizer: the streaming encoder plus the R16 residual-VQ quantizer. Produces the R16 speech units. R16-specific. |
|
| 11 |
+
| `alignment_model/` | Char-level streaming Conformer-Transducer. Base scaffold the tokenizer is built on; supplies the RNN-T predictor/joiner for char-level alignment. R-independent. |
|
| 12 |
+
| `streaming_asr/` | Word-level streaming Conformer-Transducer. Generates the chunk TextGrids (word alignment) and drives the boundary classifier. R-independent. |
|
| 13 |
| `boundary_classifier/` | Word-boundary detector for streaming chunking; consumes `streaming_asr`. R-independent. |
|
| 14 |
+
| `alignment.yaml` | Extractor / `alignment_model` hparams. |
|
| 15 |
|
| 16 |
## Pipeline
|
| 17 |
audio -> `streaming_asr` (word chunks + TextGrids) + `boundary_classifier`
|
| 18 |
-> `alignment_model` scaffold + `rvq_teacher` encoder -> R16 RVQ units.
|
| 19 |
|
| 20 |
+
Only `rvq_teacher` is R16-specific; the ASR / alignment / boundary
|
| 21 |
+
components are shared across R8/R16/R32.
|