Upload README.md
Browse files
README.md
CHANGED
|
@@ -14,15 +14,18 @@ datasets:
|
|
| 14 |
|
| 15 |
These are hardware-agnostic FP32 generator state dictionaries for
|
| 16 |
`DiffusionDITNetPartsFixedExpressions2PostNormInteraction2`. They were retrained
|
| 17 |
-
on BEAT2 English with classifier-free condition dropout and selected with
|
| 18 |
-
|
| 19 |
-
AESK FGD metric.
|
| 20 |
|
| 21 |
| File | Intended role | Epoch | CFG | Speaker2 FGD | All FGD |
|
| 22 |
| --- | --- | ---: | ---: | ---: | ---: |
|
| 23 |
| `streamtalk_speaker2_combined_e0946_cfg3.pt` | Speaker2 and combined | 946 | 3 | 0.378879 | 0.250287 |
|
| 24 |
| `streamtalk_speaker_all_e0940_cfg3.pt` | All speakers | 940 | 3 | 0.424477 | 0.217672 |
|
| 25 |
|
|
|
|
|
|
|
|
|
|
| 26 |
The checkpoints contain 407 CPU FP32 tensors and 71,167,501 parameters. Both
|
| 27 |
load strictly into the originally released StreamTalk model schema. H200,
|
| 28 |
BF16, CUDA Graphs, and four-GPU execution were training/evaluation
|
|
@@ -34,6 +37,11 @@ was selected for engineering comparisons, but the final CFG=3 values have not
|
|
| 34 |
been accepted against a direct B=1/M=1/full-window oracle. BC and DIV have not
|
| 35 |
been re-evaluated for these retrained checkpoints.
|
| 36 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 37 |
Verify downloads before loading:
|
| 38 |
|
| 39 |
```bash
|
|
|
|
| 14 |
|
| 15 |
These are hardware-agnostic FP32 generator state dictionaries for
|
| 16 |
`DiffusionDITNetPartsFixedExpressions2PostNormInteraction2`. They were retrained
|
| 17 |
+
on BEAT2 English with classifier-free condition dropout and selected with an
|
| 18 |
+
accelerated H200 implementation of the StreamTalk generation procedure plus
|
| 19 |
+
the official EMAGE/PantoMatrix AESK FGD metric.
|
| 20 |
|
| 21 |
| File | Intended role | Epoch | CFG | Speaker2 FGD | All FGD |
|
| 22 |
| --- | --- | ---: | ---: | ---: | ---: |
|
| 23 |
| `streamtalk_speaker2_combined_e0946_cfg3.pt` | Speaker2 and combined | 946 | 3 | 0.378879 | 0.250287 |
|
| 24 |
| `streamtalk_speaker_all_e0940_cfg3.pt` | All speakers | 940 | 3 | 0.424477 | 0.217672 |
|
| 25 |
|
| 26 |
+
The combined selection score is
|
| 27 |
+
`max(Speaker2 FGD / 0.383, All FGD / 0.293)`.
|
| 28 |
+
|
| 29 |
The checkpoints contain 407 CPU FP32 tensors and 71,167,501 parameters. Both
|
| 30 |
load strictly into the originally released StreamTalk model schema. H200,
|
| 31 |
BF16, CUDA Graphs, and four-GPU execution were training/evaluation
|
|
|
|
| 37 |
been accepted against a direct B=1/M=1/full-window oracle. BC and DIV have not
|
| 38 |
been re-evaluated for these retrained checkpoints.
|
| 39 |
|
| 40 |
+
The published inference NPZ bytes were independently re-scored with the
|
| 41 |
+
released scorer (metric batch 16): Speaker 2 `0.3788789702354345`; all speakers
|
| 42 |
+
`0.21764184426140076`. These differ from the selection-time values by about
|
| 43 |
+
`7e-15` and `2.97e-5`, respectively.
|
| 44 |
+
|
| 45 |
Verify downloads before loading:
|
| 46 |
|
| 47 |
```bash
|