X-Zhang commited on
Commit
b5ca0c5
·
verified ·
1 Parent(s): c90595f

Upload README.md

Browse files
Files changed (1) hide show
  1. README.md +11 -3
README.md CHANGED
@@ -14,15 +14,18 @@ datasets:
14
 
15
  These are hardware-agnostic FP32 generator state dictionaries for
16
  `DiffusionDITNetPartsFixedExpressions2PostNormInteraction2`. They were retrained
17
- on BEAT2 English with classifier-free condition dropout and selected with the
18
- released StreamTalk generation protocol plus the official EMAGE/PantoMatrix
19
- AESK FGD metric.
20
 
21
  | File | Intended role | Epoch | CFG | Speaker2 FGD | All FGD |
22
  | --- | --- | ---: | ---: | ---: | ---: |
23
  | `streamtalk_speaker2_combined_e0946_cfg3.pt` | Speaker2 and combined | 946 | 3 | 0.378879 | 0.250287 |
24
  | `streamtalk_speaker_all_e0940_cfg3.pt` | All speakers | 940 | 3 | 0.424477 | 0.217672 |
25
 
 
 
 
26
  The checkpoints contain 407 CPU FP32 tensors and 71,167,501 parameters. Both
27
  load strictly into the originally released StreamTalk model schema. H200,
28
  BF16, CUDA Graphs, and four-GPU execution were training/evaluation
@@ -34,6 +37,11 @@ was selected for engineering comparisons, but the final CFG=3 values have not
34
  been accepted against a direct B=1/M=1/full-window oracle. BC and DIV have not
35
  been re-evaluated for these retrained checkpoints.
36
 
 
 
 
 
 
37
  Verify downloads before loading:
38
 
39
  ```bash
 
14
 
15
  These are hardware-agnostic FP32 generator state dictionaries for
16
  `DiffusionDITNetPartsFixedExpressions2PostNormInteraction2`. They were retrained
17
+ on BEAT2 English with classifier-free condition dropout and selected with an
18
+ accelerated H200 implementation of the StreamTalk generation procedure plus
19
+ the official EMAGE/PantoMatrix AESK FGD metric.
20
 
21
  | File | Intended role | Epoch | CFG | Speaker2 FGD | All FGD |
22
  | --- | --- | ---: | ---: | ---: | ---: |
23
  | `streamtalk_speaker2_combined_e0946_cfg3.pt` | Speaker2 and combined | 946 | 3 | 0.378879 | 0.250287 |
24
  | `streamtalk_speaker_all_e0940_cfg3.pt` | All speakers | 940 | 3 | 0.424477 | 0.217672 |
25
 
26
+ The combined selection score is
27
+ `max(Speaker2 FGD / 0.383, All FGD / 0.293)`.
28
+
29
  The checkpoints contain 407 CPU FP32 tensors and 71,167,501 parameters. Both
30
  load strictly into the originally released StreamTalk model schema. H200,
31
  BF16, CUDA Graphs, and four-GPU execution were training/evaluation
 
37
  been accepted against a direct B=1/M=1/full-window oracle. BC and DIV have not
38
  been re-evaluated for these retrained checkpoints.
39
 
40
+ The published inference NPZ bytes were independently re-scored with the
41
+ released scorer (metric batch 16): Speaker 2 `0.3788789702354345`; all speakers
42
+ `0.21764184426140076`. These differ from the selection-time values by about
43
+ `7e-15` and `2.97e-5`, respectively.
44
+
45
  Verify downloads before loading:
46
 
47
  ```bash