owensong commited on
Commit
d133c91
·
verified ·
1 Parent(s): 9f539a2

Document completed native24 evaluation and audio provenance

Browse files
EVALUATION.md ADDED
@@ -0,0 +1,54 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # Mini Native24 Evaluation
2
+
3
+ Full corpus: 1,688 texts x six voices = 10,128 clips.
4
+
5
+ These are completed local reproductions on a repeatedly used known/development corpus, not an official submission, a new independent test, or certified training-disjoint evidence.
6
+
7
+ ## Configuration
8
+
9
+ Evaluated public revision: `9f539a24df04fe28e3d4507934b813d6654ddb2e`.
10
+ Original/base speech, native 24 kHz, PCM16 recording, seed 42, all six fixed voices. No events, enhancer, VoiceTuner or pitch polish; core weights are unchanged.
11
+
12
+ ## Word Error Rate
13
+
14
+ WER is **percent; lower is better**. Qwen3-ASR-1.7B uses the pinned official-source normalizer, scorer and corpus units, without a reference-text prompt. This is not an official leaderboard run.
15
+
16
+ ### Local execution recipe
17
+
18
+ Each voice job calls the pinned official transcriber on consecutive blocks of up to **24 rows**. Official duration sorting is applied **within each block manifest**, with batch size **8**, at most **256 new tokens**, a **30-second audio cap**, and **BF16 CUDA** inference. This is not duration sorting of the entire job as one global manifest.
19
+
20
+ Execution used a local **NVIDIA RTX 5090**, not the upstream reference/default **NVIDIA H200**. The shared metric normalizer/source does not establish bit-for-bit equivalence to the official whole-manifest execution, a leaderboard submission, or a rank.
21
+
22
+ | Aggregate | WER % |
23
+ | --- | ---: |
24
+ | Equal dataset, then equal six-voice mean | 0.739006 |
25
+ | Pooled word counts (separate) | 0.875043 |
26
+
27
+ Pooled counts: 1114 edits / 127308 reference words. Full and subset scopes are never mixed.
28
+
29
+ | Voice | CV3 % | Seed-TTS % | MiniMax % | Dataset mean % |
30
+ | --- | ---: | ---: | ---: | ---: |
31
+ | hope | 1.220008 | 0.736957 | 0.263158 | 0.740041 |
32
+ | sophia | 1.152230 | 0.820702 | 0.210526 | 0.727819 |
33
+ | cassidy | 1.179341 | 0.762080 | 0.263158 | 0.734860 |
34
+ | james | 1.043785 | 0.862574 | 0.315789 | 0.740716 |
35
+ | jasper | 1.111563 | 0.812327 | 0.263158 | 0.729016 |
36
+ | mark | 1.098007 | 0.870949 | 0.315789 | 0.761582 |
37
+
38
+ ## Objective Quality Proxies
39
+
40
+ A separately frozen 180-clip panel (30 per voice), reused without resynthesis. These are objective model scores, **not human MOS** or a claim of superior audible quality. Scoring uses a 30-second per-clip cap; UTMOSv2 averages three seeded predictions per clip.
41
+
42
+ | Proxy | Six-voice mean | Clips |
43
+ | --- | ---: | ---: |
44
+ | UTMOS22Strong | 4.478976 | 180 |
45
+ | UTMOSv2 | 3.916612 | 180 |
46
+
47
+ ## Evidence and Limits
48
+
49
+ Machine-readable counts, scope and receipt hashes: [evaluation.json](evaluation.json).
50
+ Objective-quality proof includes each metric's reader-admission hash, independently pinned asset/source receipts and weight hashes; UTMOSv2 additionally records its verified runtime/source-tree receipt. These are saved pre-scoring checks, not a new remote-payload audit by this publication step.
51
+ The known corpus has informed prior development. Reusing fixed voices and texts does not establish generalization, cloning quality, or all-platform compatibility.
52
+ Saved receipts and arithmetic checked; this preparation does not rerun ASR, official normalization/alignment, quality models, or human listening. No official leaderboard submission.
53
+
54
+ Saved audio sample inputs and container identities are separate: [audio provenance](assets/audio-provenance.json).
README.md CHANGED
@@ -21,7 +21,7 @@ Six English presets, optional 48 kHz enhancement, and Voice Tuner for reference-
21
 
22
  <p align="center"><a href="#quickstart"><img alt="Quickstart" src="https://img.shields.io/badge/Quickstart-0B2A54?style=for-the-badge&amp;logo=python&amp;logoColor=white"></a>
23
  <a href="#six-voices"><img alt="Voice demos" src="https://img.shields.io/badge/Voice_Demos-1769E0?style=for-the-badge&amp;logo=huggingface&amp;logoColor=white"></a>
24
- <a href="#voice-tuner"><img alt="Voice Tuner" src="https://img.shields.io/badge/Voice_Tuner-FFFFFF?style=for-the-badge&amp;logoColor=1769E0"></a>
25
  <a href="https://github.com/owenawsong/Inflect"><img alt="GitHub" src="https://img.shields.io/badge/GitHub-0B2A54?style=for-the-badge&amp;logo=github&amp;logoColor=white"></a>
26
  <a href="https://discord.gg/CVJYedvzvp"><img alt="Discord" src="https://img.shields.io/badge/Discord-1769E0?style=for-the-badge&amp;logo=discord&amp;logoColor=white"></a></p>
27
 
@@ -30,6 +30,10 @@ Native 24 kHz &nbsp;&middot;&nbsp; Optional compact 48 kHz &nbsp;&middot;&nbsp;
30
 
31
  ## Quickstart
32
 
 
 
 
 
33
  Use Python 3.12 and download the complete repository, not just the weight file:
34
 
35
  ```sh
@@ -87,7 +91,7 @@ Start with Cassidy and Mark, then find your preferred voice. These are native
87
  </div>
88
  </div>
89
 
90
- <sub>Generated samples, not reference recordings. Inputs and audio identities: <a href="assets/presentation-evidence.json">sample provenance</a>.</sub>
91
 
92
  ## Optional 48 kHz
93
 
@@ -106,6 +110,8 @@ Compare the same Cassidy generation:
106
  [native 24 kHz](https://huggingface.co/owensong/Inflect-Mini-v3/resolve/main/media/mini-cassidy.wav)
107
  and [enhanced 48 kHz](https://huggingface.co/owensong/Inflect-Mini-v3/resolve/main/media/mini-cassidy-48k.wav).
108
 
 
 
109
  ## Event tags
110
 
111
  Add a laugh, sigh, gasp or cough to Cassidy speech:
@@ -152,6 +158,8 @@ downloads with their own terms. [Voice Tuner guide](extras/tuner/README.md) and
152
 
153
  ## Model family
154
 
 
 
155
  | Model | Core parameters | Native output | Role |
156
  | :--- | ---: | :--- | :--- |
157
  | **Mini v3** | **34.31M** | 24 kHz | Six voices with optional enhancement, events and Voice Tuner |
@@ -162,6 +170,21 @@ Mini's core weight file is **138,388,547 bytes**. Weight size is not the complet
162
  download size or runtime memory requirement; frontend assets, dependencies and
163
  optional components are additional.
164
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
165
  ## Usage notes
166
 
167
  Mini is an English speech model. Review difficult names, numbers and long
 
21
 
22
  <p align="center"><a href="#quickstart"><img alt="Quickstart" src="https://img.shields.io/badge/Quickstart-0B2A54?style=for-the-badge&amp;logo=python&amp;logoColor=white"></a>
23
  <a href="#six-voices"><img alt="Voice demos" src="https://img.shields.io/badge/Voice_Demos-1769E0?style=for-the-badge&amp;logo=huggingface&amp;logoColor=white"></a>
24
+ <a href="#voice-tuner"><img alt="Voice Tuner (white text on navy)" src="https://img.shields.io/badge/Voice_Tuner-0B2A54?style=for-the-badge&amp;logoColor=white"></a>
25
  <a href="https://github.com/owenawsong/Inflect"><img alt="GitHub" src="https://img.shields.io/badge/GitHub-0B2A54?style=for-the-badge&amp;logo=github&amp;logoColor=white"></a>
26
  <a href="https://discord.gg/CVJYedvzvp"><img alt="Discord" src="https://img.shields.io/badge/Discord-1769E0?style=for-the-badge&amp;logo=discord&amp;logoColor=white"></a></p>
27
 
 
30
 
31
  ## Quickstart
32
 
33
+ Use a **fresh Python 3.12 environment outside the verified package**.
34
+ Keep environment files, profiles and generated audio outside the download.
35
+
36
+
37
  Use Python 3.12 and download the complete repository, not just the weight file:
38
 
39
  ```sh
 
91
  </div>
92
  </div>
93
 
94
+ <sub>Generated samples, not reference recordings. Inputs and audio identities: <a href="assets/audio-provenance.json">sample provenance</a>.</sub>
95
 
96
  ## Optional 48 kHz
97
 
 
110
  [native 24 kHz](https://huggingface.co/owensong/Inflect-Mini-v3/resolve/main/media/mini-cassidy.wav)
111
  and [enhanced 48 kHz](https://huggingface.co/owensong/Inflect-Mini-v3/resolve/main/media/mini-cassidy-48k.wav).
112
 
113
+ <audio controls preload="metadata" style="width:100%;max-width:300px" src="https://huggingface.co/owensong/Inflect-Mini-v3/resolve/main/media/mini-cassidy-48k.wav" aria-label="Mini Cassidy enhanced 48 kHz voice sample"></audio>
114
+
115
  ## Event tags
116
 
117
  Add a laugh, sigh, gasp or cough to Cassidy speech:
 
158
 
159
  ## Model family
160
 
161
+ [Explore the official Inflect v3 collection](https://huggingface.co/collections/owensong/inflect-v3-6af4bac50af427aeaac77cc6).
162
+
163
  | Model | Core parameters | Native output | Role |
164
  | :--- | ---: | :--- | :--- |
165
  | **Mini v3** | **34.31M** | 24 kHz | Six voices with optional enhancement, events and Voice Tuner |
 
170
  download size or runtime memory requirement; frontend assets, dependencies and
171
  optional components are additional.
172
 
173
+ ## Evaluation
174
+
175
+ Completed native24 base-speech results on the **full 1,688-text corpus x six voices**. Known development corpus; not an official submission or a new independent test. WER is percent (lower is better); quality proxies are not human MOS.
176
+
177
+ | Metric | Result | Clips |
178
+ | --- | ---: | ---: |
179
+ | WER %, equal dataset then equal voice mean | 0.739006 | 10128 |
180
+ | WER %, pooled word counts (separate) | 0.875043 | 10128 |
181
+ | UTMOS22Strong, objective score | 4.478976 | 180 |
182
+ | UTMOSv2, objective score | 3.916612 | 180 |
183
+
184
+ Quality uses a separate **180-clip panel**, 30 clips per voice. Full and subset WER scopes are labeled above.
185
+
186
+ [Evaluation and methodology](EVALUATION.md) / [Machine-readable results](evaluation.json) / [Audio provenance](assets/audio-provenance.json).
187
+
188
  ## Usage notes
189
 
190
  Mini is an English speech model. Review difficult names, numbers and long
assets/audio-provenance-historical.json ADDED
@@ -0,0 +1,99 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "audio": [
3
+ {
4
+ "bytes": 321680,
5
+ "channels": 1,
6
+ "frames": 80400,
7
+ "historical_media_path": "media/mini-cassidy.wav",
8
+ "profile": "base",
9
+ "sample_rate": 24000,
10
+ "seconds": 3.35,
11
+ "sha256": "0fd1fb2b1e749d8d1b62c3ef4e6fb4c8a183e33f37fac9d78950a91582435006",
12
+ "subtype": "FLOAT",
13
+ "text": "Could you bring the smaller suitcase downstairs?",
14
+ "voice": "cassidy"
15
+ },
16
+ {
17
+ "bytes": 487280,
18
+ "channels": 1,
19
+ "frames": 121800,
20
+ "historical_media_path": "media/mini-mark.wav",
21
+ "profile": "base",
22
+ "sample_rate": 24000,
23
+ "seconds": 5.075,
24
+ "sha256": "6db39b8680105bd321d61e4a9a4d8d21dd16a176f8076d9127738be5d15ac970",
25
+ "subtype": "FLOAT",
26
+ "text": "Beyond the orchard, a narrow footpath curved toward the ruined tower.",
27
+ "voice": "mark"
28
+ },
29
+ {
30
+ "bytes": 429680,
31
+ "channels": 1,
32
+ "frames": 107400,
33
+ "historical_media_path": "media/mini-hope.wav",
34
+ "profile": "base",
35
+ "sample_rate": 24000,
36
+ "seconds": 4.475,
37
+ "sha256": "63d96ec424d2ae9c21cdc2d603c3fa46fb1b8a3f53c74186d0c16e6ee7698063",
38
+ "subtype": "FLOAT",
39
+ "text": "Press the side button once, then wait until the indicator turns green.",
40
+ "voice": "hope"
41
+ },
42
+ {
43
+ "bytes": 489680,
44
+ "channels": 1,
45
+ "frames": 122400,
46
+ "historical_media_path": "media/mini-james.wav",
47
+ "profile": "base",
48
+ "sample_rate": 24000,
49
+ "seconds": 5.1,
50
+ "sha256": "7428c06e88ff7d955e9c893c4a7620b2a02dc03da80372820a2122f07c7ded1b",
51
+ "subtype": "FLOAT",
52
+ "text": "A shadow becomes longer when the light source moves closer to the horizon.",
53
+ "voice": "james"
54
+ },
55
+ {
56
+ "bytes": 367280,
57
+ "channels": 1,
58
+ "frames": 91800,
59
+ "historical_media_path": "media/mini-sophia.wav",
60
+ "profile": "base",
61
+ "sample_rate": 24000,
62
+ "seconds": 3.825,
63
+ "sha256": "25c6054f38f9fd83ff45f03fb0c27e0fdc5024622bb8d38bc9941921f5b3f365",
64
+ "subtype": "FLOAT",
65
+ "text": "We moved the chairs inside and wiped the wooden table dry.",
66
+ "voice": "sophia"
67
+ },
68
+ {
69
+ "bytes": 420080,
70
+ "channels": 1,
71
+ "frames": 105000,
72
+ "historical_media_path": "media/mini-jasper.wav",
73
+ "profile": "base",
74
+ "sample_rate": 24000,
75
+ "seconds": 4.375,
76
+ "sha256": "4c1b9a5e19b9da84a50cb0f1748c9b7b0337b101da38a69c3cd3afc1da105c0b",
77
+ "subtype": "FLOAT",
78
+ "text": "I thought you were arriving tomorrow, but it is lovely to see you.",
79
+ "voice": "jasper"
80
+ },
81
+ {
82
+ "bytes": 643280,
83
+ "channels": 1,
84
+ "frames": 160800,
85
+ "historical_media_path": "media/mini-cassidy-48k.wav",
86
+ "profile": "enhanced",
87
+ "sample_rate": 48000,
88
+ "seconds": 3.35,
89
+ "sha256": "14d7eb456f23a4779c623523cc1be4a5b9efbbd3b223e5a9d442e785171cb1b0",
90
+ "subtype": "FLOAT",
91
+ "text": "Could you bring the smaller suitcase downstairs?",
92
+ "voice": "cassidy"
93
+ }
94
+ ],
95
+ "model": "Mini",
96
+ "schema": "inflect-historical-audio-provenance-v1",
97
+ "scope": "Historical sample container identities, not current media links or a claim of current-public-CLI equivalence. Current media filenames identify separate fresh recordings. Full historical evidence is retained unchanged locally; existing base-repository evidence is not removed.",
98
+ "source_provenance_sha256": "85115530df55d3d55b03c8633c087a950ef060ec6db1a14aea070785a0042fb1"
99
+ }
assets/audio-provenance.json ADDED
@@ -0,0 +1,121 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "audio": [
3
+ {
4
+ "bytes": 160844,
5
+ "channels": 1,
6
+ "frames": 80400,
7
+ "path": "media/mini-cassidy.wav",
8
+ "profile": "base",
9
+ "sample_rate": 24000,
10
+ "seconds": 3.35,
11
+ "seed": 42,
12
+ "sha256": "ecf10e95b951c66facf75049ffe423a073b2f0de002de4a220ace75e8aed69bb",
13
+ "subtype": "PCM_16",
14
+ "text": "Could you bring the smaller suitcase downstairs?",
15
+ "text_utf8_sha256": "d0d854372884ee155684a8f530447e945f644fc38fd04cfe83b46437e845a509",
16
+ "voice": "cassidy"
17
+ },
18
+ {
19
+ "bytes": 243644,
20
+ "channels": 1,
21
+ "frames": 121800,
22
+ "path": "media/mini-mark.wav",
23
+ "profile": "base",
24
+ "sample_rate": 24000,
25
+ "seconds": 5.075,
26
+ "seed": 42,
27
+ "sha256": "519dc95ce67ddb1028a4889f5a0f85d0a3811f7d14f3c1a7e61b60ece3ccbf9c",
28
+ "subtype": "PCM_16",
29
+ "text": "Beyond the orchard, a narrow footpath curved toward the ruined tower.",
30
+ "text_utf8_sha256": "656c7108ba1ac859c36f204e111a38a070ec1a9fd3c4a1cc863da23cdae3ce20",
31
+ "voice": "mark"
32
+ },
33
+ {
34
+ "bytes": 214844,
35
+ "channels": 1,
36
+ "frames": 107400,
37
+ "path": "media/mini-hope.wav",
38
+ "profile": "base",
39
+ "sample_rate": 24000,
40
+ "seconds": 4.475,
41
+ "seed": 42,
42
+ "sha256": "d444a7e7d8caa08b5b9723f08e0447132b461b3757bdc7f4da82a0ca7433a359",
43
+ "subtype": "PCM_16",
44
+ "text": "Press the side button once, then wait until the indicator turns green.",
45
+ "text_utf8_sha256": "feaf6b86e4017ce08cf64a11fc10ad3c8fa9b9a44ad51eed1bf86d7cf34339e6",
46
+ "voice": "hope"
47
+ },
48
+ {
49
+ "bytes": 244844,
50
+ "channels": 1,
51
+ "frames": 122400,
52
+ "path": "media/mini-james.wav",
53
+ "profile": "base",
54
+ "sample_rate": 24000,
55
+ "seconds": 5.1,
56
+ "seed": 42,
57
+ "sha256": "f19e704d962cada4d1631fb439b813717114bcd450da2f20e9635820afe0d8a3",
58
+ "subtype": "PCM_16",
59
+ "text": "A shadow becomes longer when the light source moves closer to the horizon.",
60
+ "text_utf8_sha256": "806c0d5c3bb1dfbf12f41cba54d4ebe24814f5e7b1ad755c055eab20b38e89d6",
61
+ "voice": "james"
62
+ },
63
+ {
64
+ "bytes": 183644,
65
+ "channels": 1,
66
+ "frames": 91800,
67
+ "path": "media/mini-sophia.wav",
68
+ "profile": "base",
69
+ "sample_rate": 24000,
70
+ "seconds": 3.825,
71
+ "seed": 42,
72
+ "sha256": "0b287830a021088f187fa50b929b6a6857d60051e226277822743e36638c7df9",
73
+ "subtype": "PCM_16",
74
+ "text": "We moved the chairs inside and wiped the wooden table dry.",
75
+ "text_utf8_sha256": "e1ac396d2b232af45b03283e003d0fded51fa4ac96877a2fe9ae7ae142186384",
76
+ "voice": "sophia"
77
+ },
78
+ {
79
+ "bytes": 211244,
80
+ "channels": 1,
81
+ "frames": 105600,
82
+ "path": "media/mini-jasper.wav",
83
+ "profile": "base",
84
+ "sample_rate": 24000,
85
+ "seconds": 4.4,
86
+ "seed": 42,
87
+ "sha256": "749c37683a159ff4382f766ecb4223cd5f9d201b7625a0485f1469d3664b7233",
88
+ "subtype": "PCM_16",
89
+ "text": "I thought you were arriving tomorrow, but it is lovely to see you.",
90
+ "text_utf8_sha256": "5518af29efbca9ceaf1fedf4d7c7fc6d49dd717fd59bf6aacd8acf1dbf4c4b46",
91
+ "voice": "jasper"
92
+ },
93
+ {
94
+ "bytes": 321644,
95
+ "channels": 1,
96
+ "frames": 160800,
97
+ "path": "media/mini-cassidy-48k.wav",
98
+ "profile": "enhanced",
99
+ "sample_rate": 48000,
100
+ "seconds": 3.35,
101
+ "seed": 42,
102
+ "sha256": "026b630c677db87402b07dfa5def996151ac4d70bc578b4a5da3667c41d0a67c",
103
+ "subtype": "PCM_16",
104
+ "text": "Could you bring the smaller suitcase downstairs?",
105
+ "text_utf8_sha256": "d0d854372884ee155684a8f530447e945f644fc38fd04cfe83b46437e845a509",
106
+ "voice": "cassidy"
107
+ }
108
+ ],
109
+ "generator_sha256": "6a0d1e32eee01cdf72570cad7bf2239b1708c1de845b97020a0f57d66f649fe3",
110
+ "historical_evidence": "audio-provenance-historical.json",
111
+ "model": "Mini",
112
+ "package": {
113
+ "manifest": "release-manifest.json",
114
+ "manifest_sha256": "5d748fc069c95da5106f58208df7bef58fbb2d5ec4ef129430b3e150fb4156b9",
115
+ "repo": "owensong/Inflect-Mini-v3",
116
+ "revision": "9f539a24df04fe28e3d4507934b813d6654ddb2e"
117
+ },
118
+ "schema": "inflect-fresh-public-cli-audio-provenance-v1",
119
+ "scope": "Illustrative audio demos, not benchmark results or human-review evidence. Recorded with the public root CLIs at the tested package revision and manifest shown here. WAV bytes, frames, rates and codecs checked against retained source receipts; no audio reencoding.",
120
+ "source_provenance_sha256": "4649de026410621a3b0f5cfdecf82841db103182110d86a612df612c3c11ad0b"
121
+ }
config.json ADDED
@@ -0,0 +1,160 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "cli_entrypoints": {
3
+ "events": [
4
+ "python",
5
+ "run.py",
6
+ "events"
7
+ ],
8
+ "speech": [
9
+ "python",
10
+ "run.py",
11
+ "speech"
12
+ ],
13
+ "tuner_enroll": [
14
+ "python",
15
+ "tuner.py",
16
+ "enroll"
17
+ ],
18
+ "tuner_say": [
19
+ "python",
20
+ "tuner.py",
21
+ "say"
22
+ ],
23
+ "verify": [
24
+ "python",
25
+ "verify_release.py"
26
+ ]
27
+ },
28
+ "core_asset": "core/baseline/models/mini/weights.pt",
29
+ "core_parameters": 34310790,
30
+ "descriptor_scope": "Informational Inflect package descriptor, not a runtime model configuration. Use the bundled CLI and complete verified package; this file does not select a delivery profile.",
31
+ "features": {
32
+ "optional_components": {
33
+ "enhancement": {
34
+ "cli_profiles": [
35
+ "enhanced",
36
+ "combined"
37
+ ],
38
+ "input_sample_rate": 24000,
39
+ "output_sample_rate": 48000,
40
+ "parameters": 2846722,
41
+ "scope": "Optional waveform enhancement; synthesis remains native 24 kHz",
42
+ "voice_ids": [
43
+ "hope",
44
+ "sophia",
45
+ "cassidy",
46
+ "james",
47
+ "jasper",
48
+ "mark"
49
+ ]
50
+ },
51
+ "events": {
52
+ "decoder_parameters": 13531650,
53
+ "devices": [
54
+ "cpu"
55
+ ],
56
+ "enhancement_supported": false,
57
+ "learned_control_values": 25600,
58
+ "sample_rate": 24000,
59
+ "scope": "Four fixed learned performances with speech around them; not general emotion control",
60
+ "tags": [
61
+ "[laugh]",
62
+ "[sigh]",
63
+ "[gasp]",
64
+ "[cough]"
65
+ ],
66
+ "voice_ids": [
67
+ "cassidy"
68
+ ]
69
+ },
70
+ "pitch": {
71
+ "cli_profiles": [
72
+ "pitch",
73
+ "combined"
74
+ ],
75
+ "parameters": 3801977,
76
+ "scope": "Optional Cassidy pitch component; other presets retain original pitch and timing",
77
+ "voice_ids": [
78
+ "cassidy"
79
+ ]
80
+ },
81
+ "voice_tuner": {
82
+ "enrollment_assets_additional": true,
83
+ "license_map": "extras/tuner/LICENSE-MAP.json",
84
+ "reference_seconds": [
85
+ 5,
86
+ 15
87
+ ],
88
+ "requirements": "extras/tuner/requirements-tuner-enrollment-cpu-20261110.txt",
89
+ "scope": "Authorized reference enrollment and saved-profile playback; not accurate zero-shot cloning. Resemblance is not guaranteed; enrollment assets have separate terms.",
90
+ "supported_setup": "Linux CPU",
91
+ "task": "reference-based voice adaptation"
92
+ }
93
+ },
94
+ "speech": {
95
+ "devices": [
96
+ "cpu",
97
+ "cuda"
98
+ ],
99
+ "languages": [
100
+ "en"
101
+ ],
102
+ "native_sample_rate": 24000,
103
+ "reference_audio_required": false,
104
+ "voice_ids": [
105
+ "hope",
106
+ "sophia",
107
+ "cassidy",
108
+ "james",
109
+ "jasper",
110
+ "mark"
111
+ ]
112
+ }
113
+ },
114
+ "licenses_by_path": {
115
+ "LICENSE.md": {
116
+ "license": "Apache-2.0",
117
+ "scope": "Inflect-owned code and weights; third-party terms remain separate"
118
+ },
119
+ "THIRD_PARTY_NOTICES.md": {
120
+ "scope": "Retained upstream component notices"
121
+ },
122
+ "core/LICENSES/Apache-2.0.txt": {
123
+ "license": "Apache-2.0",
124
+ "scope": "Retained license text"
125
+ },
126
+ "core/LICENSES/StyleTTS2-MIT.txt": {
127
+ "license": "MIT",
128
+ "scope": "StyleTTS2-derived upstream software"
129
+ },
130
+ "core/LICENSE_SCOPE.json": {
131
+ "scope": "Component-specific Inflect license scope"
132
+ },
133
+ "core/THIRD_PARTY_NOTICES.md": {
134
+ "scope": "Retained core upstream notices"
135
+ },
136
+ "extras/events/component/LICENSE_SCOPE.json": {
137
+ "scope": "Optional event component license scope"
138
+ },
139
+ "extras/events/component/WEIGHT_LICENSE_MAP.json": {
140
+ "scope": "Optional event asset license map"
141
+ },
142
+ "extras/tuner/LICENSE-MAP.json": {
143
+ "scope": "Optional enrollment and playback component terms, including Apache-2.0, embedded CC-BY-SA-3.0 encoder and GPL-3.0 dependency notices"
144
+ }
145
+ },
146
+ "model_id": "owensong/Inflect-Mini-v3",
147
+ "model_name": "Inflect Mini v3",
148
+ "native_sample_rate": 24000,
149
+ "parameter_scope": "Synthesis core only, not the complete text-to-speech pipeline. Frontend models, fixed conditioning, dependencies and optional components are additional; file size is not runtime memory.",
150
+ "schema": "inflect-package-descriptor",
151
+ "schema_version": 1,
152
+ "voice_ids": [
153
+ "hope",
154
+ "sophia",
155
+ "cassidy",
156
+ "james",
157
+ "jasper",
158
+ "mark"
159
+ ]
160
+ }
evaluation.json ADDED
@@ -0,0 +1,560 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "configuration": {
3
+ "enhancer": false,
4
+ "events": false,
5
+ "note": "",
6
+ "pitch_polish": false,
7
+ "profile": "base",
8
+ "raw_text_input": true,
9
+ "sample_rate": 24000,
10
+ "seed": 42,
11
+ "subtype": "PCM_16",
12
+ "voice_tuner": false
13
+ },
14
+ "core_weights_unchanged": true,
15
+ "corpus": "Known CV3 / Seed-TTS / MiniMax development corpus, 1688 source cases; not a new independent test",
16
+ "evaluated_revision": "9f539a24df04fe28e3d4507934b813d6654ddb2e",
17
+ "known_corpus_repeated_use": true,
18
+ "model": "Mini",
19
+ "objective_quality": {
20
+ "utmos22": {
21
+ "clips": 180,
22
+ "equal_voice_mean": 4.4789755611111115,
23
+ "per_voice_clips": 30,
24
+ "per_voice_mean": {
25
+ "cassidy": 4.4978588,
26
+ "hope": 4.513314566666667,
27
+ "james": 4.424281033333333,
28
+ "jasper": 4.4724901,
29
+ "mark": 4.457013066666667,
30
+ "sophia": 4.5088958
31
+ },
32
+ "proof": {
33
+ "admission_file": "jobs/mos-mini/reader-admission-utmos22.json",
34
+ "admission_sha256": "5995fe640d2cb00a722e27ebd810778a61d49e586f6ec2a4daa3e5d9c41af6b9",
35
+ "asset_pins": {
36
+ "/workspace/inflect-wer-focus-20261108-r003/utmos22.pt": "38aa51ab79e2a4e09a1449758a4b37e9cbb2e8235a49662a732d33a9ba1e9bff"
37
+ },
38
+ "evidence_limit": "Saved successful pre-scoring asset/source-hash admission checked against pinned receipts; this publisher does not rerun scoring or independently rehash remote model payloads.",
39
+ "model_weights_sha256": "38aa51ab79e2a4e09a1449758a4b37e9cbb2e8235a49662a732d33a9ba1e9bff",
40
+ "quality_wrapper_sha256": "5d702be61a0d59d698290ddb18a3a5e7be50fca742617f8dc456c068b9fe69d8",
41
+ "runtime_versions": {
42
+ "librosa": "0.11.0",
43
+ "numpy": "2.4.2",
44
+ "soundfile": "0.13.1",
45
+ "torch": "2.11.0+cu128",
46
+ "transformers": "5.2.0"
47
+ },
48
+ "source_pins": {
49
+ "/workspace/inflect-wer-focus-20261108-r003/SpeechMOS-v1.2.0/hubconf.py": "72dee4dfeecdb632663290155024ede7e50adef49d798f54750910acd93ca31d",
50
+ "/workspace/inflect-wer-focus-20261108-r003/SpeechMOS-v1.2.0/hubconf_test.py": "cc42a3d4bef5b2c8ab9e6120aa4df6db4011641a4000d73713ee8019c46f59d3",
51
+ "/workspace/inflect-wer-focus-20261108-r003/SpeechMOS-v1.2.0/speechmos/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
52
+ "/workspace/inflect-wer-focus-20261108-r003/SpeechMOS-v1.2.0/speechmos/utmos22/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
53
+ "/workspace/inflect-wer-focus-20261108-r003/SpeechMOS-v1.2.0/speechmos/utmos22/fairseq_alt.py": "f243661c1dd01bec87c32d869d67b7c72f1218b8362b12ae3e0bbe6ca8614e2f",
54
+ "/workspace/inflect-wer-focus-20261108-r003/SpeechMOS-v1.2.0/speechmos/utmos22/strong/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
55
+ "/workspace/inflect-wer-focus-20261108-r003/SpeechMOS-v1.2.0/speechmos/utmos22/strong/model.py": "c9631bdc42f4687eace749a7bf5bc283537e811ec2fe4bdacb373fadced3b751",
56
+ "/workspace/inflect-wer-focus-20261108-r003/SpeechMOS-v1.2.0/speechmos/utmos22/strong/model_test.py": "84d196d3733fb5bce9f66d0e645b351a88b8bd9ff8ba927d37b0949896be7ee2"
57
+ },
58
+ "verified_asset_receipt_sha256": "51c391fe0b6f6b7821fcd1a4dfc0a43f283c50610067317fe96c3fb6ee871f59",
59
+ "verified_source_receipt_sha256": "63ba72e31309389fc4dc9d7ff1df12ab56e53d6bbc0d8fb23734c42edefe73c1"
60
+ },
61
+ "type": "Objective quality proxy, not human MOS"
62
+ },
63
+ "utmosv2": {
64
+ "clips": 180,
65
+ "equal_voice_mean": 3.9166124131944446,
66
+ "per_voice_clips": 30,
67
+ "per_voice_mean": {
68
+ "cassidy": 3.9544053819444445,
69
+ "hope": 3.9528645833333336,
70
+ "james": 3.8993489583333334,
71
+ "jasper": 3.937261284722222,
72
+ "mark": 3.932052951388889,
73
+ "sophia": 3.8237413194444443
74
+ },
75
+ "proof": {
76
+ "admission_file": "jobs/mos-mini/reader-admission-utmosv2.json",
77
+ "admission_sha256": "68897e2743a4ef52cd44312afb222590c83ef891972f1dea8289303a7408a2e1",
78
+ "asset_pins": {
79
+ "/workspace/inflect-mini-acoustic-20261102-r001/assets/utmos-pinned/assets.json": "a2efc9d98a86afd11e70110cae31d1830f4a1d91f574a3448e6589d1f9437c21",
80
+ "/workspace/inflect-mini-acoustic-20261102-r001/assets/utmos-pinned/hub/models--facebook--wav2vec2-base/snapshots/0b5b8e868dd84f03fd87d01f9c4ff0f080fecfe8/config.json": "4937977e24d12d1bba70cdce8709c3c04807a8e4ae8ddac4229c48c436ae99ae",
81
+ "/workspace/inflect-mini-acoustic-20261102-r001/assets/utmos-pinned/hub/models--facebook--wav2vec2-base/snapshots/0b5b8e868dd84f03fd87d01f9c4ff0f080fecfe8/preprocessor_config.json": "b225d617c025463b9e157e06afea8b90dc7078fc70b013c533328423e0486b4a",
82
+ "/workspace/inflect-mini-acoustic-20261102-r001/assets/utmos-pinned/hub/models--facebook--wav2vec2-base/snapshots/0b5b8e868dd84f03fd87d01f9c4ff0f080fecfe8/pytorch_model.bin": "3249fe98bfc62fcbc26067f724716a6ec49d12c4728a2af1df659013905dff21",
83
+ "/workspace/inflect-mini-acoustic-20261102-r001/assets/utmos-pinned/hub/models--sarulab-speech--UTMOSv2/snapshots/506474f2b33dc77c234d668cc419be1861899cad/fold0_s42_best_model.pth": "c8149d988e4bbf3f347e6966b5d769de347a5f8c59ffca1dc4bd4bf5b8585e57",
84
+ "/workspace/inflect-mini-acoustic-20261102-r001/assets/utmos-pinned/hub/models--timm--tf_efficientnetv2_s.in21k_ft_in1k/snapshots/ea9abc143ea2b9d8e1ec1de277bce02149b9cf0e/config.json": "dc47b5c54ec8021e3ef2e02972d8c80ba91ec2fa6bf6b8e76566bf1a4f398c23",
85
+ "/workspace/inflect-mini-acoustic-20261102-r001/assets/utmos-pinned/hub/models--timm--tf_efficientnetv2_s.in21k_ft_in1k/snapshots/ea9abc143ea2b9d8e1ec1de277bce02149b9cf0e/model.safetensors": "6f1933fb6c0d760eae03863ad0110570393e16c0610f8fe94dc9f978e52ec59c"
86
+ },
87
+ "evidence_limit": "Saved successful pre-scoring asset/source-hash admission checked against pinned receipts; this publisher does not rerun scoring or independently rehash remote model payloads.",
88
+ "model_weights_sha256": "c8149d988e4bbf3f347e6966b5d769de347a5f8c59ffca1dc4bd4bf5b8585e57",
89
+ "quality_wrapper_sha256": "5d702be61a0d59d698290ddb18a3a5e7be50fca742617f8dc456c068b9fe69d8",
90
+ "runtime_versions": {
91
+ "librosa": "0.11.0",
92
+ "numpy": "2.4.2",
93
+ "soundfile": "0.13.1",
94
+ "torch": "2.11.0+cu128",
95
+ "transformers": "5.2.0"
96
+ },
97
+ "source_pins": {
98
+ "/workspace/inflect-wer-focus-20261108-r003/SpeechMOS-v1.2.0/hubconf.py": "72dee4dfeecdb632663290155024ede7e50adef49d798f54750910acd93ca31d",
99
+ "/workspace/inflect-wer-focus-20261108-r003/SpeechMOS-v1.2.0/hubconf_test.py": "cc42a3d4bef5b2c8ab9e6120aa4df6db4011641a4000d73713ee8019c46f59d3",
100
+ "/workspace/inflect-wer-focus-20261108-r003/SpeechMOS-v1.2.0/speechmos/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
101
+ "/workspace/inflect-wer-focus-20261108-r003/SpeechMOS-v1.2.0/speechmos/utmos22/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
102
+ "/workspace/inflect-wer-focus-20261108-r003/SpeechMOS-v1.2.0/speechmos/utmos22/fairseq_alt.py": "f243661c1dd01bec87c32d869d67b7c72f1218b8362b12ae3e0bbe6ca8614e2f",
103
+ "/workspace/inflect-wer-focus-20261108-r003/SpeechMOS-v1.2.0/speechmos/utmos22/strong/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
104
+ "/workspace/inflect-wer-focus-20261108-r003/SpeechMOS-v1.2.0/speechmos/utmos22/strong/model.py": "c9631bdc42f4687eace749a7bf5bc283537e811ec2fe4bdacb373fadced3b751",
105
+ "/workspace/inflect-wer-focus-20261108-r003/SpeechMOS-v1.2.0/speechmos/utmos22/strong/model_test.py": "84d196d3733fb5bce9f66d0e645b351a88b8bd9ff8ba927d37b0949896be7ee2"
106
+ },
107
+ "verified_asset_receipt_sha256": "51c391fe0b6f6b7821fcd1a4dfc0a43f283c50610067317fe96c3fb6ee871f59",
108
+ "verified_model_asset": {
109
+ "filename": "fold0_s42_best_model.pth",
110
+ "relative_path": "hub/models--sarulab-speech--UTMOSv2/snapshots/506474f2b33dc77c234d668cc419be1861899cad/fold0_s42_best_model.pth",
111
+ "repo": "sarulab-speech/UTMOSv2",
112
+ "revision": "506474f2b33dc77c234d668cc419be1861899cad",
113
+ "sha256": "c8149d988e4bbf3f347e6966b5d769de347a5f8c59ffca1dc4bd4bf5b8585e57",
114
+ "size": 818531314,
115
+ "url": "https://huggingface.co/sarulab-speech/UTMOSv2/resolve/506474f2b33dc77c234d668cc419be1861899cad/fold0_s42_best_model.pth"
116
+ },
117
+ "verified_runtime_receipt_sha256": "ca339d334ed4e1a0b151e2d47ae67d95ba2ca86c058158ada8c92425662507f8",
118
+ "verified_source_receipt_sha256": "63ba72e31309389fc4dc9d7ff1df12ab56e53d6bbc0d8fb23734c42edefe73c1",
119
+ "verified_source_tree": {
120
+ "commit": "14a281c6072d6fad2bf31f992ed2e60304400075",
121
+ "tracked_files_sha256": {
122
+ ".github/ISSUE_TEMPLATE/bug-report.yml": "1c555396240f6ce5c844826194827c1bbc2d69f5e63d43e3d0af8f63f7a44900",
123
+ ".github/ISSUE_TEMPLATE/config.yml": "24cfdf9e3d4880738184eb765d98aa064a725b04053d133862ff6d50074f0323",
124
+ ".github/pull_request_template.md": "150c01c4b343a77fc30c4a5e28acf23660e1094a40902fd83358e9591ff4852c",
125
+ ".github/workflows/lint_and_format.yml": "363a72839ea103d2e3ca7a2e6f38d596e6f7e05cc552658799cca43e9deaf3b2",
126
+ ".github/workflows/mypy_check.yml": "a9cfb2f0a465fc062d625d54cea934b1ab6a85fb46ab75d2d2c2ffb1627a96b5",
127
+ ".github/workflows/tests.yml": "75801156effdbda3860be7fb85f3f89c145e4dad7d34b4682bc2c9c674da0a6e",
128
+ ".gitignore": "4b24693066d6feeb27393b262b43b2f3b45a5a4fc04b5dae611d66e6d1049ed2",
129
+ ".vscode/settings.json": "2822db6b6363e03234742851c0c00b50de6355b0e0a3f24c131d2cc0ae0c6ba8",
130
+ "CITATION.cff": "452869811a2661105bc668c623651d48c5bb5c03ba74963c91b0d4ad9eb9dc24",
131
+ "LICENSE": "ddefd7cc91936715d038865d38d5ada0cd42d31916a2583f121dfa94242de76d",
132
+ "README.md": "e2a168d618451a5094b217d5340f3f32590b84b1e8e0d552cc7f0e7f44013350",
133
+ "docs/datasets.md": "21098e7139f2a0d01c7a8150adb09d1afa5603d107fe70ce5ffb16359bec1a6f",
134
+ "docs/image/line2.svg": "7d645a311344885e2a8dafb09428370ebcdf8c0290c73f886cf73bcb6fbbc4f6",
135
+ "docs/image/line3.svg": "129d08072260874407450c4c715f3b0356ca57134d2ee62d015d2b37c1f43163",
136
+ "docs/image/line4.svg": "8b1049dd611291b50a75c64a56fb08b3d75c985908e3a77456c9a3711e5822de",
137
+ "docs/image/titleLine.svg": "947a10474cdd919c1ae58c5ae7dab7e87a469c490d54f1d923864449ebba058a",
138
+ "docs/image/titleLine2b.svg": "1c54331511bde1d121a6ac28290cd95ffba15718897bb535133bc9697be5a8d8",
139
+ "docs/image/titleLine2t.svg": "99fb519c87bc8a3b0fddedcfb24b47ea9be64fe7016f6c6a3d18c119655f3829",
140
+ "docs/image/titleLine3b.svg": "1d74e764253efcb824dc79d126f39c4515f8fd1f73eb96862d425963ea303ab3",
141
+ "docs/image/titleLine3t.svg": "6ad35f781483c9fa0eb62ac2749687075831fdbcd85a187988fd120175ceab3e",
142
+ "docs/image/titleLine4b.svg": "083b77360d7e47988d46bf9446144c619abe4d4a46bcf2d1c950c446fc36b588",
143
+ "docs/image/titleLine4t.svg": "8d29a0aafc7c0c09c7057c41b2802e964f89d0f27266ea27ed441f2f8a493c8c",
144
+ "docs/image/titleLine5b.svg": "67418ab64d8b88ccd4e303e15d132863e68f6876af0afb206e406449c80c15e0",
145
+ "docs/image/titleLine5t.svg": "2d865f7cc844f88a76d9fe73e50dff3de7a627b0cadf793f606f7c1e88e86b13",
146
+ "docs/image/utmosv2.PNG": "0dbbcbb591a99cd7c44412e2d64835be8e6ae190a3d113feae81b93f048aa42d",
147
+ "docs/inference.md": "6b5bea32d78e4a8b59b601e1d9d593f76ee3d14d22c506cfa073cb326b356f47",
148
+ "docs/reproduction.md": "58a23a4a7cdd3504017fe5ca690e22f16f9dc57dcacadb79faf29305ce2192f5",
149
+ "docs/training.md": "91b830147975b5d8a5aa7011c11cfc57f462b98f2c2f9c90ae213759f23456bd",
150
+ "inference.py": "551a5250033664a03b42a213baae4a247101ce9fa9f07eca9670781349ea5586",
151
+ "poster.pdf": "1508aa615af85fe142f658332f1154c378278ee2b64403b76e2b4fa775704f95",
152
+ "pyproject.toml": "715bf2580da456589a354c56e1fb6bb328da30e94235dd66ea635ab8cb04b830",
153
+ "quickstart.ipynb": "b9811c2d22373a066cad65bd7e03b6675a03e6617c7305f942c675a344149a6b",
154
+ "tests/core_tests/test_create.py": "821f80f990e440a6f00367de0c538ea6434d567cf7dbcd7a168236e627fea97a",
155
+ "tests/core_tests/test_model.py": "f20be949a948a9bbdc031bd8439c0c143189092c36771b5b5256f984e3a7c382",
156
+ "train.py": "48a7f71ee5886a041bb64fa48e2d0a45d16d180e932e4ebfe0fc530c9f65c237",
157
+ "utmosv2/__init__.py": "e06dc6d346eb846fb93023e6745069b27d9be31b9c96471259225ad24debf283",
158
+ "utmosv2/_core/__init__.py": "97855bfa183313568c397cf05aea33d12102b3f7ecfa320aba1c3dd6e84fdedf",
159
+ "utmosv2/_core/create.py": "fc4826f65e31da6eff6aec4bc71bc6f0f599707ec9e434701f7c4352fe433542",
160
+ "utmosv2/_core/model/__init__.py": "394ee28ff47e226ef8ff05b2a774079e0e692a085500873dabf36a85c61c4c7d",
161
+ "utmosv2/_core/model/_common.py": "c751e552eb4eb8ad31697370f6a84ab398cabda3062e0a12f93f63ba651c8f4d",
162
+ "utmosv2/_core/model/_models.py": "6f1ada7cb39c5f2da9917c68dc17af363f40ed190d7cc4ec0d8f102382d45496",
163
+ "utmosv2/_import.py": "9c4799a0cd837d1ff45fb87083e479243478199352352d3399b5cf12862b2fb0",
164
+ "utmosv2/_settings/__init__.py": "4ec7b658e3fea5fdca5dc54d90ccb12d70d11fd18c3f2a85f452996816c82f8f",
165
+ "utmosv2/_settings/_config.py": "d865f90543c4c02decc37a52df9403542dd1efeb732707d3ad0b62e97d05771c",
166
+ "utmosv2/config/c_fusion_stage2.py": "1ac42cff20dbc8de4e68570b4a4745d724b218020774508aede82b174ad4d258",
167
+ "utmosv2/config/c_fusion_stage3.py": "832dfbaecec441b1aedc7a932830bacc4a7b5bec6006f9d043d56569fc799a6c",
168
+ "utmosv2/config/c_spec_only_stage1.py": "108e4aa3674d814758a7feff0c2a9cbc32261d0353dedb87510aeec72e540ee6",
169
+ "utmosv2/config/c_spec_only_stage2.py": "18a4e0da32eed14f9fc9cd5897622792de2dc147f097a34da4cbdcb91ce6784c",
170
+ "utmosv2/config/c_ssl_only_stage1.py": "04d672d7d0aa29bdef75d6e41401ae6921338fb908adf281d349ae3fee657cc0",
171
+ "utmosv2/config/c_ssl_only_stage2.py": "86b05cbcd8b464120b26cc3bbed16fb9d378e38fa44e6d9557a516bb240d57d1",
172
+ "utmosv2/config/fusion_stage2.py": "cc13ecc5217ffad0036d3bfa8bcd8d52e525470285f4a8bcc90255425b9554dd",
173
+ "utmosv2/config/fusion_stage2_wo_bc.py": "63e5694198c064149696e1951b3e19be12b42a6805ebcacf4e6b74940740bd54",
174
+ "utmosv2/config/fusion_stage2_wo_bvcc.py": "13e4d054f90cd9e2c2ceddccb801678cb23ad74116bbe15036bcc31c87f855b1",
175
+ "utmosv2/config/fusion_stage2_wo_sarulab.py": "1a0b0fe01ceb6fb05c387dded96fba3e6a10921754f09577452ed297af4d3e5f",
176
+ "utmosv2/config/fusion_stage2_wo_somos.py": "6ede5659485a074899a14823eb8e7b9fb8acdfd82f2d39d757ac02b1d93c65f9",
177
+ "utmosv2/config/fusion_stage3.py": "9e30618e51ddbcf77cb2d3bbd66e3f194833c06f3141abb626ba385eb38f1c05",
178
+ "utmosv2/config/fusion_stage3_wo_bc.py": "c8aa6230baee6169fd5496cd9f1c5ac2482ecbc7b3f67d74e7a98e505fd03356",
179
+ "utmosv2/config/fusion_stage3_wo_bvcc.py": "3841522053d29172c496f98df49cc17db7512d4e92f95e96845245ab5905aadf",
180
+ "utmosv2/config/fusion_stage3_wo_sarulab.py": "753a14b30184e785152e7392f8ff8597feb275e9a7f32fc80a090a1c24130dfa",
181
+ "utmosv2/config/fusion_stage3_wo_somos.py": "c898bc0f46561ce56f59fda606e1d70f78e353e7de09f8ccc19381611267f364",
182
+ "utmosv2/config/fusion_wo_stage1and2.py": "1d20f81673a88110780a17b1e40afec4c2c26f3761806010e0ef21f2824aacd2",
183
+ "utmosv2/config/fusion_wo_stage2.py": "ec5527163d6f084faec5f9fcc89add50b6fe5533deea4348421935e0e40b6e4f",
184
+ "utmosv2/config/spec_only.py": "42814110a090b590712c65934e2d0e8a8fe364b917c9ddf094a28240a6934c33",
185
+ "utmosv2/config/spec_only_wo_bc.py": "15a3d1456ccee40fee8111d14a3c29226c9ed2e90f4c5e3c5fe39c5976490bb1",
186
+ "utmosv2/config/spec_only_wo_bvcc.py": "762ddced5c96e9d10fd7066ed1296fa54d78780ff0414a00ca7a00d4924bd885",
187
+ "utmosv2/config/spec_only_wo_sarulab.py": "112d9edfab4d2fe44fe6ab9783786b2d2338c3f8f0ecbefec6d8520baa65370e",
188
+ "utmosv2/config/spec_only_wo_somos.py": "25c98b66647bd241c5805e5d4e8b65e5800c29a95769d65e8beadf09b8ffb9e3",
189
+ "utmosv2/config/ssl_only_stage1.py": "3e98f812732f3f91235559f741c642fab37f4870b3c3a0f2b2494ca05c1f76ab",
190
+ "utmosv2/config/ssl_only_stage1_wo_bc.py": "bd221cdd1b2f4521f27eec6c9a46971f3592f4703923c50ff0b63618c9e88034",
191
+ "utmosv2/config/ssl_only_stage1_wo_bvcc.py": "0cc332d2d615863156e5183a4ca10f2f7a798a17a27bfb8a29fbeb2a910ce7d3",
192
+ "utmosv2/config/ssl_only_stage1_wo_sarulab.py": "d7cc8c7dbaf8cb81ec9ed76806fdc22b0ef31562b1e71c3b46d30036ca294f7f",
193
+ "utmosv2/config/ssl_only_stage1_wo_somos.py": "58a57b430f994853b2143dc5142a659e32c6c3bad9c0d29f035de3a6c0d22092",
194
+ "utmosv2/config/ssl_only_stage2.py": "f395f05995893754e2009032f03129e5c801d9a364dca444fbeec4bd92a1aa9a",
195
+ "utmosv2/config/ssl_only_stage2_wo_bc.py": "b9f7d2abcad7b649274b1a6705a1676bcbb810d0508a9943c76fb3090c846932",
196
+ "utmosv2/config/ssl_only_stage2_wo_bvcc.py": "0090a123be326e534b240402da2e8ed25c986f284c2c525b0b4b7396d7e97e1e",
197
+ "utmosv2/config/ssl_only_stage2_wo_sarulab.py": "64bc215dc14e3af1701d126c5e1fc1192b7df243541f0680a50febe3e66f172f",
198
+ "utmosv2/config/ssl_only_stage2_wo_somos.py": "0be93b940502bc51bf754ae1a3e4d49c283ce04acaf0b078ef326f678f48c11a",
199
+ "utmosv2/dataset/__init__.py": "4c3c3f5605c91b45b1a013efd91cc49840000722947176e7a29fa86e73e10473",
200
+ "utmosv2/dataset/_base.py": "68fcbfcda642855320dbff5c313149bb60d2ff437d0730bc9db48b99093f8ba7",
201
+ "utmosv2/dataset/_schema.py": "c4b42cdcff6fc0fa517fdbfb7104eaec61f952147143b2f74c0193c69ba31a61",
202
+ "utmosv2/dataset/_utils.py": "e3e28c3e0e2eb643846f400a7898afe932bfe4ed5cb705a2343e674abe01380a",
203
+ "utmosv2/dataset/multi_spec.py": "5c43fb2cdd746609db59dc597adba12127c844ce332da5840362c9d319193fbc",
204
+ "utmosv2/dataset/ssl.py": "94cf4e9a606253de37f02dd715b309991ac5303a6c1c5cf063726700154e59c8",
205
+ "utmosv2/dataset/ssl_multispec.py": "57ea343bd156e58918297054f36c67985f29ddea3cebc3c4c38c94ccb263f378",
206
+ "utmosv2/loss/__init__.py": "91aba42eb8262753448c804721b94b49474e3791187571e9ac9a5e7e051867a8",
207
+ "utmosv2/loss/_losses.py": "226ec4d1ce8bfaacb1fb9c768d8ebc4be242ac58a1b1e2880d7beba7a8e9c768",
208
+ "utmosv2/model/__init__.py": "b2d15c929596e7038dba58e8e48e9857863db28f0758f4d33503946b8a795919",
209
+ "utmosv2/model/multi_spec.py": "9166fc16a8b95c1f40d4808a5b820bbb4a5a71298e02666bab955015bda60dab",
210
+ "utmosv2/model/ssl.py": "007408c00dbf3baf4f63424e2367743e0fc6671f9f2266da13011899c62139d9",
211
+ "utmosv2/model/ssl_multispec.py": "11ce2c1c56b81241f40a231a19ee38c8c919b6251f52210f08be5f03ac417ba3",
212
+ "utmosv2/preprocess/__init__.py": "6c32a9f8191d0470d3723ff58c2cea1e64f859eccc0b674cbf944aa5d40767e3",
213
+ "utmosv2/preprocess/_preprocess.py": "0a86d0d9e0ec7210e1375d33775b38c4752fe088c551389f72207dfbbd3aaeae",
214
+ "utmosv2/py.typed": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
215
+ "utmosv2/runner/__init__.py": "19850919de7394e61f88bce21388d06d87f14721807cac72ba28552c70ba7d06",
216
+ "utmosv2/runner/_inference.py": "dfcc13e973c056d7d1123a6626250f202a2c43eb81d65e8d0072612e2f40a75c",
217
+ "utmosv2/runner/_train.py": "4899445ae22907aaa8108ce575f6e8a228f120fecb508c773e64248bea5ad04c",
218
+ "utmosv2/transform/__init__.py": "a77578722bee96fdc2e9f5f82d722befe489e176ec93e8954c0a7c247459410e",
219
+ "utmosv2/transform/_xymasking.py": "c50bc929963aa6b352cce34e1568cf4a7c61bcb6a778c8160368cb68e534cd2c",
220
+ "utmosv2/utils/__init__.py": "5a062c5a4541e8d41692cd369add9476f17bc9cc78b1edebb38456cb0f6ad309",
221
+ "utmosv2/utils/_constants.py": "9def1481bc0da33fd884dbf3ef424ccb79c52b4a698fb059cd915ba4990c89b1",
222
+ "utmosv2/utils/_download.py": "d9fc6efe6e9421dc43ef328b4893df9b64b324b52d65f4ef7181771218e16802",
223
+ "utmosv2/utils/_pure/__init__.py": "6ecc5b4b2d703e3c719b3e908b0c50e61f5247b49d9994192bf757616ff3d786",
224
+ "utmosv2/utils/_pure/initializers.py": "60bfabaec9ab14a2a461210f932a2893f7c671579f8b66e9dae4eaa4759c744d",
225
+ "utmosv2/utils/_pure/metrics.py": "9fb39563141893d2e845d5fde79970583ddd3279148f04acc2d6d15842665fbf",
226
+ "utmosv2/utils/_pure/save.py": "14b78fb01330d6caa96b515b0af5b53eaf754d26747ea3b80d5df7382f6aa80e",
227
+ "utmosv2/utils/_pure/split.py": "7bec87d6d2a89b8943cd1edda602d91d20d5b43cf4684b075023a41c49048ba4",
228
+ "utmosv2/utils/_task_dependents/__init__.py": "b692f7991c4494d3b7ca28f6936411904c92a98c727b045253e4d3330c34606c",
229
+ "utmosv2/utils/_task_dependents/initializers.py": "07573ebdd7be372d39bfe614ba7a638b9c353edd0970b2cac68dc9335f38f984",
230
+ "utmosv2/utils/_task_dependents/log.py": "8c692abaef70361665236393feb6e88bd85ee76675582d1f7c4de894e8b3d173",
231
+ "utmosv2/utils/_task_dependents/metrics.py": "9e3d8386e8298427e1b93708a742d35f7507c534d640baebb66f6c714fc21c13",
232
+ "utmosv2/utils/_task_dependents/save.py": "340dd944788b602f63871c78a5ef146b843bf93c53b0e156d5958605724ccf24",
233
+ "uv.lock": "8250985069c8d175835027cbd41961edcde3895260a7202322d6c2254014f095"
234
+ },
235
+ "tree_sha256": "225ed6288d2a645d0611626ea2500ced87798c1ab55b9322b45087a098078bb2",
236
+ "version": "1.3.0"
237
+ }
238
+ },
239
+ "type": "Objective quality proxy, not human MOS"
240
+ }
241
+ },
242
+ "official_submission": false,
243
+ "report_sha256": "2ae71224f1c583523af9d9bc404c52586149ead571c941e1313711a723d625a1",
244
+ "schema": "inflect-public-native24-evaluation-v1",
245
+ "scoring": {
246
+ "aggregation": "WER percent, lower is better: per dataset sum(edits)/sum(N)*100, equal dataset mean, then equal six-voice mean. Pooled word-count WER is separate; no intermediate rounding.",
247
+ "execution": {
248
+ "asr_batch_size": 8,
249
+ "audio_cap_seconds": 30,
250
+ "bitwise_official_execution_equivalence_claimed": false,
251
+ "device": "CUDA",
252
+ "dtype": "BF16",
253
+ "duration_sorting": "Official duration sorting within each temporary block manifest, not one globally sorted whole-job manifest",
254
+ "last_block_may_be_smaller": true,
255
+ "local_hardware": "NVIDIA RTX 5090",
256
+ "max_new_tokens": 256,
257
+ "official_rank_claimed": false,
258
+ "submitted_rows_per_transcriber_call": 24,
259
+ "upstream_reference_hardware": "NVIDIA H200 (not used for this local run)"
260
+ },
261
+ "limits": "Saved receipts and arithmetic checked; this preparation does not rerun ASR, official normalization/alignment, quality models, or human listening. No official leaderboard submission.",
262
+ "reader": "Qwen3-ASR-1.7B",
263
+ "reader_weights_sha256": "2db53c7d81bd9b8cbc6a074e89be2c968a0d373fb4ee68bb1b1e14f7042dfee1",
264
+ "source_scorer_sha256": "7b9ec60595ee1aa9e05a7821c0afd1f7830ef499bcea2e80c93d3df8b5401717",
265
+ "transcribe_source_sha256": "0dadc103e104439568431634558112a12d65320382e9c4af6ad449df63faf586",
266
+ "utmos22_source_sha256": "55795acfce499829fb33084e3b2202555a00de6252e220837fe84313796df01f"
267
+ },
268
+ "source_receipts": {
269
+ "external-evidence/quality-asset-pins.json": "51c391fe0b6f6b7821fcd1a4dfc0a43f283c50610067317fe96c3fb6ee871f59",
270
+ "external-evidence/v3_window_quality_score_20261111.py": "5d702be61a0d59d698290ddb18a3a5e7be50fca742617f8dc456c068b9fe69d8",
271
+ "jobs/mini-cassidy-full/reader-admission.json": "2067c9cecd20579b2587990e1523d0b1fc3cc6c5e12ddd716e6f0804361a8534",
272
+ "jobs/mini-cassidy-full/render/panel.json": "c37bef1d690cc329d353799a99aaf57f66022c889c81b3f3b59c5cab943ee2e8",
273
+ "jobs/mini-cassidy-full/score-render-asr/clips.json": "020403ccbd963c339f5a93044eeb440243e74efa759ba210fb0d04622e7bbd4e",
274
+ "jobs/mini-cassidy-full/score-render-asr/plan.json": "6457afc170f060eb9d272ed16ceabc93e17315fd36934b31640fc54180540de8",
275
+ "jobs/mini-hope-full/reader-admission.json": "0b09caf2a5120e2ce0c4b341b60d86debf55a003bc17288c5ccda1d07e7fabf1",
276
+ "jobs/mini-hope-full/render/panel.json": "9affd3396a801be47229a8b99b617878c1c5e5a32326aa70fcca728e6051f955",
277
+ "jobs/mini-hope-full/score-render-asr/clips.json": "093023a251a6bd00ab3f6b86b1560315b67e798a6cc2bd00bfa661964b4f5798",
278
+ "jobs/mini-hope-full/score-render-asr/plan.json": "c1716a6e6081b71b1b7d6e828f409fa3dff4700a17d9b4407d0431534ce60501",
279
+ "jobs/mini-james-full/reader-admission.json": "b35193893a300349a89a1bfd91e8d03c7887396508a124c73872197fada804a1",
280
+ "jobs/mini-james-full/render/panel.json": "e25deae9ad22bdd0b802cbd1f1f7d29c5635c2addbbcae732f2796a96185667b",
281
+ "jobs/mini-james-full/score-render-asr/clips.json": "dd43aeaa8852dce2d3f1bacbdb7815a16badcbe96b3c305a0b1e3dcc1ab2cf76",
282
+ "jobs/mini-james-full/score-render-asr/plan.json": "8d2718bfcd457eea6db275d58b59f313d30aefd1256c30a79ccb5005ad89659d",
283
+ "jobs/mini-jasper-full/reader-admission.json": "dec22421174e43e5cc8cf0c0f86a76979a299097038ffd84daf1114f4e07dd0a",
284
+ "jobs/mini-jasper-full/render/panel.json": "fee8d3114aafcb214b1db92e0ad04a00b7cf09b04443de84e8eef0f948cb91e6",
285
+ "jobs/mini-jasper-full/score-render-asr/clips.json": "293eb9c4e2e2571cd70f09c91d038ba13d56fa29dc0ecf8d35052a8ff09c0629",
286
+ "jobs/mini-jasper-full/score-render-asr/plan.json": "9ce80c47bf60c9bb6caeacb1995069c67862c39b3e24b3485041b12ad93e6d70",
287
+ "jobs/mini-mark-full/reader-admission.json": "2b0c834ce94a8851761acfd53dc69e5ff7421927d6099405743bc1bf01746727",
288
+ "jobs/mini-mark-full/render/panel.json": "639a1120745da4d588850af09042960e7f3a4cbf3f592f2edca07268e44c57d2",
289
+ "jobs/mini-mark-full/score-render-asr/clips.json": "303ea96de7baee1bd14333bcff7936c6feca774ddc77db691fecfb8c2242259e",
290
+ "jobs/mini-mark-full/score-render-asr/plan.json": "241aa8ec2453b342cf236345ea216eb61e86e02cc6f2e6ea6950d986e03bd38a",
291
+ "jobs/mini-sophia-full/reader-admission.json": "5adbe21ff6bb6898cbc215902eae4478508446d87ab75d700d629437cb4f3a4e",
292
+ "jobs/mini-sophia-full/render/panel.json": "d513d6768fab74a75c1e864bc46a286632f9ce3d7fe94a66c05dd42a514f4dd8",
293
+ "jobs/mini-sophia-full/score-render-asr/clips.json": "eff6e8accee0ace046d1fa6cc0225c2826e572cc06526a53ee16863c9e8a190b",
294
+ "jobs/mini-sophia-full/score-render-asr/plan.json": "e6095f03bb7c2716e4d3069ad884514968a35eb55e185915ee5bba0ec399646c",
295
+ "jobs/mos-mini/quality-panel-receipt.json": "4cda1a404f88ab413c0b25ac01ba3f0730c4e3ef0151e9dae566c2936c276cf4",
296
+ "jobs/mos-mini/reader-admission-utmos22.json": "5995fe640d2cb00a722e27ebd810778a61d49e586f6ec2a4daa3e5d9c41af6b9",
297
+ "jobs/mos-mini/reader-admission-utmosv2.json": "68897e2743a4ef52cd44312afb222590c83ef891972f1dea8289303a7408a2e1",
298
+ "jobs/mos-mini/render/panel.json": "e4e195b99b87d80e0baacd493f6993db689b808ef1679bb4b235bd6401c4324f",
299
+ "jobs/mos-mini/score-render-utmos22/clips.json": "2a2d2c3a94807ff4dbd53001342f37c9efd31802713c07f8e678e31244c83636",
300
+ "jobs/mos-mini/score-render-utmos22/plan.json": "d166e5943b0b29cf8375e014511d6881d426dbeeefe031d35959488f6f3f1ad0",
301
+ "jobs/mos-mini/score-render-utmos22/summary.json": "702243875739a7229e19fc8b7d01a09d8d068b18d4f403c7ed7ef48126ec849c",
302
+ "jobs/mos-mini/score-render-utmosv2/clips.json": "0a380461327eb6f5eeb474f778bb1695dac65df285c253fcf114ef6f21117ec1",
303
+ "jobs/mos-mini/score-render-utmosv2/plan.json": "fe4935a52ee2c40b45c49a9eabff61a0eface063dc0cc6fd802472032c7d3cb4",
304
+ "jobs/mos-mini/score-render-utmosv2/runtime.json": "ca339d334ed4e1a0b151e2d47ae67d95ba2ca86c058158ada8c92425662507f8",
305
+ "jobs/mos-mini/score-render-utmosv2/summary.json": "0bfcb22b44fdfeccbe330ac8b860fd7ffffd36c7648159d4e9abf3e5221d5cff",
306
+ "quality-source-pins.json": "63ba72e31309389fc4dc9d7ff1df12ab56e53d6bbc0d8fb23734c42edefe73c1",
307
+ "reader-reference-pins.json": "b859d4fdf2a345693e3e57177e775aa8618fe370b8406b78964e40b1bb855bcc"
308
+ },
309
+ "training_disjointness_certified": false,
310
+ "wer": {
311
+ "N": 127308,
312
+ "cases_per_voice": 1688,
313
+ "clips": 10128,
314
+ "dataset_cases_per_voice": {
315
+ "cv3_eval_zero_shot_en": 500,
316
+ "minimax_eval_tts_en": 100,
317
+ "seed_tts_eval_tts_en": 1088
318
+ },
319
+ "edits": 1114,
320
+ "equal_dataset_equal_voice_wer_percent": 0.7390056860624062,
321
+ "pooled_wer_percent": 0.875043202312502,
322
+ "scope": "full-1688-per-voice",
323
+ "voices": [
324
+ {
325
+ "N": 21218,
326
+ "cells": [
327
+ {
328
+ "D": 7,
329
+ "I": 6,
330
+ "N": 7377,
331
+ "S": 77,
332
+ "clips": 500,
333
+ "dataset": "cv3_eval_zero_shot_en",
334
+ "edits": 90,
335
+ "wer_percent": 1.2200081333875559
336
+ },
337
+ {
338
+ "D": 9,
339
+ "I": 3,
340
+ "N": 11941,
341
+ "S": 76,
342
+ "clips": 1088,
343
+ "dataset": "seed_tts_eval_tts_en",
344
+ "edits": 88,
345
+ "wer_percent": 0.7369567037936521
346
+ },
347
+ {
348
+ "D": 1,
349
+ "I": 0,
350
+ "N": 1900,
351
+ "S": 4,
352
+ "clips": 100,
353
+ "dataset": "minimax_eval_tts_en",
354
+ "edits": 5,
355
+ "wer_percent": 0.2631578947368421
356
+ }
357
+ ],
358
+ "edits": 183,
359
+ "equal_dataset_wer_percent": 0.74004091063935,
360
+ "pooled_wer_percent": 0.8624752568573852,
361
+ "voice": "hope"
362
+ },
363
+ {
364
+ "N": 21218,
365
+ "cells": [
366
+ {
367
+ "D": 6,
368
+ "I": 6,
369
+ "N": 7377,
370
+ "S": 73,
371
+ "clips": 500,
372
+ "dataset": "cv3_eval_zero_shot_en",
373
+ "edits": 85,
374
+ "wer_percent": 1.152229903754914
375
+ },
376
+ {
377
+ "D": 10,
378
+ "I": 3,
379
+ "N": 11941,
380
+ "S": 85,
381
+ "clips": 1088,
382
+ "dataset": "seed_tts_eval_tts_en",
383
+ "edits": 98,
384
+ "wer_percent": 0.8207017837702035
385
+ },
386
+ {
387
+ "D": 1,
388
+ "I": 0,
389
+ "N": 1900,
390
+ "S": 3,
391
+ "clips": 100,
392
+ "dataset": "minimax_eval_tts_en",
393
+ "edits": 4,
394
+ "wer_percent": 0.21052631578947367
395
+ }
396
+ ],
397
+ "edits": 187,
398
+ "equal_dataset_wer_percent": 0.727819334438197,
399
+ "pooled_wer_percent": 0.8813271750400603,
400
+ "voice": "sophia"
401
+ },
402
+ {
403
+ "N": 21218,
404
+ "cells": [
405
+ {
406
+ "D": 7,
407
+ "I": 7,
408
+ "N": 7377,
409
+ "S": 73,
410
+ "clips": 500,
411
+ "dataset": "cv3_eval_zero_shot_en",
412
+ "edits": 87,
413
+ "wer_percent": 1.1793411956079707
414
+ },
415
+ {
416
+ "D": 9,
417
+ "I": 2,
418
+ "N": 11941,
419
+ "S": 80,
420
+ "clips": 1088,
421
+ "dataset": "seed_tts_eval_tts_en",
422
+ "edits": 91,
423
+ "wer_percent": 0.7620802277866175
424
+ },
425
+ {
426
+ "D": 1,
427
+ "I": 0,
428
+ "N": 1900,
429
+ "S": 4,
430
+ "clips": 100,
431
+ "dataset": "minimax_eval_tts_en",
432
+ "edits": 5,
433
+ "wer_percent": 0.2631578947368421
434
+ }
435
+ ],
436
+ "edits": 183,
437
+ "equal_dataset_wer_percent": 0.7348597727104768,
438
+ "pooled_wer_percent": 0.8624752568573852,
439
+ "voice": "cassidy"
440
+ },
441
+ {
442
+ "N": 21218,
443
+ "cells": [
444
+ {
445
+ "D": 3,
446
+ "I": 8,
447
+ "N": 7377,
448
+ "S": 66,
449
+ "clips": 500,
450
+ "dataset": "cv3_eval_zero_shot_en",
451
+ "edits": 77,
452
+ "wer_percent": 1.0437847363426866
453
+ },
454
+ {
455
+ "D": 11,
456
+ "I": 4,
457
+ "N": 11941,
458
+ "S": 88,
459
+ "clips": 1088,
460
+ "dataset": "seed_tts_eval_tts_en",
461
+ "edits": 103,
462
+ "wer_percent": 0.8625743237584792
463
+ },
464
+ {
465
+ "D": 1,
466
+ "I": 0,
467
+ "N": 1900,
468
+ "S": 5,
469
+ "clips": 100,
470
+ "dataset": "minimax_eval_tts_en",
471
+ "edits": 6,
472
+ "wer_percent": 0.3157894736842105
473
+ }
474
+ ],
475
+ "edits": 186,
476
+ "equal_dataset_wer_percent": 0.7407161779284588,
477
+ "pooled_wer_percent": 0.8766141954943916,
478
+ "voice": "james"
479
+ },
480
+ {
481
+ "N": 21218,
482
+ "cells": [
483
+ {
484
+ "D": 5,
485
+ "I": 8,
486
+ "N": 7377,
487
+ "S": 69,
488
+ "clips": 500,
489
+ "dataset": "cv3_eval_zero_shot_en",
490
+ "edits": 82,
491
+ "wer_percent": 1.1115629659753288
492
+ },
493
+ {
494
+ "D": 8,
495
+ "I": 5,
496
+ "N": 11941,
497
+ "S": 84,
498
+ "clips": 1088,
499
+ "dataset": "seed_tts_eval_tts_en",
500
+ "edits": 97,
501
+ "wer_percent": 0.8123272757725484
502
+ },
503
+ {
504
+ "D": 1,
505
+ "I": 0,
506
+ "N": 1900,
507
+ "S": 4,
508
+ "clips": 100,
509
+ "dataset": "minimax_eval_tts_en",
510
+ "edits": 5,
511
+ "wer_percent": 0.2631578947368421
512
+ }
513
+ ],
514
+ "edits": 184,
515
+ "equal_dataset_wer_percent": 0.7290160454949064,
516
+ "pooled_wer_percent": 0.867188236403054,
517
+ "voice": "jasper"
518
+ },
519
+ {
520
+ "N": 21218,
521
+ "cells": [
522
+ {
523
+ "D": 3,
524
+ "I": 9,
525
+ "N": 7377,
526
+ "S": 69,
527
+ "clips": 500,
528
+ "dataset": "cv3_eval_zero_shot_en",
529
+ "edits": 81,
530
+ "wer_percent": 1.0980073200488003
531
+ },
532
+ {
533
+ "D": 11,
534
+ "I": 4,
535
+ "N": 11941,
536
+ "S": 89,
537
+ "clips": 1088,
538
+ "dataset": "seed_tts_eval_tts_en",
539
+ "edits": 104,
540
+ "wer_percent": 0.8709488317561344
541
+ },
542
+ {
543
+ "D": 1,
544
+ "I": 0,
545
+ "N": 1900,
546
+ "S": 5,
547
+ "clips": 100,
548
+ "dataset": "minimax_eval_tts_en",
549
+ "edits": 6,
550
+ "wer_percent": 0.3157894736842105
551
+ }
552
+ ],
553
+ "edits": 191,
554
+ "equal_dataset_wer_percent": 0.7615818751630484,
555
+ "pooled_wer_percent": 0.9001790932227354,
556
+ "voice": "mark"
557
+ }
558
+ ]
559
+ }
560
+ }
media/mini-cassidy-48k.wav CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:14d7eb456f23a4779c623523cc1be4a5b9efbbd3b223e5a9d442e785171cb1b0
3
- size 643280
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:026b630c677db87402b07dfa5def996151ac4d70bc578b4a5da3667c41d0a67c
3
+ size 321644
media/mini-cassidy.wav CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:0fd1fb2b1e749d8d1b62c3ef4e6fb4c8a183e33f37fac9d78950a91582435006
3
- size 321680
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ecf10e95b951c66facf75049ffe423a073b2f0de002de4a220ace75e8aed69bb
3
+ size 160844
media/mini-hope.wav CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:63d96ec424d2ae9c21cdc2d603c3fa46fb1b8a3f53c74186d0c16e6ee7698063
3
- size 429680
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d444a7e7d8caa08b5b9723f08e0447132b461b3757bdc7f4da82a0ca7433a359
3
+ size 214844
media/mini-james.wav CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:7428c06e88ff7d955e9c893c4a7620b2a02dc03da80372820a2122f07c7ded1b
3
- size 489680
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f19e704d962cada4d1631fb439b813717114bcd450da2f20e9635820afe0d8a3
3
+ size 244844
media/mini-jasper.wav CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:4c1b9a5e19b9da84a50cb0f1748c9b7b0337b101da38a69c3cd3afc1da105c0b
3
- size 420080
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:749c37683a159ff4382f766ecb4223cd5f9d201b7625a0485f1469d3664b7233
3
+ size 211244
media/mini-mark.wav CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:6db39b8680105bd321d61e4a9a4d8d21dd16a176f8076d9127738be5d15ac970
3
- size 487280
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:519dc95ce67ddb1028a4889f5a0f85d0a3811f7d14f3c1a7e61b60ece3ccbf9c
3
+ size 243644
media/mini-sophia.wav CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:25c6054f38f9fd83ff45f03fb0c27e0fdc5024622bb8d38bc9941921f5b3f365
3
- size 367280
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0b287830a021088f187fa50b929b6a6857d60051e226277822743e36638c7df9
3
+ size 183644
release-manifest.json CHANGED
@@ -34,6 +34,10 @@
34
  "bytes": 2278,
35
  "sha256": "ee7aa2d54a1bea5e5795afbada2553e9c2055b2d41b00b645e114d100dffb53d"
36
  },
 
 
 
 
37
  "LICENSE.md": {
38
  "bytes": 10455,
39
  "sha256": "12c48c640d1d0baf158d45175a4238b9227c71c77f50b0d15791b8efc08cd793"
@@ -43,13 +47,21 @@
43
  "sha256": "09f0b40a96cb8c6e533d3bc813127a637114ebaf61037ca821a7d1212f1463b7"
44
  },
45
  "README.md": {
46
- "bytes": 10819,
47
- "sha256": "66bf54eda16174d80fd9e995ba02ecee3d2ce9808d2d07673e239e68a9c9b862"
48
  },
49
  "THIRD_PARTY_NOTICES.md": {
50
  "bytes": 808,
51
  "sha256": "e57d036bd8a6ea496ee83c4ac1bbce04a5daa50217519b2e9d6458d4af5fd5c1"
52
  },
 
 
 
 
 
 
 
 
53
  "assets/banner-v3.svg": {
54
  "bytes": 3866,
55
  "sha256": "80cb5ebf977d063829b54c9764b39de4e8ee37d2d6fd6b03bbbf6a037ba57cdb"
@@ -86,6 +98,10 @@
86
  "bytes": 296,
87
  "sha256": "a6a25c3fd266aefa028b8c04c145449d4896af1386b8510d46c6cac539504c70"
88
  },
 
 
 
 
89
  "core/BETA_ACCESS.md": {
90
  "bytes": 564,
91
  "sha256": "87b3a1c704484f13785a1604ab0ea8a43d0b8c9210469565178f25498bd7fd5a"
@@ -334,6 +350,10 @@
334
  "bytes": 12806127,
335
  "sha256": "46d3dd0637e3149283812025c13144e07c324648987589fb9210a98bb7cd8351"
336
  },
 
 
 
 
337
  "extras/events/README.md": {
338
  "bytes": 2607,
339
  "sha256": "472d58112103d5992ed14ae1cf15bde6869777d40c0cd8f01edc690b7a754628"
@@ -1835,32 +1855,32 @@
1835
  "sha256": "0938b6e5e049f3e7987cc3bc32ca379f96c854ee175aeb883e25e6f00da8691c"
1836
  },
1837
  "media/mini-cassidy-48k.wav": {
1838
- "bytes": 643280,
1839
- "sha256": "14d7eb456f23a4779c623523cc1be4a5b9efbbd3b223e5a9d442e785171cb1b0"
1840
  },
1841
  "media/mini-cassidy.wav": {
1842
- "bytes": 321680,
1843
- "sha256": "0fd1fb2b1e749d8d1b62c3ef4e6fb4c8a183e33f37fac9d78950a91582435006"
1844
  },
1845
  "media/mini-hope.wav": {
1846
- "bytes": 429680,
1847
- "sha256": "63d96ec424d2ae9c21cdc2d603c3fa46fb1b8a3f53c74186d0c16e6ee7698063"
1848
  },
1849
  "media/mini-james.wav": {
1850
- "bytes": 489680,
1851
- "sha256": "7428c06e88ff7d955e9c893c4a7620b2a02dc03da80372820a2122f07c7ded1b"
1852
  },
1853
  "media/mini-jasper.wav": {
1854
- "bytes": 420080,
1855
- "sha256": "4c1b9a5e19b9da84a50cb0f1748c9b7b0337b101da38a69c3cd3afc1da105c0b"
1856
  },
1857
  "media/mini-mark.wav": {
1858
- "bytes": 487280,
1859
- "sha256": "6db39b8680105bd321d61e4a9a4d8d21dd16a176f8076d9127738be5d15ac970"
1860
  },
1861
  "media/mini-sophia.wav": {
1862
- "bytes": 367280,
1863
- "sha256": "25c6054f38f9fd83ff45f03fb0c27e0fdc5024622bb8d38bc9941921f5b3f365"
1864
  },
1865
  "run.py": {
1866
  "bytes": 1347,
 
34
  "bytes": 2278,
35
  "sha256": "ee7aa2d54a1bea5e5795afbada2553e9c2055b2d41b00b645e114d100dffb53d"
36
  },
37
+ "EVALUATION.md": {
38
+ "bytes": 3298,
39
+ "sha256": "fe31998e16271b8f002e9057a39a30a54d888f2941a24764c36aca445a80c968"
40
+ },
41
  "LICENSE.md": {
42
  "bytes": 10455,
43
  "sha256": "12c48c640d1d0baf158d45175a4238b9227c71c77f50b0d15791b8efc08cd793"
 
47
  "sha256": "09f0b40a96cb8c6e533d3bc813127a637114ebaf61037ca821a7d1212f1463b7"
48
  },
49
  "README.md": {
50
+ "bytes": 12119,
51
+ "sha256": "7a6c911865b5dd4b50b5f5a3733d34bf77931623be6a8f2df967747384a5c6f7"
52
  },
53
  "THIRD_PARTY_NOTICES.md": {
54
  "bytes": 808,
55
  "sha256": "e57d036bd8a6ea496ee83c4ac1bbce04a5daa50217519b2e9d6458d4af5fd5c1"
56
  },
57
+ "assets/audio-provenance-historical.json": {
58
+ "bytes": 3472,
59
+ "sha256": "024bac809f7ff008633fa3164afb1104634a3022edf89891d28e97a4aec8e621"
60
+ },
61
+ "assets/audio-provenance.json": {
62
+ "bytes": 4538,
63
+ "sha256": "c0f31862facd6f735021f47e6116d839cb14bd8350e4078c7db9583c3fd6282e"
64
+ },
65
  "assets/banner-v3.svg": {
66
  "bytes": 3866,
67
  "sha256": "80cb5ebf977d063829b54c9764b39de4e8ee37d2d6fd6b03bbbf6a037ba57cdb"
 
98
  "bytes": 296,
99
  "sha256": "a6a25c3fd266aefa028b8c04c145449d4896af1386b8510d46c6cac539504c70"
100
  },
101
+ "config.json": {
102
+ "bytes": 4449,
103
+ "sha256": "996015c421f3b6ed32c215658e4c3ba1170d484589f85e7112d70576c0bb78ae"
104
+ },
105
  "core/BETA_ACCESS.md": {
106
  "bytes": 564,
107
  "sha256": "87b3a1c704484f13785a1604ab0ea8a43d0b8c9210469565178f25498bd7fd5a"
 
350
  "bytes": 12806127,
351
  "sha256": "46d3dd0637e3149283812025c13144e07c324648987589fb9210a98bb7cd8351"
352
  },
353
+ "evaluation.json": {
354
+ "bytes": 34349,
355
+ "sha256": "9d4d3bb768bf3ead93b554018cc29a976dfe44800a1e937ecd09bd77baabc77f"
356
+ },
357
  "extras/events/README.md": {
358
  "bytes": 2607,
359
  "sha256": "472d58112103d5992ed14ae1cf15bde6869777d40c0cd8f01edc690b7a754628"
 
1855
  "sha256": "0938b6e5e049f3e7987cc3bc32ca379f96c854ee175aeb883e25e6f00da8691c"
1856
  },
1857
  "media/mini-cassidy-48k.wav": {
1858
+ "bytes": 321644,
1859
+ "sha256": "026b630c677db87402b07dfa5def996151ac4d70bc578b4a5da3667c41d0a67c"
1860
  },
1861
  "media/mini-cassidy.wav": {
1862
+ "bytes": 160844,
1863
+ "sha256": "ecf10e95b951c66facf75049ffe423a073b2f0de002de4a220ace75e8aed69bb"
1864
  },
1865
  "media/mini-hope.wav": {
1866
+ "bytes": 214844,
1867
+ "sha256": "d444a7e7d8caa08b5b9723f08e0447132b461b3757bdc7f4da82a0ca7433a359"
1868
  },
1869
  "media/mini-james.wav": {
1870
+ "bytes": 244844,
1871
+ "sha256": "f19e704d962cada4d1631fb439b813717114bcd450da2f20e9635820afe0d8a3"
1872
  },
1873
  "media/mini-jasper.wav": {
1874
+ "bytes": 211244,
1875
+ "sha256": "749c37683a159ff4382f766ecb4223cd5f9d201b7625a0485f1469d3664b7233"
1876
  },
1877
  "media/mini-mark.wav": {
1878
+ "bytes": 243644,
1879
+ "sha256": "519dc95ce67ddb1028a4889f5a0f85d0a3811f7d14f3c1a7e61b60ece3ccbf9c"
1880
  },
1881
  "media/mini-sophia.wav": {
1882
+ "bytes": 183644,
1883
+ "sha256": "0b287830a021088f187fa50b929b6a6857d60051e226277822743e36638c7df9"
1884
  },
1885
  "run.py": {
1886
  "bytes": 1347,