Stage verified Inflect v2 release candidate and evaluation evidence

.gitattributes

@@ -40,3 +40,4 @@ samples/male/punctuation.wav filter=lfs diff=lfs merge=lfs -text
 samples/male/technical.wav filter=lfs diff=lfs merge=lfs -text
 smoke/release_smoke.wav filter=lfs diff=lfs merge=lfs -text
 smoke/standalone_cpu.wav filter=lfs diff=lfs merge=lfs -text
+assets/inflect-v2-repository-hero.png filter=lfs diff=lfs merge=lfs -text

CHANGELOG.md

@@ -0,0 +1,7 @@
+# Changelog
+
+## 2.0.0 - 2026-07-22
+
+- Release Inflect-Micro-v2 as a complete 24 kHz English text-to-waveform package.
+- Add punctuation-preserving normalization, long-text chunking, deterministic seeds, speed control, and variation control.
+- Publish matched 500-prompt evaluation, community blind-listening evidence, runtime reports, samples, and integrity hashes.

CITATION.cff

@@ -0,0 +1,11 @@
+cff-version: 1.2.0
+message: If you use this model, please cite it.
+title: 'Inflect-Micro-v2'
+type: software
+authors:
+  - family-names: Song
+    given-names: Owen
+version: 2.0.0
+date-released: 2026-07-22
+url: 'https://huggingface.co/owensong/Inflect-Micro-v2'
+license: Apache-2.0

README.md

@@ -11,78 +11,120 @@ tags:
   - small-model
   - vits
   - 24khz
+library_name: pytorch
 ---
 
-<h1 align="center">Inflect-Micro-v2</h1>
-
-<p align="center"><strong>A complete 24 kHz text-to-waveform TTS system in 9,356,513 parameters.</strong><br>One English voice. CPU-ready. No external vocoder.</p>
+![Inflect v2](assets/inflect-v2-repository-hero.png)
 
-<p align="center"><a href="https://huggingface.co/spaces/owensong/Inflect-v2-Private-Playground"><strong>Try Micro and Nano in the browser</strong></a></p>
+<h1 align="center">Inflect-Micro-v2</h1>
+<p align="center"><strong>Complete local TTS under 10M parameters.</strong><br>A complete 24 kHz English text-to-waveform model with its neural waveform decoder included.</p>
+<p align="center"><a href="https://huggingface.co/spaces/owensong/Inflect-v2-Private-Playground"><strong>Try it in the browser</strong></a> · <a href="https://huggingface.co/owensong/Inflect-Nano-v2">Inflect-Nano-v2</a> · <a href="#evaluation">Evaluation</a> · <a href="#limitations">Limitations</a></p>
 
-Inflect-Micro-v2 is designed for local applications where the entire speech stack must fit below **10M parameters**. The count includes text encoding, duration modeling, latent generation, and waveform decoding. It does not hide a separately downloaded vocoder.
+Inflect-Micro-v2 is the quality-focused member of Inflect v2. The complete deployable system has **9,356,513 parameters**; there is no second vocoder download and no hidden large language model at inference time.
 
 ## Listen First
 
-All samples below use unseen evaluation text, not training-audio reconstructions.
+Every clip below uses held-out text rather than a training-audio reconstruction.
 
-| Prompt | Male voice |
+| Prompt type | Audio |
 | --- | --- |
-| **Conversational** - It wasn't until later that I realized what had actually happened. | <audio controls preload="none" src="samples/male/conversational.wav"></audio> |
-| **Punctuation** - First, close the window; second, turn off the lamp; finally, lock the door. | <audio controls preload="none" src="samples/male/punctuation.wav"></audio> |
-| **Numbers** - The package weighs twelve point six kilograms and arrived on July twenty-first. | <audio controls preload="none" src="samples/male/numbers.wav"></audio> |
-| **Names Places** - Gwendolyn photographed the eucalyptus trees outside Ljubljana. | <audio controls preload="none" src="samples/male/names_places.wav"></audio> |
-| **Technical** - The system runs on three core components that all have to stay in sync. | <audio controls preload="none" src="samples/male/technical.wav"></audio> |
+| Conversational | <audio controls preload="none" src="samples/male/conversational.wav"></audio> |
+| Punctuation | <audio controls preload="none" src="samples/male/punctuation.wav"></audio> |
+| Numbers | <audio controls preload="none" src="samples/male/numbers.wav"></audio> |
+| Names and places | <audio controls preload="none" src="samples/male/names_places.wav"></audio> |
+| Technical | <audio controls preload="none" src="samples/male/technical.wav"></audio> |
 
-## Model Facts
+## At a Glance
 
 | | Inflect-Micro-v2 |
 | --- | ---: |
-| Deployable inference parameters | **9,356,513** |
-| PyTorch checkpoint size | **37.53 MB** |
+| Complete deployable parameters | **9,356,513** |
+| FP32 model weights | **37.53 MB** |
 | Sample rate | **24 kHz** |
-| Included voices | **1 male voice** |
+| Voice | **1 fixed English male voice** |
 | External vocoder | **None** |
-| Inference package | **PyTorch** |
+| Release format | **PyTorch FP32** |
+| Long text | **Punctuation-aware chunking** |
+
+Inflect v2 is released in two deliberately different sizes. **Micro** spends its larger budget on waveform capacity and hidden width; **Nano** prioritizes footprint while preserving the same public runtime and text frontend. Both numbers above count the complete deployable generator, including the waveform decoder.
 
-## Training Data
+## Human Listening
 
-The deployable Inflect weights were trained from scratch on a single-speaker synthetic English corpus produced with Qwen3-TTS. Qwen3-TTS is a training-time teacher only and is not downloaded or used for inference. The corpus itself is not included in this repository.
+![Community blind listening](assets/evidence/human-preference.svg)
+
+Inflect-Micro-v2 recorded a **66.2% preference rate** (21 wins, 10 losses, 3 ties) in the final anonymous community study. The full study contains **147 pairwise decisions** across the published lineup. Ties count as half a win. This is descriptive community evidence, not a formal MOS study; pair coverage and vote counts differ by system.
 
 ## Evaluation
 
-![Matched unseen-text evaluation](assets/matched-evaluation.svg)
+### Quality versus footprint
 
-| System | UTMOS22 higher is better | Whisper-large-v3 semantic WER lower is better |
-| --- | ---: | ---: |
-| Inflect-Micro-v2 | 4.406 | 1.23% |
-| Inflect-Nano-v2 | 4.392 | 1.53% |
-| Piper Ryan Low | 4.256 | 1.23% |
-| Kitten Nano Bruno | 4.246 | 0.96% |
+![Predicted quality versus footprint](assets/evidence/quality-vs-footprint.svg)
 
-The selected Inflect-Micro-v2 checkpoint scored **4.406 UTMOS22** and **1.23% semantic WER** on the matched 200-prompt release set. Automated metrics are diagnostics, not substitutes for listening.
+### Intelligibility
 
-<details>
-<summary><strong>Evaluation protocol and raw reports</strong></summary>
+![Semantic WER](assets/evidence/semantic-wer.svg)
+
+### Cross-ASR robustness
+
+![Semantic WER across ASR families](assets/evidence/asr-robustness.svg)
+
+### CPU throughput
+
+![Warm CPU throughput](assets/evidence/cpu-throughput.svg)
+
+### Quality and speed
+
+![Quality and CPU throughput](assets/evidence/quality-vs-cpu-speed.svg)
+
+### Error analysis
+
+![Semantic WER by prompt category](assets/evidence/category-semantic-wer.svg)
+
+### Complete model footprint
+
+![Model footprint](assets/evidence/model-footprint.svg)
 
-- All four systems synthesize the same 200 unseen English prompts.
-- Semantic WER uses Whisper-large-v3 and the disclosed English text normalizer.
-- UTMOS22 uses `tarepan/SpeechMOS` v1.2.0 with 5,000 paired bootstrap samples.
-- NISQA dimensions, signal diagnostics, categorized ASR failures, speaker consistency, and multi-seed robustness are under `evaluation/`.
-- `evaluation/asr_robustness.json` separates sentence failures, semantic character errors, tail WER, and category-level errors.
-- Competitor results apply only to the named checkpoints and voices, not every configuration of those projects.
+| System | Weights | UTMOS22 ↑ | Semantic WER ↓ |
+| --- | ---: | ---: | ---: |
+| **Inflect-Micro-v2** | 37.5 MB | 4.395 | 1.93% |
+| **Inflect-Nano-v2** | 16.0 MB | 4.386 | 2.48% |
+| KittenTTS Nano · Bruno | 56.8 MB | 4.217 | 0.97% |
+| KittenTTS Nano · Hugo | 56.8 MB | 4.191 | 1.15% |
+| Piper · Ryan Low | 63.1 MB | 4.289 | 2.33% |
+| Piper · Danny Low | 63.1 MB | 4.195 | 1.81% |
+| Supertonic 3 · James · 3-step | 398.1 MB | 2.471 | 692.82% |
+| Supertonic 3 · James · 8-step | 398.1 MB | 4.295 | 622.52% |
+
+On the 500-prompt matched set, Inflect-Micro-v2 measured **4.395 UTMOS22** (95% bootstrap CI 4.381–4.408) and **1.93% semantic WER** (95% CI 1.46–2.42). UTMOS22 is an automated quality predictor, not human MOS. WER measures transcript recoverability, not naturalness.
+
+Under the prespecified Whisper-large-v3 protocol, Supertonic produced insertion-heavy hypotheses and landed off-scale at **692.82%** (3-step) and **622.52%** (8-step). The independent wav2vec2 pass scored the same clips at **13.47%** and **3.76%**, respectively. This large disagreement is reported as ASR-family sensitivity, not collapsed into an aggregate or interpreted as a direct measure of Supertonic intelligibility. Exact hypotheses and per-clip errors ship in the raw reports.
+
+<details>
+<summary><strong>Protocol and raw evidence</strong></summary>
+
+- 500 identical unseen English prompts per system; 4,000 generated clips total.
+- The set combines a 200-prompt stress corpus with 300 deterministic CMU Arctic phonetic-balance sentences.
+- Exact-text exclusion was run against 87,362 training transcripts.
+- Headline semantic WER uses Whisper-large-v3 and the disclosed English normalizer; wav2vec2 LV-60K is included as an independent ASR-sensitivity check.
+- UTMOS22 uses `tarepan/SpeechMOS` v1.2.0.
+- Headline intervals use 10,000 bootstrap samples.
+- Kitten and Piper voices are reported separately; equal-weight family averages are in `evaluation/final/evidence-summary.json`.
+- Supertonic 3-step and 8-step are never pooled.
+- Per-clip outputs, category breakdowns, runtime rows, and signal diagnostics are under `evaluation/final/`.
 
 </details>
 
 ## Quickstart
 
 ```bash
-pip install torch numpy scipy soundfile phonemizer espeakng-loader num2words Unidecode huggingface_hub
-hf download owensong/Inflect-Micro-v2 --local-dir Inflect-Micro-v2
-python Inflect-Micro-v2/inference.py --model-dir Inflect-Micro-v2 --device cpu --text "Small models should still sound alive." --output sample.wav
+pip install -r requirements.txt
+python inference.py \
+  --model-dir . \
+  --device cpu \
+  --text "A small voice can still have something meaningful to say." \
+  --output sample.wav
 ```
 
-Python:
-
 ```python
 import sys
 from huggingface_hub import snapshot_download
@@ -92,58 +134,94 @@ sys.path.insert(0, model_dir)
 from inference import InflectTTS
 
 tts = InflectTTS(model_dir, device="cpu")
-tts.save("The complete model runs locally.", "sample.wav", seed=7)
+tts.save(
+    "The complete speech model runs locally.",
+    "sample.wav",
+    speed=1.0,
+    variation=0.667,
+    seed=7,
+)
 ```
 
-Long text is split at punctuation-aware boundaries by the packaged runtime. `speed` ranges from `0.5` to `2.0`; `variation` ranges from `0.0` to `1.0`.
+The packaged runtime accepts `speed` from `0.5` to `2.0`, `variation` from `0.0` to `1.0`, and a deterministic integer seed. Long input is split at punctuation-aware boundaries and concatenated with controlled pauses.
+
+### Controls
+
+| Control | Default | Effect |
+| --- | ---: | --- |
+| `speed` | `1.0` | Speech rate; supported range `0.5`–`2.0` |
+| `variation` | `0.667` | Stochastic latent variation; lower is steadier, higher is more variable |
+| `seed` | `0` | Reproducible sampling seed; incremented per long-text chunk |
+
+Use a fixed seed when comparing systems. A different seed is a different stochastic sample, not a different checkpoint.
 
 ## Architecture
 
-Inflect v2 is a size-specific compact VITS-derived system:
+Inflect v2 is a **parameter-efficient VITS-family, end-to-end text-to-waveform speech generator** with a phoneme frontend, monotonic alignment, stochastic latent synthesis, and an integrated neural waveform decoder.
 
-- English normalization and stress-marked eSpeak phonemes with punctuation retained
-- compact Transformer text encoder and deterministic duration predictor
-- monotonic alignment, posterior encoder, and residual coupling flow during training
-- integrated adversarial waveform decoder
-- multi-resolution STFT, adversarial, feature, mel, duration, and KL supervision
+- punctuation-preserving English normalization and stress-marked phonemes
+- compact Transformer text encoder and duration model
+- latent prior and residual coupling flow
+- integrated adversarial waveform decoder at 24 kHz
+- inference-only checkpoint with training discriminators and optimizer state removed
 
-| Component setting | Value |
+| Component | Value |
 | --- | ---: |
 | Latent channels | 192 |
 | Text hidden channels | 96 |
 | Text encoder layers / heads | 3 / 2 |
 | Feed-forward channels | 768 |
-| Posterior encoder layers | 3 |
+| Flow coupling blocks | 4 |
 | Initial decoder channels | 320 |
 | Upsample rates | 8, 8, 2, 2 |
 | Training segment | 16,384 samples |
 
-The downloadable checkpoint is inference-only. Training discriminators and optimizer state are excluded from both the package and deployable parameter count.
+The model card describes the deployable architecture. The private corpus-construction and optimization recipe is not part of this open-weight release.
 
 ## Runtime
 
-End-to-end warm inference, including the text frontend:
+Warm end-to-end CPU inference on **AMD EPYC 7K62 48-Core Processor**, with **192 logical CPUs visible** to the isolated process and runtime-default thread settings:
 
-| Device | RTF lower is better | Audio / wall time | p95 utterance latency | Load time |
-| --- | ---: | ---: | ---: | ---: |
-| CPU | 0.6969 | 1.4x | 4.398 s | 1.29 s |
-| CUDA | 0.0168 | 59.5x | 0.086 s | 1.36 s |
+| RTF ↓ | Audio / wall time ↑ | Median latency | p95 latency | Cold load |
+| ---: | ---: | ---: | ---: | ---: |
+| 0.7431 | 1.35× | 3.205 s | 4.681 s | 1.35 s |
 
-Runtime depends strongly on CPU, PyTorch build, thread settings, and text length. Reproduce it from the JSON reports under `evaluation/runtime/`.
+Runtime varies with processor, PyTorch build, thread policy, text length, and operating system. Use the raw report rather than extrapolating these measurements to untested devices.
+
+## Fine-tuning
+
+The initial release is inference-first. The checkpoint is structurally compatible with voice and language adaptation, but the private training recipe and corpus-generation pipeline are not included. A tested public adaptation toolkit should be treated as a separate release rather than inferred from the inference package. See `docs/FINETUNING.md` for the supported status and data contract.
+
+## Repository Layout
+
+| Path | Purpose |
+| --- | --- |
+| `model.pth` | Inference-only generator checkpoint |
+| `config.json` | Deployable architecture and audio configuration |
+| `inference.py` | Public Python API and CLI |
+| `inflect_vits_frontend.py` | Normalization, phonemization, and punctuation frontend |
+| `runtime/` | Self-contained model implementation required for inference |
+| `samples/` | Held-out example generations |
+| `evaluation/final/` | Final matched benchmark reports and protocol artifacts |
+| `release_manifest.json` | File sizes and SHA-256 integrity hashes |
 
 ## Limitations
 
-- English only, with one fixed male voice; this release does not support voice cloning.
+- English only and one fixed male voice. This is not a zero-shot voice-cloning model.
 - Unfamiliar phrasing can become flatter or less expressive.
-- Numbers and uncommon names are the weakest intelligibility categories in the release evaluation; verify critical verbalizations.
-- Homograph pronunciation depends on context available to the frontend.
-- Long passages are synthesized in chunks rather than as one unbounded sequence.
-- This model is not validated for medical, legal, emergency, or accessibility-critical use.
-- Synthetic training speech can transfer teacher cadence and biases.
+- Numbers, abbreviations, homographs, and uncommon names depend strongly on frontend normalization and context.
+- Long passages are synthesized in chunks, so transitions can differ from a single long-form model pass.
+- Stochastic variation can change pronunciation and timing; use a fixed seed for reproducibility.
+- Learned MOS predictors can reward or penalize spectral traits differently from human listeners.
+- Not validated for medical, legal, emergency, or accessibility-critical communication.
+
+## Responsible Use
+
+Do not use the included voice to impersonate a real person, deceive listeners, or create fraudulent content. Disclose synthetic speech where the context could otherwise mislead. Users are responsible for applicable laws and the license.
 
 ## Integrity and License
 
-`release_manifest.json` records the source checkpoint, deployable parameter count, byte sizes, and SHA-256 hashes. Original Inflect work is licensed under Apache-2.0; bundled third-party portions retain the notices in `THIRD_PARTY_NOTICES.md`. Do not use the included voice to impersonate a real person or deceive listeners.
+`release_manifest.json` records file sizes and SHA-256 hashes. Original Inflect code and weights in this repository are licensed under Apache-2.0; bundled third-party components retain their own notices in `THIRD_PARTY_NOTICES.md`.
 
 ## Citation
 

assets/evidence/evidence-summary.json

@@ -0,0 +1,1990 @@
+{
+  "format": "inflect_v2_release_evidence_v1",
+  "systems": {
+    "inflect-micro-v2": {
+      "label": "Inflect-Micro-v2",
+      "weight_mb": 37.529995,
+      "semantic_wer": {
+        "wer": 0.019293218720152817,
+        "ci": [
+          0.014622733476311172,
+          0.024179280518969924
+        ],
+        "categories": {
+          "conversational": {
+            "raw": {
+              "utterances": 25,
+              "errors": 0,
+              "words": 296,
+              "wer": 0.0
+            },
+            "semantic": {
+              "utterances": 25,
+              "errors": 0,
+              "words": 309,
+              "wer": 0.0
+            }
+          },
+          "descriptive": {
+            "raw": {
+              "utterances": 16,
+              "errors": 2,
+              "words": 217,
+              "wer": 0.009216589861751152
+            },
+            "semantic": {
+              "utterances": 16,
+              "errors": 1,
+              "words": 226,
+              "wer": 0.004424778761061947
+            }
+          },
+          "emotional": {
+            "raw": {
+              "utterances": 24,
+              "errors": 0,
+              "words": 314,
+              "wer": 0.0
+            },
+            "semantic": {
+              "utterances": 24,
+              "errors": 0,
+              "words": 329,
+              "wer": 0.0
+            }
+          },
+          "homographs": {
+            "raw": {
+              "utterances": 6,
+              "errors": 2,
+              "words": 70,
+              "wer": 0.02857142857142857
+            },
+            "semantic": {
+              "utterances": 6,
+              "errors": 2,
+              "words": 70,
+              "wer": 0.02857142857142857
+            }
+          },
+          "long": {
+            "raw": {
+              "utterances": 15,
+              "errors": 3,
+              "words": 412,
+              "wer": 0.007281553398058253
+            },
+            "semantic": {
+              "utterances": 15,
+              "errors": 3,
+              "words": 432,
+              "wer": 0.006944444444444444
+            }
+          },
+          "long_range": {
+            "raw": {
+              "utterances": 6,
+              "errors": 0,
+              "words": 121,
+              "wer": 0.0
+            },
+            "semantic": {
+              "utterances": 6,
+              "errors": 0,
+              "words": 121,
+              "wer": 0.0
+            }
+          },
+          "names_places": {
+            "raw": {
+              "utterances": 6,
+              "errors": 4,
+              "words": 57,
+              "wer": 0.07017543859649122
+            },
+            "semantic": {
+              "utterances": 6,
+              "errors": 4,
+              "words": 57,
+              "wer": 0.07017543859649122
+            }
+          },
+          "narrative": {
+            "raw": {
+              "utterances": 24,
+              "errors": 2,
+              "words": 342,
+              "wer": 0.005847953216374269
+            },
+            "semantic": {
+              "utterances": 24,
+              "errors": 1,
+              "words": 352,
+              "wer": 0.002840909090909091
+            }
+          },
+          "numbers": {
+            "raw": {
+              "utterances": 6,
+              "errors": 33,
+              "words": 81,
+              "wer": 0.4074074074074074
+            },
+            "semantic": {
+              "utterances": 6,
+              "errors": 8,
+              "words": 64,
+              "wer": 0.125
+            }
+          },
+          "phonetic_balance": {
+            "raw": {
+              "utterances": 300,
+              "errors": 82,
+              "words": 2605,
+              "wer": 0.03147792706333973
+            },
+            "semantic": {
+              "utterances": 300,
+              "errors": 68,
+              "words": 2627,
+              "wer": 0.02588503996954701
+            }
+          },
+          "punctuation": {
+            "raw": {
+              "utterances": 6,
+              "errors": 0,
+              "words": 65,
+              "wer": 0.0
+            },
+            "semantic": {
+              "utterances": 6,
+              "errors": 0,
+              "words": 65,
+              "wer": 0.0
+            }
+          },
+          "question": {
+            "raw": {
+              "utterances": 15,
+              "errors": 0,
+              "words": 163,
+              "wer": 0.0
+            },
+            "semantic": {
+              "utterances": 15,
+              "errors": 0,
+              "words": 165,
+              "wer": 0.0
+            }
+          },
+          "rare_words": {
+            "raw": {
+              "utterances": 6,
+              "errors": 3,
+              "words": 57,
+              "wer": 0.05263157894736842
+            },
+            "semantic": {
+              "utterances": 6,
+              "errors": 3,
+              "words": 57,
+              "wer": 0.05263157894736842
+            }
+          },
+          "short": {
+            "raw": {
+              "utterances": 24,
+              "errors": 3,
+              "words": 98,
+              "wer": 0.030612244897959183
+            },
+            "semantic": {
+              "utterances": 24,
+              "errors": 3,
+              "words": 105,
+              "wer": 0.02857142857142857
+            }
+          },
+          "technical": {
+            "raw": {
+              "utterances": 21,
+              "errors": 12,
+              "words": 251,
+              "wer": 0.04780876494023904
+            },
+            "semantic": {
+              "utterances": 21,
+              "errors": 8,
+              "words": 256,
+              "wer": 0.03125
+            }
+          }
+        }
+      },
+      "utmos22": {
+        "mean": 4.395012595653534,
+        "ci": [
+          4.3812509111166,
+          4.4079569326162344
+        ]
+      }
+    },
+    "inflect-nano-v2": {
+      "label": "Inflect-Nano-v2",
+      "weight_mb": 15.971083,
+      "semantic_wer": {
+        "wer": 0.024832855778414518,
+        "ci": [
+          0.019525267993874426,
+          0.030727866333781446
+        ],
+        "categories": {
+          "conversational": {
+            "raw": {
+              "utterances": 25,
+              "errors": 5,
+              "words": 296,
+              "wer": 0.016891891891891893
+            },
+            "semantic": {
+              "utterances": 25,
+              "errors": 3,
+              "words": 309,
+              "wer": 0.009708737864077669
+            }
+          },
+          "descriptive": {
+            "raw": {
+              "utterances": 16,
+              "errors": 2,
+              "words": 217,
+              "wer": 0.009216589861751152
+            },
+            "semantic": {
+              "utterances": 16,
+              "errors": 1,
+              "words": 226,
+              "wer": 0.004424778761061947
+            }
+          },
+          "emotional": {
+            "raw": {
+              "utterances": 24,
+              "errors": 1,
+              "words": 314,
+              "wer": 0.0031847133757961785
+            },
+            "semantic": {
+              "utterances": 24,
+              "errors": 1,
+              "words": 329,
+              "wer": 0.00303951367781155
+            }
+          },
+          "homographs": {
+            "raw": {
+              "utterances": 6,
+              "errors": 3,
+              "words": 70,
+              "wer": 0.04285714285714286
+            },
+            "semantic": {
+              "utterances": 6,
+              "errors": 3,
+              "words": 70,
+              "wer": 0.04285714285714286
+            }
+          },
+          "long": {
+            "raw": {
+              "utterances": 15,
+              "errors": 3,
+              "words": 412,
+              "wer": 0.007281553398058253
+            },
+            "semantic": {
+              "utterances": 15,
+              "errors": 3,
+              "words": 432,
+              "wer": 0.006944444444444444
+            }
+          },
+          "long_range": {
+            "raw": {
+              "utterances": 6,
+              "errors": 1,
+              "words": 121,
+              "wer": 0.008264462809917356
+            },
+            "semantic": {
+              "utterances": 6,
+              "errors": 1,
+              "words": 121,
+              "wer": 0.008264462809917356
+            }
+          },
+          "names_places": {
+            "raw": {
+              "utterances": 6,
+              "errors": 3,
+              "words": 57,
+              "wer": 0.05263157894736842
+            },
+            "semantic": {
+              "utterances": 6,
+              "errors": 3,
+              "words": 57,
+              "wer": 0.05263157894736842
+            }
+          },
+          "narrative": {
+            "raw": {
+              "utterances": 24,
+              "errors": 5,
+              "words": 342,
+              "wer": 0.014619883040935672
+            },
+            "semantic": {
+              "utterances": 24,
+              "errors": 4,
+              "words": 352,
+              "wer": 0.011363636363636364
+            }
+          },
+          "numbers": {
+            "raw": {
+              "utterances": 6,
+              "errors": 33,
+              "words": 81,
+              "wer": 0.4074074074074074
+            },
+            "semantic": {
+              "utterances": 6,
+              "errors": 6,
+              "words": 64,
+              "wer": 0.09375
+            }
+          },
+          "phonetic_balance": {
+            "raw": {
+              "utterances": 300,
+              "errors": 96,
+              "words": 2605,
+              "wer": 0.03685220729366603
+            },
+            "semantic": {
+              "utterances": 300,
+              "errors": 83,
+              "words": 2627,
+              "wer": 0.031594975256947086
+            }
+          },
+          "punctuation": {
+            "raw": {
+              "utterances": 6,
+              "errors": 0,
+              "words": 65,
+              "wer": 0.0
+            },
+            "semantic": {
+              "utterances": 6,
+              "errors": 0,
+              "words": 65,
+              "wer": 0.0
+            }
+          },
+          "question": {
+            "raw": {
+              "utterances": 15,
+              "errors": 1,
+              "words": 163,
+              "wer": 0.006134969325153374
+            },
+            "semantic": {
+              "utterances": 15,
+              "errors": 1,
+              "words": 165,
+              "wer": 0.006060606060606061
+            }
+          },
+          "rare_words": {
+            "raw": {
+              "utterances": 6,
+              "errors": 5,
+              "words": 57,
+              "wer": 0.08771929824561403
+            },
+            "semantic": {
+              "utterances": 6,
+              "errors": 5,
+              "words": 57,
+              "wer": 0.08771929824561403
+            }
+          },
+          "short": {
+            "raw": {
+              "utterances": 24,
+              "errors": 8,
+              "words": 98,
+              "wer": 0.08163265306122448
+            },
+            "semantic": {
+              "utterances": 24,
+              "errors": 8,
+              "words": 105,
+              "wer": 0.0761904761904762
+            }
+          },
+          "technical": {
+            "raw": {
+              "utterances": 21,
+              "errors": 12,
+              "words": 251,
+              "wer": 0.04780876494023904
+            },
+            "semantic": {
+              "utterances": 21,
+              "errors": 8,
+              "words": 256,
+              "wer": 0.03125
+            }
+          }
+        }
+      },
+      "utmos22": {
+        "mean": 4.3861008615493775,
+        "ci": [
+          4.372184220826625,
+          4.3987462292552
+        ]
+      }
+    },
+    "kitten-nano-bruno": {
+      "label": "KittenTTS Nano \u00b7 Bruno",
+      "weight_mb": 56.767095,
+      "semantic_wer": {
+        "wer": 0.009742120343839542,
+        "ci": [
+          0.006622516556291391,
+          0.013268998793727383
+        ],
+        "categories": {
+          "conversational": {
+            "raw": {
+              "utterances": 25,
+              "errors": 0,
+              "words": 296,
+              "wer": 0.0
+            },
+            "semantic": {
+              "utterances": 25,
+              "errors": 0,
+              "words": 309,
+              "wer": 0.0
+            }
+          },
+          "descriptive": {
+            "raw": {
+              "utterances": 16,
+              "errors": 1,
+              "words": 217,
+              "wer": 0.004608294930875576
+            },
+            "semantic": {
+              "utterances": 16,
+              "errors": 0,
+              "words": 226,
+              "wer": 0.0
+            }
+          },
+          "emotional": {
+            "raw": {
+              "utterances": 24,
+              "errors": 0,
+              "words": 314,
+              "wer": 0.0
+            },
+            "semantic": {
+              "utterances": 24,
+              "errors": 0,
+              "words": 329,
+              "wer": 0.0
+            }
+          },
+          "homographs": {
+            "raw": {
+              "utterances": 6,
+              "errors": 1,
+              "words": 70,
+              "wer": 0.014285714285714285
+            },
+            "semantic": {
+              "utterances": 6,
+              "errors": 1,
+              "words": 70,
+              "wer": 0.014285714285714285
+            }
+          },
+          "long": {
+            "raw": {
+              "utterances": 15,
+              "errors": 2,
+              "words": 412,
+              "wer": 0.0048543689320388345
+            },
+            "semantic": {
+              "utterances": 15,
+              "errors": 2,
+              "words": 432,
+              "wer": 0.004629629629629629
+            }
+          },
+          "long_range": {
+            "raw": {
+              "utterances": 6,
+              "errors": 0,
+              "words": 121,
+              "wer": 0.0
+            },
+            "semantic": {
+              "utterances": 6,
+              "errors": 0,
+              "words": 121,
+              "wer": 0.0
+            }
+          },
+          "names_places": {
+            "raw": {
+              "utterances": 6,
+              "errors": 2,
+              "words": 57,
+              "wer": 0.03508771929824561
+            },
+            "semantic": {
+              "utterances": 6,
+              "errors": 2,
+              "words": 57,
+              "wer": 0.03508771929824561
+            }
+          },
+          "narrative": {
+            "raw": {
+              "utterances": 24,
+              "errors": 3,
+              "words": 342,
+              "wer": 0.008771929824561403
+            },
+            "semantic": {
+              "utterances": 24,
+              "errors": 2,
+              "words": 352,
+              "wer": 0.005681818181818182
+            }
+          },
+          "numbers": {
+            "raw": {
+              "utterances": 6,
+              "errors": 32,
+              "words": 81,
+              "wer": 0.3950617283950617
+            },
+            "semantic": {
+              "utterances": 6,
+              "errors": 5,
+              "words": 64,
+              "wer": 0.078125
+            }
+          },
+          "phonetic_balance": {
+            "raw": {
+              "utterances": 300,
+              "errors": 39,
+              "words": 2605,
+              "wer": 0.014971209213051824
+            },
+            "semantic": {
+              "utterances": 300,
+              "errors": 30,
+              "words": 2627,
+              "wer": 0.011419870574800152
+            }
+          },
+          "punctuation": {
+            "raw": {
+              "utterances": 6,
+              "errors": 0,
+              "words": 65,
+              "wer": 0.0
+            },
+            "semantic": {
+              "utterances": 6,
+              "errors": 0,
+              "words": 65,
+              "wer": 0.0
+            }
+          },
+          "question": {
+            "raw": {
+              "utterances": 15,
+              "errors": 0,
+              "words": 163,
+              "wer": 0.0
+            },
+            "semantic": {
+              "utterances": 15,
+              "errors": 0,
+              "words": 165,
+              "wer": 0.0
+            }
+          },
+          "rare_words": {
+            "raw": {
+              "utterances": 6,
+              "errors": 2,
+              "words": 57,
+              "wer": 0.03508771929824561
+            },
+            "semantic": {
+              "utterances": 6,
+              "errors": 2,
+              "words": 57,
+              "wer": 0.03508771929824561
+            }
+          },
+          "short": {
+            "raw": {
+              "utterances": 24,
+              "errors": 2,
+              "words": 98,
+              "wer": 0.02040816326530612
+            },
+            "semantic": {
+              "utterances": 24,
+              "errors": 2,
+              "words": 105,
+              "wer": 0.01904761904761905
+            }
+          },
+          "technical": {
+            "raw": {
+              "utterances": 21,
+              "errors": 9,
+              "words": 251,
+              "wer": 0.035856573705179286
+            },
+            "semantic": {
+              "utterances": 21,
+              "errors": 5,
+              "words": 256,
+              "wer": 0.01953125
+            }
+          }
+        }
+      },
+      "utmos22": {
+        "mean": 4.21684304523468,
+        "ci": [
+          4.193502563333512,
+          4.239324071252346
+        ]
+      }
+    },
+    "kitten-nano-hugo": {
+      "label": "KittenTTS Nano \u00b7 Hugo",
+      "weight_mb": 56.767095,
+      "semantic_wer": {
+        "wer": 0.011461318051575931,
+        "ci": [
+          0.007995319812792511,
+          0.01523625843780135
+        ],
+        "categories": {
+          "conversational": {
+            "raw": {
+              "utterances": 25,
+              "errors": 1,
+              "words": 296,
+              "wer": 0.0033783783783783786
+            },
+            "semantic": {
+              "utterances": 25,
+              "errors": 1,
+              "words": 309,
+              "wer": 0.003236245954692557
+            }
+          },
+          "descriptive": {
+            "raw": {
+              "utterances": 16,
+              "errors": 1,
+              "words": 217,
+              "wer": 0.004608294930875576
+            },
+            "semantic": {
+              "utterances": 16,
+              "errors": 0,
+              "words": 226,
+              "wer": 0.0
+            }
+          },
+          "emotional": {
+            "raw": {
+              "utterances": 24,
+              "errors": 0,
+              "words": 314,
+              "wer": 0.0
+            },
+            "semantic": {
+              "utterances": 24,
+              "errors": 0,
+              "words": 329,
+              "wer": 0.0
+            }
+          },
+          "homographs": {
+            "raw": {
+              "utterances": 6,
+              "errors": 1,
+              "words": 70,
+              "wer": 0.014285714285714285
+            },
+            "semantic": {
+              "utterances": 6,
+              "errors": 1,
+              "words": 70,
+              "wer": 0.014285714285714285
+            }
+          },
+          "long": {
+            "raw": {
+              "utterances": 15,
+              "errors": 3,
+              "words": 412,
+              "wer": 0.007281553398058253
+            },
+            "semantic": {
+              "utterances": 15,
+              "errors": 3,
+              "words": 432,
+              "wer": 0.006944444444444444
+            }
+          },
+          "long_range": {
+            "raw": {
+              "utterances": 6,
+              "errors": 0,
+              "words": 121,
+              "wer": 0.0
+            },
+            "semantic": {
+              "utterances": 6,
+              "errors": 0,
+              "words": 121,
+              "wer": 0.0
+            }
+          },
+          "names_places": {
+            "raw": {
+              "utterances": 6,
+              "errors": 2,
+              "words": 57,
+              "wer": 0.03508771929824561
+            },
+            "semantic": {
+              "utterances": 6,
+              "errors": 2,
+              "words": 57,
+              "wer": 0.03508771929824561
+            }
+          },
+          "narrative": {
+            "raw": {
+              "utterances": 24,
+              "errors": 6,
+              "words": 342,
+              "wer": 0.017543859649122806
+            },
+            "semantic": {
+              "utterances": 24,
+              "errors": 5,
+              "words": 352,
+              "wer": 0.014204545454545454
+            }
+          },
+          "numbers": {
+            "raw": {
+              "utterances": 6,
+              "errors": 32,
+              "words": 81,
+              "wer": 0.3950617283950617
+            },
+            "semantic": {
+              "utterances": 6,
+              "errors": 5,
+              "words": 64,
+              "wer": 0.078125
+            }
+          },
+          "phonetic_balance": {
+            "raw": {
+              "utterances": 300,
+              "errors": 39,
+              "words": 2605,
+              "wer": 0.014971209213051824
+            },
+            "semantic": {
+              "utterances": 300,
+              "errors": 30,
+              "words": 2627,
+              "wer": 0.011419870574800152
+            }
+          },
+          "punctuation": {
+            "raw": {
+              "utterances": 6,
+              "errors": 0,
+              "words": 65,
+              "wer": 0.0
+            },
+            "semantic": {
+              "utterances": 6,
+              "errors": 0,
+              "words": 65,
+              "wer": 0.0
+            }
+          },
+          "question": {
+            "raw": {
+              "utterances": 15,
+              "errors": 0,
+              "words": 163,
+              "wer": 0.0
+            },
+            "semantic": {
+              "utterances": 15,
+              "errors": 0,
+              "words": 165,
+              "wer": 0.0
+            }
+          },
+          "rare_words": {
+            "raw": {
+              "utterances": 6,
+              "errors": 3,
+              "words": 57,
+              "wer": 0.05263157894736842
+            },
+            "semantic": {
+              "utterances": 6,
+              "errors": 3,
+              "words": 57,
+              "wer": 0.05263157894736842
+            }
+          },
+          "short": {
+            "raw": {
+              "utterances": 24,
+              "errors": 4,
+              "words": 98,
+              "wer": 0.04081632653061224
+            },
+            "semantic": {
+              "utterances": 24,
+              "errors": 4,
+              "words": 105,
+              "wer": 0.0380952380952381
+            }
+          },
+          "technical": {
+            "raw": {
+              "utterances": 21,
+              "errors": 12,
+              "words": 251,
+              "wer": 0.04780876494023904
+            },
+            "semantic": {
+              "utterances": 21,
+              "errors": 6,
+              "words": 256,
+              "wer": 0.0234375
+            }
+          }
+        }
+      },
+      "utmos22": {
+        "mean": 4.191078673839569,
+        "ci": [
+          4.168552933418751,
+          4.212353882300854
+        ]
+      }
+    },
+    "piper-ryan-low": {
+      "label": "Piper \u00b7 Ryan Low",
+      "weight_mb": 63.104526,
+      "semantic_wer": {
+        "wer": 0.023304680038204392,
+        "ci": [
+          0.018028169014084508,
+          0.02901655306718598
+        ],
+        "categories": {
+          "conversational": {
+            "raw": {
+              "utterances": 25,
+              "errors": 8,
+              "words": 296,
+              "wer": 0.02702702702702703
+            },
+            "semantic": {
+              "utterances": 25,
+              "errors": 5,
+              "words": 309,
+              "wer": 0.016181229773462782
+            }
+          },
+          "descriptive": {
+            "raw": {
+              "utterances": 16,
+              "errors": 3,
+              "words": 217,
+              "wer": 0.013824884792626729
+            },
+            "semantic": {
+              "utterances": 16,
+              "errors": 1,
+              "words": 226,
+              "wer": 0.004424778761061947
+            }
+          },
+          "emotional": {
+            "raw": {
+              "utterances": 24,
+              "errors": 1,
+              "words": 314,
+              "wer": 0.0031847133757961785
+            },
+            "semantic": {
+              "utterances": 24,
+              "errors": 1,
+              "words": 329,
+              "wer": 0.00303951367781155
+            }
+          },
+          "homographs": {
+            "raw": {
+              "utterances": 6,
+              "errors": 1,
+              "words": 70,
+              "wer": 0.014285714285714285
+            },
+            "semantic": {
+              "utterances": 6,
+              "errors": 1,
+              "words": 70,
+              "wer": 0.014285714285714285
+            }
+          },
+          "long": {
+            "raw": {
+              "utterances": 15,
+              "errors": 3,
+              "words": 412,
+              "wer": 0.007281553398058253
+            },
+            "semantic": {
+              "utterances": 15,
+              "errors": 3,
+              "words": 432,
+              "wer": 0.006944444444444444
+            }
+          },
+          "long_range": {
+            "raw": {
+              "utterances": 6,
+              "errors": 1,
+              "words": 121,
+              "wer": 0.008264462809917356
+            },
+            "semantic": {
+              "utterances": 6,
+              "errors": 1,
+              "words": 121,
+              "wer": 0.008264462809917356
+            }
+          },
+          "names_places": {
+            "raw": {
+              "utterances": 6,
+              "errors": 2,
+              "words": 57,
+              "wer": 0.03508771929824561
+            },
+            "semantic": {
+              "utterances": 6,
+              "errors": 2,
+              "words": 57,
+              "wer": 0.03508771929824561
+            }
+          },
+          "narrative": {
+            "raw": {
+              "utterances": 24,
+              "errors": 1,
+              "words": 342,
+              "wer": 0.0029239766081871343
+            },
+            "semantic": {
+              "utterances": 24,
+              "errors": 0,
+              "words": 352,
+              "wer": 0.0
+            }
+          },
+          "numbers": {
+            "raw": {
+              "utterances": 6,
+              "errors": 32,
+              "words": 81,
+              "wer": 0.3950617283950617
+            },
+            "semantic": {
+              "utterances": 6,
+              "errors": 6,
+              "words": 64,
+              "wer": 0.09375
+            }
+          },
+          "phonetic_balance": {
+            "raw": {
+              "utterances": 300,
+              "errors": 94,
+              "words": 2605,
+              "wer": 0.03608445297504798
+            },
+            "semantic": {
+              "utterances": 300,
+              "errors": 83,
+              "words": 2627,
+              "wer": 0.031594975256947086
+            }
+          },
+          "punctuation": {
+            "raw": {
+              "utterances": 6,
+              "errors": 1,
+              "words": 65,
+              "wer": 0.015384615384615385
+            },
+            "semantic": {
+              "utterances": 6,
+              "errors": 1,
+              "words": 65,
+              "wer": 0.015384615384615385
+            }
+          },
+          "question": {
+            "raw": {
+              "utterances": 15,
+              "errors": 0,
+              "words": 163,
+              "wer": 0.0
+            },
+            "semantic": {
+              "utterances": 15,
+              "errors": 0,
+              "words": 165,
+              "wer": 0.0
+            }
+          },
+          "rare_words": {
+            "raw": {
+              "utterances": 6,
+              "errors": 4,
+              "words": 57,
+              "wer": 0.07017543859649122
+            },
+            "semantic": {
+              "utterances": 6,
+              "errors": 4,
+              "words": 57,
+              "wer": 0.07017543859649122
+            }
+          },
+          "short": {
+            "raw": {
+              "utterances": 24,
+              "errors": 7,
+              "words": 98,
+              "wer": 0.07142857142857142
+            },
+            "semantic": {
+              "utterances": 24,
+              "errors": 8,
+              "words": 105,
+              "wer": 0.0761904761904762
+            }
+          },
+          "technical": {
+            "raw": {
+              "utterances": 21,
+              "errors": 10,
+              "words": 251,
+              "wer": 0.0398406374501992
+            },
+            "semantic": {
+              "utterances": 21,
+              "errors": 6,
+              "words": 256,
+              "wer": 0.0234375
+            }
+          }
+        }
+      },
+      "utmos22": {
+        "mean": 4.289378658294678,
+        "ci": [
+          4.271461564397812,
+          4.306235534155369
+        ]
+      }
+    },
+    "piper-danny-low": {
+      "label": "Piper \u00b7 Danny Low",
+      "weight_mb": 63.104526,
+      "semantic_wer": {
+        "wer": 0.018147086914995225,
+        "ci": [
+          0.013549618320610687,
+          0.022975077881619937
+        ],
+        "categories": {
+          "conversational": {
+            "raw": {
+              "utterances": 25,
+              "errors": 2,
+              "words": 296,
+              "wer": 0.006756756756756757
+            },
+            "semantic": {
+              "utterances": 25,
+              "errors": 2,
+              "words": 309,
+              "wer": 0.006472491909385114
+            }
+          },
+          "descriptive": {
+            "raw": {
+              "utterances": 16,
+              "errors": 2,
+              "words": 217,
+              "wer": 0.009216589861751152
+            },
+            "semantic": {
+              "utterances": 16,
+              "errors": 1,
+              "words": 226,
+              "wer": 0.004424778761061947
+            }
+          },
+          "emotional": {
+            "raw": {
+              "utterances": 24,
+              "errors": 1,
+              "words": 314,
+              "wer": 0.0031847133757961785
+            },
+            "semantic": {
+              "utterances": 24,
+              "errors": 1,
+              "words": 329,
+              "wer": 0.00303951367781155
+            }
+          },
+          "homographs": {
+            "raw": {
+              "utterances": 6,
+              "errors": 1,
+              "words": 70,
+              "wer": 0.014285714285714285
+            },
+            "semantic": {
+              "utterances": 6,
+              "errors": 1,
+              "words": 70,
+              "wer": 0.014285714285714285
+            }
+          },
+          "long": {
+            "raw": {
+              "utterances": 15,
+              "errors": 7,
+              "words": 412,
+              "wer": 0.01699029126213592
+            },
+            "semantic": {
+              "utterances": 15,
+              "errors": 7,
+              "words": 432,
+              "wer": 0.016203703703703703
+            }
+          },
+          "long_range": {
+            "raw": {
+              "utterances": 6,
+              "errors": 0,
+              "words": 121,
+              "wer": 0.0
+            },
+            "semantic": {
+              "utterances": 6,
+              "errors": 0,
+              "words": 121,
+              "wer": 0.0
+            }
+          },
+          "names_places": {
+            "raw": {
+              "utterances": 6,
+              "errors": 3,
+              "words": 57,
+              "wer": 0.05263157894736842
+            },
+            "semantic": {
+              "utterances": 6,
+              "errors": 3,
+              "words": 57,
+              "wer": 0.05263157894736842
+            }
+          },
+          "narrative": {
+            "raw": {
+              "utterances": 24,
+              "errors": 1,
+              "words": 342,
+              "wer": 0.0029239766081871343
+            },
+            "semantic": {
+              "utterances": 24,
+              "errors": 0,
+              "words": 352,
+              "wer": 0.0
+            }
+          },
+          "numbers": {
+            "raw": {
+              "utterances": 6,
+              "errors": 33,
+              "words": 81,
+              "wer": 0.4074074074074074
+            },
+            "semantic": {
+              "utterances": 6,
+              "errors": 7,
+              "words": 64,
+              "wer": 0.109375
+            }
+          },
+          "phonetic_balance": {
+            "raw": {
+              "utterances": 300,
+              "errors": 73,
+              "words": 2605,
+              "wer": 0.02802303262955854
+            },
+            "semantic": {
+              "utterances": 300,
+              "errors": 61,
+              "words": 2627,
+              "wer": 0.02322040350209364
+            }
+          },
+          "punctuation": {
+            "raw": {
+              "utterances": 6,
+              "errors": 0,
+              "words": 65,
+              "wer": 0.0
+            },
+            "semantic": {
+              "utterances": 6,
+              "errors": 0,
+              "words": 65,
+              "wer": 0.0
+            }
+          },
+          "question": {
+            "raw": {
+              "utterances": 15,
+              "errors": 2,
+              "words": 163,
+              "wer": 0.012269938650306749
+            },
+            "semantic": {
+              "utterances": 15,
+              "errors": 2,
+              "words": 165,
+              "wer": 0.012121212121212121
+            }
+          },
+          "rare_words": {
+            "raw": {
+              "utterances": 6,
+              "errors": 2,
+              "words": 57,
+              "wer": 0.03508771929824561
+            },
+            "semantic": {
+              "utterances": 6,
+              "errors": 2,
+              "words": 57,
+              "wer": 0.03508771929824561
+            }
+          },
+          "short": {
+            "raw": {
+              "utterances": 24,
+              "errors": 3,
+              "words": 98,
+              "wer": 0.030612244897959183
+            },
+            "semantic": {
+              "utterances": 24,
+              "errors": 3,
+              "words": 105,
+              "wer": 0.02857142857142857
+            }
+          },
+          "technical": {
+            "raw": {
+              "utterances": 21,
+              "errors": 9,
+              "words": 251,
+              "wer": 0.035856573705179286
+            },
+            "semantic": {
+              "utterances": 21,
+              "errors": 5,
+              "words": 256,
+              "wer": 0.01953125
+            }
+          }
+        }
+      },
+      "utmos22": {
+        "mean": 4.194989757061005,
+        "ci": [
+          4.179823832964897,
+          4.20924334000349
+        ]
+      }
+    },
+    "supertonic3-james-3step": {
+      "label": "Supertonic 3 \u00b7 James \u00b7 3-step",
+      "weight_mb": 398.075273,
+      "semantic_wer": {
+        "wer": 6.928175740210124,
+        "ci": [
+          5.861435406698565,
+          8.043254987161761
+        ],
+        "categories": {
+          "conversational": {
+            "raw": {
+              "utterances": 25,
+              "errors": 1295,
+              "words": 296,
+              "wer": 4.375
+            },
+            "semantic": {
+              "utterances": 25,
+              "errors": 1449,
+              "words": 309,
+              "wer": 4.689320388349515
+            }
+          },
+          "descriptive": {
+            "raw": {
+              "utterances": 16,
+              "errors": 902,
+              "words": 217,
+              "wer": 4.15668202764977
+            },
+            "semantic": {
+              "utterances": 16,
+              "errors": 998,
+              "words": 226,
+              "wer": 4.415929203539823
+            }
+          },
+          "emotional": {
+            "raw": {
+              "utterances": 24,
+              "errors": 2189,
+              "words": 314,
+              "wer": 6.971337579617835
+            },
+            "semantic": {
+              "utterances": 24,
+              "errors": 2306,
+              "words": 329,
+              "wer": 7.009118541033435
+            }
+          },
+          "homographs": {
+            "raw": {
+              "utterances": 6,
+              "errors": 70,
+              "words": 70,
+              "wer": 1.0
+            },
+            "semantic": {
+              "utterances": 6,
+              "errors": 73,
+              "words": 70,
+              "wer": 1.042857142857143
+            }
+          },
+          "long": {
+            "raw": {
+              "utterances": 15,
+              "errors": 1113,
+              "words": 412,
+              "wer": 2.7014563106796117
+            },
+            "semantic": {
+              "utterances": 15,
+              "errors": 1190,
+              "words": 432,
+              "wer": 2.7546296296296298
+            }
+          },
+          "long_range": {
+            "raw": {
+              "utterances": 6,
+              "errors": 153,
+              "words": 121,
+              "wer": 1.2644628099173554
+            },
+            "semantic": {
+              "utterances": 6,
+              "errors": 159,
+              "words": 121,
+              "wer": 1.3140495867768596
+            }
+          },
+          "names_places": {
+            "raw": {
+              "utterances": 6,
+              "errors": 666,
+              "words": 57,
+              "wer": 11.68421052631579
+            },
+            "semantic": {
+              "utterances": 6,
+              "errors": 828,
+              "words": 57,
+              "wer": 14.526315789473685
+            }
+          },
+          "narrative": {
+            "raw": {
+              "utterances": 24,
+              "errors": 2415,
+              "words": 342,
+              "wer": 7.06140350877193
+            },
+            "semantic": {
+              "utterances": 24,
+              "errors": 2562,
+              "words": 352,
+              "wer": 7.278409090909091
+            }
+          },
+          "numbers": {
+            "raw": {
+              "utterances": 6,
+              "errors": 94,
+              "words": 81,
+              "wer": 1.1604938271604939
+            },
+            "semantic": {
+              "utterances": 6,
+              "errors": 91,
+              "words": 64,
+              "wer": 1.421875
+            }
+          },
+          "phonetic_balance": {
+            "raw": {
+              "utterances": 300,
+              "errors": 19668,
+              "words": 2605,
+              "wer": 7.550095969289827
+            },
+            "semantic": {
+              "utterances": 300,
+              "errors": 21028,
+              "words": 2627,
+              "wer": 8.00456794822992
+            }
+          },
+          "punctuation": {
+            "raw": {
+              "utterances": 6,
+              "errors": 803,
+              "words": 65,
+              "wer": 12.353846153846154
+            },
+            "semantic": {
+              "utterances": 6,
+              "errors": 807,
+              "words": 65,
+              "wer": 12.415384615384616
+            }
+          },
+          "question": {
+            "raw": {
+              "utterances": 15,
+              "errors": 1412,
+              "words": 163,
+              "wer": 8.662576687116564
+            },
+            "semantic": {
+              "utterances": 15,
+              "errors": 1529,
+              "words": 165,
+              "wer": 9.266666666666667
+            }
+          },
+          "rare_words": {
+            "raw": {
+              "utterances": 6,
+              "errors": 819,
+              "words": 57,
+              "wer": 14.368421052631579
+            },
+            "semantic": {
+              "utterances": 6,
+              "errors": 820,
+              "words": 57,
+              "wer": 14.385964912280702
+            }
+          },
+          "short": {
+            "raw": {
+              "utterances": 24,
+              "errors": 436,
+              "words": 98,
+              "wer": 4.448979591836735
+            },
+            "semantic": {
+              "utterances": 24,
+              "errors": 447,
+              "words": 105,
+              "wer": 4.257142857142857
+            }
+          },
+          "technical": {
+            "raw": {
+              "utterances": 21,
+              "errors": 1976,
+              "words": 251,
+              "wer": 7.872509960159363
+            },
+            "semantic": {
+              "utterances": 21,
+              "errors": 1982,
+              "words": 256,
+              "wer": 7.7421875
+            }
+          }
+        }
+      },
+      "utmos22": {
+        "mean": 2.4712263617515564,
+        "ci": [
+          2.412739716243744,
+          2.5290928330957887
+        ]
+      }
+    },
+    "supertonic3-james-8step": {
+      "label": "Supertonic 3 \u00b7 James \u00b7 8-step",
+      "weight_mb": 398.075273,
+      "semantic_wer": {
+        "wer": 6.225214899713467,
+        "ci": [
+          5.2127497621313035,
+          7.2831739961759085
+        ],
+        "categories": {
+          "conversational": {
+            "raw": {
+              "utterances": 25,
+              "errors": 1746,
+              "words": 296,
+              "wer": 5.898648648648648
+            },
+            "semantic": {
+              "utterances": 25,
+              "errors": 1812,
+              "words": 309,
+              "wer": 5.864077669902913
+            }
+          },
+          "descriptive": {
+            "raw": {
+              "utterances": 16,
+              "errors": 1230,
+              "words": 217,
+              "wer": 5.668202764976958
+            },
+            "semantic": {
+              "utterances": 16,
+              "errors": 1234,
+              "words": 226,
+              "wer": 5.460176991150442
+            }
+          },
+          "emotional": {
+            "raw": {
+              "utterances": 24,
+              "errors": 1592,
+              "words": 314,
+              "wer": 5.070063694267516
+            },
+            "semantic": {
+              "utterances": 24,
+              "errors": 1670,
+              "words": 329,
+              "wer": 5.075987841945289
+            }
+          },
+          "homographs": {
+            "raw": {
+              "utterances": 6,
+              "errors": 326,
+              "words": 70,
+              "wer": 4.6571428571428575
+            },
+            "semantic": {
+              "utterances": 6,
+              "errors": 413,
+              "words": 70,
+              "wer": 5.9
+            }
+          },
+          "long": {
+            "raw": {
+              "utterances": 15,
+              "errors": 1459,
+              "words": 412,
+              "wer": 3.54126213592233
+            },
+            "semantic": {
+              "utterances": 15,
+              "errors": 1468,
+              "words": 432,
+              "wer": 3.3981481481481484
+            }
+          },
+          "long_range": {
+            "raw": {
+              "utterances": 6,
+              "errors": 113,
+              "words": 121,
+              "wer": 0.9338842975206612
+            },
+            "semantic": {
+              "utterances": 6,
+              "errors": 113,
+              "words": 121,
+              "wer": 0.9338842975206612
+            }
+          },
+          "names_places": {
+            "raw": {
+              "utterances": 6,
+              "errors": 381,
+              "words": 57,
+              "wer": 6.684210526315789
+            },
+            "semantic": {
+              "utterances": 6,
+              "errors": 476,
+              "words": 57,
+              "wer": 8.350877192982455
+            }
+          },
+          "narrative": {
+            "raw": {
+              "utterances": 24,
+              "errors": 1338,
+              "words": 342,
+              "wer": 3.912280701754386
+            },
+            "semantic": {
+              "utterances": 24,
+              "errors": 1344,
+              "words": 352,
+              "wer": 3.8181818181818183
+            }
+          },
+          "numbers": {
+            "raw": {
+              "utterances": 6,
+              "errors": 90,
+              "words": 81,
+              "wer": 1.1111111111111112
+            },
+            "semantic": {
+              "utterances": 6,
+              "errors": 87,
+              "words": 64,
+              "wer": 1.359375
+            }
+          },
+          "phonetic_balance": {
+            "raw": {
+              "utterances": 300,
+              "errors": 18274,
+              "words": 2605,
+              "wer": 7.014971209213051
+            },
+            "semantic": {
+              "utterances": 300,
+              "errors": 19044,
+              "words": 2627,
+              "wer": 7.2493338408831365
+            }
+          },
+          "punctuation": {
+            "raw": {
+              "utterances": 6,
+              "errors": 361,
+              "words": 65,
+              "wer": 5.553846153846154
+            },
+            "semantic": {
+              "utterances": 6,
+              "errors": 438,
+              "words": 65,
+              "wer": 6.7384615384615385
+            }
+          },
+          "question": {
+            "raw": {
+              "utterances": 15,
+              "errors": 1153,
+              "words": 163,
+              "wer": 7.07361963190184
+            },
+            "semantic": {
+              "utterances": 15,
+              "errors": 1267,
+              "words": 165,
+              "wer": 7.678787878787879
+            }
+          },
+          "rare_words": {
+            "raw": {
+              "utterances": 6,
+              "errors": 438,
+              "words": 57,
+              "wer": 7.684210526315789
+            },
+            "semantic": {
+              "utterances": 6,
+              "errors": 444,
+              "words": 57,
+              "wer": 7.7894736842105265
+            }
+          },
+          "short": {
+            "raw": {
+              "utterances": 24,
+              "errors": 1005,
+              "words": 98,
+              "wer": 10.255102040816327
+            },
+            "semantic": {
+              "utterances": 24,
+              "errors": 1057,
+              "words": 105,
+              "wer": 10.066666666666666
+            }
+          },
+          "technical": {
+            "raw": {
+              "utterances": 21,
+              "errors": 1585,
+              "words": 251,
+              "wer": 6.314741035856573
+            },
+            "semantic": {
+              "utterances": 21,
+              "errors": 1722,
+              "words": 256,
+              "wer": 6.7265625
+            }
+          }
+        }
+      },
+      "utmos22": {
+        "mean": 4.29470673418045,
+        "ci": [
+          4.281224336981774,
+          4.307890736854076
+        ]
+      }
+    }
+  },
+  "asr_robustness": {
+    "inflect-micro-v2": {
+      "whisper-large-v3": {
+        "wer": 0.019293218720152817,
+        "ci": [
+          0.014622733476311172,
+          0.024179280518969924
+        ]
+      },
+      "wav2vec2-large-lv60k-960h": {
+        "wer": 0.048137535816618914,
+        "ci": [
+          0.03997704667176741,
+          0.05712124077926991
+        ]
+      }
+    },
+    "inflect-nano-v2": {
+      "whisper-large-v3": {
+        "wer": 0.024832855778414518,
+        "ci": [
+          0.019525267993874426,
+          0.030727866333781446
+        ]
+      },
+      "wav2vec2-large-lv60k-960h": {
+        "wer": 0.05673352435530086,
+        "ci": [
+          0.04819277108433735,
+          0.06602129719264278
+        ]
+      }
+    },
+    "kitten-nano-bruno": {
+      "whisper-large-v3": {
+        "wer": 0.009742120343839542,
+        "ci": [
+          0.006622516556291391,
+          0.013268998793727383
+        ]
+      },
+      "wav2vec2-large-lv60k-960h": {
+        "wer": 0.03553008595988539,
+        "ci": [
+          0.028724626579854463,
+          0.04309006211180124
+        ]
+      }
+    },
+    "kitten-nano-hugo": {
+      "whisper-large-v3": {
+        "wer": 0.011461318051575931,
+        "ci": [
+          0.007995319812792511,
+          0.01523625843780135
+        ]
+      },
+      "wav2vec2-large-lv60k-960h": {
+        "wer": 0.03629417382999045,
+        "ci": [
+          0.029451395572666024,
+          0.043798449612403104
+        ]
+      }
+    },
+    "piper-ryan-low": {
+      "whisper-large-v3": {
+        "wer": 0.023304680038204392,
+        "ci": [
+          0.018028169014084508,
+          0.02901655306718598
+        ]
+      },
+      "wav2vec2-large-lv60k-960h": {
+        "wer": 0.0670487106017192,
+        "ci": [
+          0.05838601710673113,
+          0.07638619620007756
+        ]
+      }
+    },
+    "piper-danny-low": {
+      "whisper-large-v3": {
+        "wer": 0.018147086914995225,
+        "ci": [
+          0.013549618320610687,
+          0.022975077881619937
+        ]
+      },
+      "wav2vec2-large-lv60k-960h": {
+        "wer": 0.053104106972301814,
+        "ci": [
+          0.04440632742519535,
+          0.06227176628867961
+        ]
+      }
+    },
+    "supertonic3-james-3step": {
+      "whisper-large-v3": {
+        "wer": 6.928175740210124,
+        "ci": [
+          5.861435406698565,
+          8.043254987161761
+        ]
+      },
+      "wav2vec2-large-lv60k-960h": {
+        "wer": 0.1346704871060172,
+        "ci": [
+          0.11719324026451139,
+          0.15343099460292983
+        ]
+      }
+    },
+    "supertonic3-james-8step": {
+      "whisper-large-v3": {
+        "wer": 6.225214899713467,
+        "ci": [
+          5.2127497621313035,
+          7.2831739961759085
+        ]
+      },
+      "wav2vec2-large-lv60k-960h": {
+        "wer": 0.037631327602674305,
+        "ci": [
+          0.030763314747164008,
+          0.044854881266490766
+        ]
+      }
+    }
+  },
+  "family_averages": {
+    "kitten": {
+      "semantic_wer": 0.010601719197707736,
+      "utmos22": 4.2039608595371245
+    },
+    "piper": {
+      "semantic_wer": 0.02072588347659981,
+      "utmos22": 4.242184207677841
+    }
+  },
+  "notes": [
+    "Family averages are equal-weight macro averages over the two named voices.",
+    "Supertonic 3-step and 8-step remain separate.",
+    "UTMOS22 and WER are not combined into one score."
+  ]
+}

config.json

@@ -1,49 +1,9 @@
 {
+  "format": "inflect_v2_inference_config_v1",
   "train": {
-    "log_interval": 25,
-    "eval_interval": 2000,
-    "max_steps": 188000,
-    "seed": 20260720,
-    "epochs": 1000,
-    "learning_rate": 5e-06,
-    "resume_learning_rate": 5e-06,
-    "betas": [
-      0.8,
-      0.99
-    ],
-    "eps": 1e-09,
-    "batch_size": 32,
-    "num_workers": 8,
-    "fp16_run": true,
-    "lr_decay": 0.9999,
-    "segment_size": 16384,
-    "init_lr_ratio": 1,
-    "warmup_epochs": 0,
-    "c_mel": 45,
-    "c_kl": 1.0,
-    "c_stft": 1.5,
-    "stft_resolutions": [
-      [
-        1024,
-        256,
-        1024
-      ],
-      [
-        512,
-        128,
-        512
-      ],
-      [
-        256,
-        64,
-        256
-      ]
-    ],
-    "freeze_linguistic": true
+    "segment_size": 16384
   },
   "data": {
-    "training_files": "filelists/inflect_qwenfull_train_divrepair_v1.txt",
-    "validation_files": "filelists/inflect_qwenfull_dev_inflect_frontend.txt",
     "text_cleaners": [],
     "max_wav_value": 32768.0,
     "sampling_rate": 24000,
@@ -103,6 +63,7 @@
     ],
     "n_layers_q": 3,
     "use_spectral_norm": false,
-    "use_sdp": false
+    "use_sdp": false,
+    "inference_only": true
   }
 }

docs/API.md

@@ -0,0 +1,23 @@
+# Python API
+
+## `InflectTTS(model_dir, device="cpu")`
+
+Loads one released checkpoint and its configuration. Construct the engine once and reuse it for multiple utterances.
+
+## `synthesize(text, *, speed=1.0, variation=0.667, seed=0)`
+
+Returns a mono `numpy.float32` waveform at 24 kHz. Empty text raises `ValueError`. `speed` must be between `0.5` and `2.0`; `variation` must be between `0.0` and `1.0`. Long input is split at punctuation-aware boundaries, and each chunk uses `seed + chunk_index`.
+
+## `save(text, output, **kwargs)`
+
+Synthesizes and writes a WAV file, creating parent directories as needed. It returns the output `Path`.
+
+```python
+from inference import InflectTTS
+
+tts = InflectTTS(".", device="cpu")
+waveform = tts.synthesize("A compact model can still speak clearly.", seed=7)
+tts.save("This is written directly to disk.", "out.wav", seed=7)
+```
+
+The API is intentionally small. It does not expose speaker cloning, streaming state, SSML, or language switching in the v2 launch package.

docs/DEPLOYMENT.md

@@ -0,0 +1,29 @@
+# Deployment notes
+
+## Installation
+
+Use Python 3.10 or newer in a clean virtual environment, install `requirements.txt`, then run `inference.py` from the model repository. The package is tested with PyTorch CPU and CUDA execution; device-specific performance depends on the local PyTorch build.
+
+## Reproducibility
+
+Keep the checkpoint, `config.json`, frontend files, and `runtime/` directory together. Record `Inflect-Micro-v2`, the release revision, `speed`, `variation`, and `seed` with generated artifacts. Verify files against `release_manifest.json` when moving the package between machines.
+
+## Long text
+
+The runtime splits long text at sentence punctuation and then at safe intra-sentence boundaries. Chunks are synthesized independently and joined with punctuation-dependent silence. This prevents unbounded inference but means a long paragraph is not one globally planned prosody pass.
+
+## Production boundaries
+
+- Instantiate `InflectTTS` once and reuse it; loading per request wastes time.
+- Serialize calls to one model instance unless the surrounding application explicitly manages device memory and random seeds.
+- Validate empty or untrusted input before synthesis.
+- Set a fixed seed for deterministic caching and tests.
+- Measure on the actual target device before claiming real-time operation.
+
+## Troubleshooting
+
+- Missing phonemizer errors: reinstall `phonemizer` and `espeakng-loader` from `requirements.txt`.
+- Unexpected pronunciation: spell out ambiguous abbreviations or add context; the release frontend is English-only.
+- Flat or unstable delivery: keep `variation` near the default before changing speed.
+- Long pauses: inspect source punctuation because chunk boundaries intentionally follow punctuation.
+- Slow first request: model loading is measured separately from warm synthesis and should not happen per utterance.

docs/EVALUATION.md

@@ -0,0 +1,34 @@
+# Final evaluation protocol
+
+## Matched corpus
+
+All automated headline results use 500 identical unseen English prompts per system. The set combines 200 manually audited stress prompts with 300 deterministic CMU Arctic sentences. Exact normalized text was excluded against 87,362 training transcripts. The frozen prompt manifest and exclusion report are included under `evaluation/final/raw/`.
+
+## Systems
+
+- Inflect-Micro-v2 and Inflect-Nano-v2, fixed release checkpoints.
+- KittenTTS Nano, Bruno and Hugo reported separately.
+- Piper low, Ryan and Danny reported separately.
+- Supertonic 3 James at 3 and 8 steps, reported separately.
+
+Family averages for Kitten and Piper are equal-weight macro averages of the two named voices. The two Supertonic step counts are never pooled.
+
+## Intelligibility
+
+Headline semantic WER uses Whisper-large-v3. A second complete pass with wav2vec2 Large LV-60K tests whether conclusions are sensitive to one ASR family. References and hypotheses are normalized into equivalent spoken English forms so formatting differences such as `12.6` versus `twelve point six` are not automatically counted as speech errors. Both reports include per-clip rows, prompt-category breakdowns, and 10,000-sample bootstrap intervals. ASR-family results are never averaged into a single headline value.
+
+## Predicted quality
+
+UTMOS22 is run over every generated clip with 10,000-sample bootstrap intervals. It is a learned quality predictor, not human MOS, and is reported separately from WER and human preference.
+
+## Runtime
+
+Runtime reports use one named host, the same 50-prompt subset, warm end-to-end synthesis, one isolated process per system, each public runtime's default thread/provider behavior, and separate model-load timing. RTF, audio-seconds per wall-second, median latency, p95 latency, and per-prompt rows are retained. Cross-machine numbers are not mixed.
+
+## Human evidence
+
+The community study was blind, randomized left/right order, and stored pairwise preferences rather than user identity. Preference rate is `(wins + 0.5 × ties) / appearances`. It is descriptive community evidence, not a formal laboratory MOS study.
+
+## Reporting rules
+
+No aggregate score combines WER, UTMOS22, speed, size, and human preference. Confidence intervals, raw reports, model weight footprint, and known limitations accompany headline values.

docs/FINETUNING.md

@@ -0,0 +1,27 @@
+# Fine-tuning and adaptation status
+
+`Inflect-Micro-v2` is an open-weight, inference-first release. The repository does not ship the private corpus-construction recipe, teacher setup, discriminator checkpoints, optimizer state, or a supported training command.
+
+## What is supported
+
+- Local inference from the released generator checkpoint.
+- Deterministic regression testing through a fixed text, seed, speed, and variation value.
+- Inspection of the complete deployable architecture and frontend.
+- Research adaptation in a separate VITS-compatible training environment, at the user's own risk.
+
+## What is not yet supported
+
+- A one-command new-voice trainer.
+- Zero-shot voice cloning or speaker embeddings.
+- Language adaptation without rebuilding the symbol inventory and frontend.
+- Resuming the release checkpoint as if it contained discriminators or optimizer state.
+
+## Data contract for future adapters
+
+A defensible voice-adaptation toolkit must require a UTF-8 manifest with one audio path and one verified transcript per row; mono, consistently sampled, unclipped speech; held-out prompts that never enter training; speaker-identity and transcript audits; and an inference-only export that removes all training-only state. Duration, silence, clipping, and ASR checks must run before training rather than after a failed model.
+
+## Evaluation contract
+
+Any adapted checkpoint should be compared with the frozen release on identical unseen prompts, a fixed seed policy, semantic WER, signal diagnostics, a learned quality predictor, and a blinded human listening test. Improving speaker similarity while reducing intelligibility is not a successful adaptation.
+
+This file intentionally does not pretend that an unvalidated training recipe is a supported feature. A public adapter will be documented separately if it passes the same package and evaluation gates as the release models.

evaluation/asr_failures.json

@@ -1,1961 +0,0 @@
-{
-  "format": "inflect_tts_asr_failure_taxonomy_v1",
-  "source_report": "release_polish_overnight_20260720/final_large200/asr/report.json",
-  "asr": "whisper-large-v3",
-  "systems": {
-    "inflect-micro-v2-finalist": {
-      "utterances": 200,
-      "reference_words": 2608,
-      "semantic_wer": 0.012269938650306749,
-      "substitution_rate": 0.008819018404907975,
-      "deletion_rate": 0.0011503067484662577,
-      "insertion_rate": 0.0023006134969325155,
-      "utterance_failure_rate": 0.105,
-      "severe_failure_rate": 0.02,
-      "empty_hypothesis_rate": 0.0,
-      "leading_omission_rate": 0.0,
-      "ending_omission_rate": 0.0,
-      "insertion_burst_rate": 0.0,
-      "adjacent_phrase_repetition_rate": 0.02
-    },
-    "inflect-nano-v2-finalist": {
-      "utterances": 200,
-      "reference_words": 2608,
-      "semantic_wer": 0.015337423312883436,
-      "substitution_rate": 0.009585889570552147,
-      "deletion_rate": 0.0011503067484662577,
-      "insertion_rate": 0.004601226993865031,
-      "utterance_failure_rate": 0.115,
-      "severe_failure_rate": 0.03,
-      "empty_hypothesis_rate": 0.0,
-      "leading_omission_rate": 0.005,
-      "ending_omission_rate": 0.0,
-      "insertion_burst_rate": 0.0,
-      "adjacent_phrase_repetition_rate": 0.02
-    },
-    "kitten-nano-bruno": {
-      "utterances": 200,
-      "reference_words": 2608,
-      "semantic_wer": 0.009585889570552147,
-      "substitution_rate": 0.005368098159509203,
-      "deletion_rate": 0.0023006134969325155,
-      "insertion_rate": 0.0019171779141104294,
-      "utterance_failure_rate": 0.075,
-      "severe_failure_rate": 0.01,
-      "empty_hypothesis_rate": 0.0,
-      "leading_omission_rate": 0.0,
-      "ending_omission_rate": 0.005,
-      "insertion_burst_rate": 0.0,
-      "adjacent_phrase_repetition_rate": 0.02
-    },
-    "piper-ryan-low": {
-      "utterances": 200,
-      "reference_words": 2608,
-      "semantic_wer": 0.012269938650306749,
-      "substitution_rate": 0.009585889570552147,
-      "deletion_rate": 0.0011503067484662577,
-      "insertion_rate": 0.0015337423312883436,
-      "utterance_failure_rate": 0.095,
-      "severe_failure_rate": 0.02,
-      "empty_hypothesis_rate": 0.0,
-      "leading_omission_rate": 0.0,
-      "ending_omission_rate": 0.0,
-      "insertion_burst_rate": 0.0,
-      "adjacent_phrase_repetition_rate": 0.02
-    }
-  },
-  "systems_by_category": {
-    "inflect-micro-v2-finalist::conversational": {
-      "utterances": 25,
-      "reference_words": 309,
-      "semantic_wer": 0.0,
-      "substitution_rate": 0.0,
-      "deletion_rate": 0.0,
-      "insertion_rate": 0.0,
-      "utterance_failure_rate": 0.0,
-      "severe_failure_rate": 0.0,
-      "empty_hypothesis_rate": 0.0,
-      "leading_omission_rate": 0.0,
-      "ending_omission_rate": 0.0,
-      "insertion_burst_rate": 0.0,
-      "adjacent_phrase_repetition_rate": 0.0
-    },
-    "inflect-micro-v2-finalist::descriptive": {
-      "utterances": 16,
-      "reference_words": 226,
-      "semantic_wer": 0.0,
-      "substitution_rate": 0.0,
-      "deletion_rate": 0.0,
-      "insertion_rate": 0.0,
-      "utterance_failure_rate": 0.0,
-      "severe_failure_rate": 0.0,
-      "empty_hypothesis_rate": 0.0,
-      "leading_omission_rate": 0.0,
-      "ending_omission_rate": 0.0,
-      "insertion_burst_rate": 0.0,
-      "adjacent_phrase_repetition_rate": 0.0625
-    },
-    "inflect-micro-v2-finalist::emotional": {
-      "utterances": 24,
-      "reference_words": 329,
-      "semantic_wer": 0.0,
-      "substitution_rate": 0.0,
-      "deletion_rate": 0.0,
-      "insertion_rate": 0.0,
-      "utterance_failure_rate": 0.0,
-      "severe_failure_rate": 0.0,
-      "empty_hypothesis_rate": 0.0,
-      "leading_omission_rate": 0.0,
-      "ending_omission_rate": 0.0,
-      "insertion_burst_rate": 0.0,
-      "adjacent_phrase_repetition_rate": 0.041666666666666664
-    },
-    "inflect-micro-v2-finalist::homographs": {
-      "utterances": 6,
-      "reference_words": 70,
-      "semantic_wer": 0.014285714285714285,
-      "substitution_rate": 0.014285714285714285,
-      "deletion_rate": 0.0,
-      "insertion_rate": 0.0,
-      "utterance_failure_rate": 0.16666666666666666,
-      "severe_failure_rate": 0.0,
-      "empty_hypothesis_rate": 0.0,
-      "leading_omission_rate": 0.0,
-      "ending_omission_rate": 0.0,
-      "insertion_burst_rate": 0.0,
-      "adjacent_phrase_repetition_rate": 0.0
-    },
-    "inflect-micro-v2-finalist::long": {
-      "utterances": 15,
-      "reference_words": 432,
-      "semantic_wer": 0.0023148148148148147,
-      "substitution_rate": 0.0,
-      "deletion_rate": 0.0023148148148148147,
-      "insertion_rate": 0.0,
-      "utterance_failure_rate": 0.06666666666666667,
-      "severe_failure_rate": 0.0,
-      "empty_hypothesis_rate": 0.0,
-      "leading_omission_rate": 0.0,
-      "ending_omission_rate": 0.0,
-      "insertion_burst_rate": 0.0,
-      "adjacent_phrase_repetition_rate": 0.0
-    },
-    "inflect-micro-v2-finalist::long_range": {
-      "utterances": 6,
-      "reference_words": 121,
-      "semantic_wer": 0.0,
-      "substitution_rate": 0.0,
-      "deletion_rate": 0.0,
-      "insertion_rate": 0.0,
-      "utterance_failure_rate": 0.0,
-      "severe_failure_rate": 0.0,
-      "empty_hypothesis_rate": 0.0,
-      "leading_omission_rate": 0.0,
-      "ending_omission_rate": 0.0,
-      "insertion_burst_rate": 0.0,
-      "adjacent_phrase_repetition_rate": 0.0
-    },
-    "inflect-micro-v2-finalist::names_places": {
-      "utterances": 6,
-      "reference_words": 57,
-      "semantic_wer": 0.07017543859649122,
-      "substitution_rate": 0.07017543859649122,
-      "deletion_rate": 0.0,
-      "insertion_rate": 0.0,
-      "utterance_failure_rate": 0.5,
-      "severe_failure_rate": 0.0,
-      "empty_hypothesis_rate": 0.0,
-      "leading_omission_rate": 0.0,
-      "ending_omission_rate": 0.0,
-      "insertion_burst_rate": 0.0,
-      "adjacent_phrase_repetition_rate": 0.0
-    },
-    "inflect-micro-v2-finalist::narrative": {
-      "utterances": 24,
-      "reference_words": 352,
-      "semantic_wer": 0.002840909090909091,
-      "substitution_rate": 0.002840909090909091,
-      "deletion_rate": 0.0,
-      "insertion_rate": 0.0,
-      "utterance_failure_rate": 0.041666666666666664,
-      "severe_failure_rate": 0.0,
-      "empty_hypothesis_rate": 0.0,
-      "leading_omission_rate": 0.0,
-      "ending_omission_rate": 0.0,
-      "insertion_burst_rate": 0.0,
-      "adjacent_phrase_repetition_rate": 0.0
-    },
-    "inflect-micro-v2-finalist::numbers": {
-      "utterances": 6,
-      "reference_words": 64,
-      "semantic_wer": 0.15625,
-      "substitution_rate": 0.125,
-      "deletion_rate": 0.0,
-      "insertion_rate": 0.03125,
-      "utterance_failure_rate": 0.8333333333333334,
-      "severe_failure_rate": 0.3333333333333333,
-      "empty_hypothesis_rate": 0.0,
-      "leading_omission_rate": 0.0,
-      "ending_omission_rate": 0.0,
-      "insertion_burst_rate": 0.0,
-      "adjacent_phrase_repetition_rate": 0.0
-    },
-    "inflect-micro-v2-finalist::punctuation": {
-      "utterances": 6,
-      "reference_words": 65,
-      "semantic_wer": 0.0,
-      "substitution_rate": 0.0,
-      "deletion_rate": 0.0,
-      "insertion_rate": 0.0,
-      "utterance_failure_rate": 0.0,
-      "severe_failure_rate": 0.0,
-      "empty_hypothesis_rate": 0.0,
-      "leading_omission_rate": 0.0,
-      "ending_omission_rate": 0.0,
-      "insertion_burst_rate": 0.0,
-      "adjacent_phrase_repetition_rate": 0.0
-    },
-    "inflect-micro-v2-finalist::question": {
-      "utterances": 15,
-      "reference_words": 165,
-      "semantic_wer": 0.0,
-      "substitution_rate": 0.0,
-      "deletion_rate": 0.0,
-      "insertion_rate": 0.0,
-      "utterance_failure_rate": 0.0,
-      "severe_failure_rate": 0.0,
-      "empty_hypothesis_rate": 0.0,
-      "leading_omission_rate": 0.0,
-      "ending_omission_rate": 0.0,
-      "insertion_burst_rate": 0.0,
-      "adjacent_phrase_repetition_rate": 0.0
-    },
-    "inflect-micro-v2-finalist::rare_words": {
-      "utterances": 6,
-      "reference_words": 57,
-      "semantic_wer": 0.05263157894736842,
-      "substitution_rate": 0.03508771929824561,
-      "deletion_rate": 0.0,
-      "insertion_rate": 0.017543859649122806,
-      "utterance_failure_rate": 0.3333333333333333,
-      "severe_failure_rate": 0.0,
-      "empty_hypothesis_rate": 0.0,
-      "leading_omission_rate": 0.0,
-      "ending_omission_rate": 0.0,
-      "insertion_burst_rate": 0.0,
-      "adjacent_phrase_repetition_rate": 0.0
-    },
-    "inflect-micro-v2-finalist::short": {
-      "utterances": 24,
-      "reference_words": 105,
-      "semantic_wer": 0.0380952380952381,
-      "substitution_rate": 0.01904761904761905,
-      "deletion_rate": 0.0,
-      "insertion_rate": 0.01904761904761905,
-      "utterance_failure_rate": 0.16666666666666666,
-      "severe_failure_rate": 0.041666666666666664,
-      "empty_hypothesis_rate": 0.0,
-      "leading_omission_rate": 0.0,
-      "ending_omission_rate": 0.0,
-      "insertion_burst_rate": 0.0,
-      "adjacent_phrase_repetition_rate": 0.08333333333333333
-    },
-    "inflect-micro-v2-finalist::technical": {
-      "utterances": 21,
-      "reference_words": 256,
-      "semantic_wer": 0.03125,
-      "substitution_rate": 0.01953125,
-      "deletion_rate": 0.0078125,
-      "insertion_rate": 0.00390625,
-      "utterance_failure_rate": 0.19047619047619047,
-      "severe_failure_rate": 0.047619047619047616,
-      "empty_hypothesis_rate": 0.0,
-      "leading_omission_rate": 0.0,
-      "ending_omission_rate": 0.0,
-      "insertion_burst_rate": 0.0,
-      "adjacent_phrase_repetition_rate": 0.0
-    },
-    "inflect-nano-v2-finalist::conversational": {
-      "utterances": 25,
-      "reference_words": 309,
-      "semantic_wer": 0.003236245954692557,
-      "substitution_rate": 0.0,
-      "deletion_rate": 0.0,
-      "insertion_rate": 0.003236245954692557,
-      "utterance_failure_rate": 0.04,
-      "severe_failure_rate": 0.0,
-      "empty_hypothesis_rate": 0.0,
-      "leading_omission_rate": 0.0,
-      "ending_omission_rate": 0.0,
-      "insertion_burst_rate": 0.0,
-      "adjacent_phrase_repetition_rate": 0.0
-    },
-    "inflect-nano-v2-finalist::descriptive": {
-      "utterances": 16,
-      "reference_words": 226,
-      "semantic_wer": 0.0,
-      "substitution_rate": 0.0,
-      "deletion_rate": 0.0,
-      "insertion_rate": 0.0,
-      "utterance_failure_rate": 0.0,
-      "severe_failure_rate": 0.0,
-      "empty_hypothesis_rate": 0.0,
-      "leading_omission_rate": 0.0,
-      "ending_omission_rate": 0.0,
-      "insertion_burst_rate": 0.0,
-      "adjacent_phrase_repetition_rate": 0.0625
-    },
-    "inflect-nano-v2-finalist::emotional": {
-      "utterances": 24,
-      "reference_words": 329,
-      "semantic_wer": 0.0,
-      "substitution_rate": 0.0,
-      "deletion_rate": 0.0,
-      "insertion_rate": 0.0,
-      "utterance_failure_rate": 0.0,
-      "severe_failure_rate": 0.0,
-      "empty_hypothesis_rate": 0.0,
-      "leading_omission_rate": 0.0,
-      "ending_omission_rate": 0.0,
-      "insertion_burst_rate": 0.0,
-      "adjacent_phrase_repetition_rate": 0.041666666666666664
-    },
-    "inflect-nano-v2-finalist::homographs": {
-      "utterances": 6,
-      "reference_words": 70,
-      "semantic_wer": 0.05714285714285714,
-      "substitution_rate": 0.05714285714285714,
-      "deletion_rate": 0.0,
-      "insertion_rate": 0.0,
-      "utterance_failure_rate": 0.3333333333333333,
-      "severe_failure_rate": 0.0,
-      "empty_hypothesis_rate": 0.0,
-      "leading_omission_rate": 0.0,
-      "ending_omission_rate": 0.0,
-      "insertion_burst_rate": 0.0,
-      "adjacent_phrase_repetition_rate": 0.0
-    },
-    "inflect-nano-v2-finalist::long": {
-      "utterances": 15,
-      "reference_words": 432,
-      "semantic_wer": 0.004629629629629629,
-      "substitution_rate": 0.0023148148148148147,
-      "deletion_rate": 0.0,
-      "insertion_rate": 0.0023148148148148147,
-      "utterance_failure_rate": 0.06666666666666667,
-      "severe_failure_rate": 0.0,
-      "empty_hypothesis_rate": 0.0,
-      "leading_omission_rate": 0.0,
-      "ending_omission_rate": 0.0,
-      "insertion_burst_rate": 0.0,
-      "adjacent_phrase_repetition_rate": 0.0
-    },
-    "inflect-nano-v2-finalist::long_range": {
-      "utterances": 6,
-      "reference_words": 121,
-      "semantic_wer": 0.008264462809917356,
-      "substitution_rate": 0.008264462809917356,
-      "deletion_rate": 0.0,
-      "insertion_rate": 0.0,
-      "utterance_failure_rate": 0.16666666666666666,
-      "severe_failure_rate": 0.0,
-      "empty_hypothesis_rate": 0.0,
-      "leading_omission_rate": 0.0,
-      "ending_omission_rate": 0.0,
-      "insertion_burst_rate": 0.0,
-      "adjacent_phrase_repetition_rate": 0.0
-    },
-    "inflect-nano-v2-finalist::names_places": {
-      "utterances": 6,
-      "reference_words": 57,
-      "semantic_wer": 0.08771929824561403,
-      "substitution_rate": 0.08771929824561403,
-      "deletion_rate": 0.0,
-      "insertion_rate": 0.0,
-      "utterance_failure_rate": 0.5,
-      "severe_failure_rate": 0.16666666666666666,
-      "empty_hypothesis_rate": 0.0,
-      "leading_omission_rate": 0.0,
-      "ending_omission_rate": 0.0,
-      "insertion_burst_rate": 0.0,
-      "adjacent_phrase_repetition_rate": 0.0
-    },
-    "inflect-nano-v2-finalist::narrative": {
-      "utterances": 24,
-      "reference_words": 352,
-      "semantic_wer": 0.011363636363636364,
-      "substitution_rate": 0.005681818181818182,
-      "deletion_rate": 0.0,
-      "insertion_rate": 0.005681818181818182,
-      "utterance_failure_rate": 0.125,
-      "severe_failure_rate": 0.0,
-      "empty_hypothesis_rate": 0.0,
-      "leading_omission_rate": 0.0,
-      "ending_omission_rate": 0.0,
-      "insertion_burst_rate": 0.0,
-      "adjacent_phrase_repetition_rate": 0.0
-    },
-    "inflect-nano-v2-finalist::numbers": {
-      "utterances": 6,
-      "reference_words": 64,
-      "semantic_wer": 0.125,
-      "substitution_rate": 0.078125,
-      "deletion_rate": 0.015625,
-      "insertion_rate": 0.03125,
-      "utterance_failure_rate": 0.5,
-      "severe_failure_rate": 0.3333333333333333,
-      "empty_hypothesis_rate": 0.0,
-      "leading_omission_rate": 0.16666666666666666,
-      "ending_omission_rate": 0.0,
-      "insertion_burst_rate": 0.0,
-      "adjacent_phrase_repetition_rate": 0.0
-    },
-    "inflect-nano-v2-finalist::punctuation": {
-      "utterances": 6,
-      "reference_words": 65,
-      "semantic_wer": 0.0,
-      "substitution_rate": 0.0,
-      "deletion_rate": 0.0,
-      "insertion_rate": 0.0,
-      "utterance_failure_rate": 0.0,
-      "severe_failure_rate": 0.0,
-      "empty_hypothesis_rate": 0.0,
-      "leading_omission_rate": 0.0,
-      "ending_omission_rate": 0.0,
-      "insertion_burst_rate": 0.0,
-      "adjacent_phrase_repetition_rate": 0.0
-    },
-    "inflect-nano-v2-finalist::question": {
-      "utterances": 15,
-      "reference_words": 165,
-      "semantic_wer": 0.0,
-      "substitution_rate": 0.0,
-      "deletion_rate": 0.0,
-      "insertion_rate": 0.0,
-      "utterance_failure_rate": 0.0,
-      "severe_failure_rate": 0.0,
-      "empty_hypothesis_rate": 0.0,
-      "leading_omission_rate": 0.0,
-      "ending_omission_rate": 0.0,
-      "insertion_burst_rate": 0.0,
-      "adjacent_phrase_repetition_rate": 0.0
-    },
-    "inflect-nano-v2-finalist::rare_words": {
-      "utterances": 6,
-      "reference_words": 57,
-      "semantic_wer": 0.03508771929824561,
-      "substitution_rate": 0.017543859649122806,
-      "deletion_rate": 0.0,
-      "insertion_rate": 0.017543859649122806,
-      "utterance_failure_rate": 0.16666666666666666,
-      "severe_failure_rate": 0.0,
-      "empty_hypothesis_rate": 0.0,
-      "leading_omission_rate": 0.0,
-      "ending_omission_rate": 0.0,
-      "insertion_burst_rate": 0.0,
-      "adjacent_phrase_repetition_rate": 0.0
-    },
-    "inflect-nano-v2-finalist::short": {
-      "utterances": 24,
-      "reference_words": 105,
-      "semantic_wer": 0.047619047619047616,
-      "substitution_rate": 0.009523809523809525,
-      "deletion_rate": 0.0,
-      "insertion_rate": 0.0380952380952381,
-      "utterance_failure_rate": 0.16666666666666666,
-      "severe_failure_rate": 0.08333333333333333,
-      "empty_hypothesis_rate": 0.0,
-      "leading_omission_rate": 0.0,
-      "ending_omission_rate": 0.0,
-      "insertion_burst_rate": 0.0,
-      "adjacent_phrase_repetition_rate": 0.08333333333333333
-    },
-    "inflect-nano-v2-finalist::technical": {
-      "utterances": 21,
-      "reference_words": 256,
-      "semantic_wer": 0.03125,
-      "substitution_rate": 0.01953125,
-      "deletion_rate": 0.0078125,
-      "insertion_rate": 0.00390625,
-      "utterance_failure_rate": 0.19047619047619047,
-      "severe_failure_rate": 0.047619047619047616,
-      "empty_hypothesis_rate": 0.0,
-      "leading_omission_rate": 0.0,
-      "ending_omission_rate": 0.0,
-      "insertion_burst_rate": 0.0,
-      "adjacent_phrase_repetition_rate": 0.0
-    },
-    "kitten-nano-bruno::conversational": {
-      "utterances": 25,
-      "reference_words": 309,
-      "semantic_wer": 0.003236245954692557,
-      "substitution_rate": 0.0,
-      "deletion_rate": 0.003236245954692557,
-      "insertion_rate": 0.0,
-      "utterance_failure_rate": 0.04,
-      "severe_failure_rate": 0.0,
-      "empty_hypothesis_rate": 0.0,
-      "leading_omission_rate": 0.0,
-      "ending_omission_rate": 0.0,
-      "insertion_burst_rate": 0.0,
-      "adjacent_phrase_repetition_rate": 0.0
-    },
-    "kitten-nano-bruno::descriptive": {
-      "utterances": 16,
-      "reference_words": 226,
-      "semantic_wer": 0.0,
-      "substitution_rate": 0.0,
-      "deletion_rate": 0.0,
-      "insertion_rate": 0.0,
-      "utterance_failure_rate": 0.0,
-      "severe_failure_rate": 0.0,
-      "empty_hypothesis_rate": 0.0,
-      "leading_omission_rate": 0.0,
-      "ending_omission_rate": 0.0,
-      "insertion_burst_rate": 0.0,
-      "adjacent_phrase_repetition_rate": 0.0625
-    },
-    "kitten-nano-bruno::emotional": {
-      "utterances": 24,
-      "reference_words": 329,
-      "semantic_wer": 0.0,
-      "substitution_rate": 0.0,
-      "deletion_rate": 0.0,
-      "insertion_rate": 0.0,
-      "utterance_failure_rate": 0.0,
-      "severe_failure_rate": 0.0,
-      "empty_hypothesis_rate": 0.0,
-      "leading_omission_rate": 0.0,
-      "ending_omission_rate": 0.0,
-      "insertion_burst_rate": 0.0,
-      "adjacent_phrase_repetition_rate": 0.041666666666666664
-    },
-    "kitten-nano-bruno::homographs": {
-      "utterances": 6,
-      "reference_words": 70,
-      "semantic_wer": 0.014285714285714285,
-      "substitution_rate": 0.014285714285714285,
-      "deletion_rate": 0.0,
-      "insertion_rate": 0.0,
-      "utterance_failure_rate": 0.16666666666666666,
-      "severe_failure_rate": 0.0,
-      "empty_hypothesis_rate": 0.0,
-      "leading_omission_rate": 0.0,
-      "ending_omission_rate": 0.0,
-      "insertion_burst_rate": 0.0,
-      "adjacent_phrase_repetition_rate": 0.0
-    },
-    "kitten-nano-bruno::long": {
-      "utterances": 15,
-      "reference_words": 432,
-      "semantic_wer": 0.0023148148148148147,
-      "substitution_rate": 0.0,
-      "deletion_rate": 0.0023148148148148147,
-      "insertion_rate": 0.0,
-      "utterance_failure_rate": 0.06666666666666667,
-      "severe_failure_rate": 0.0,
-      "empty_hypothesis_rate": 0.0,
-      "leading_omission_rate": 0.0,
-      "ending_omission_rate": 0.0,
-      "insertion_burst_rate": 0.0,
-      "adjacent_phrase_repetition_rate": 0.0
-    },
-    "kitten-nano-bruno::long_range": {
-      "utterances": 6,
-      "reference_words": 121,
-      "semantic_wer": 0.0,
-      "substitution_rate": 0.0,
-      "deletion_rate": 0.0,
-      "insertion_rate": 0.0,
-      "utterance_failure_rate": 0.0,
-      "severe_failure_rate": 0.0,
-      "empty_hypothesis_rate": 0.0,
-      "leading_omission_rate": 0.0,
-      "ending_omission_rate": 0.0,
-      "insertion_burst_rate": 0.0,
-      "adjacent_phrase_repetition_rate": 0.0
-    },
-    "kitten-nano-bruno::names_places": {
-      "utterances": 6,
-      "reference_words": 57,
-      "semantic_wer": 0.05263157894736842,
-      "substitution_rate": 0.05263157894736842,
-      "deletion_rate": 0.0,
-      "insertion_rate": 0.0,
-      "utterance_failure_rate": 0.16666666666666666,
-      "severe_failure_rate": 0.16666666666666666,
-      "empty_hypothesis_rate": 0.0,
-      "leading_omission_rate": 0.0,
-      "ending_omission_rate": 0.0,
-      "insertion_burst_rate": 0.0,
-      "adjacent_phrase_repetition_rate": 0.0
-    },
-    "kitten-nano-bruno::narrative": {
-      "utterances": 24,
-      "reference_words": 352,
-      "semantic_wer": 0.011363636363636364,
-      "substitution_rate": 0.002840909090909091,
-      "deletion_rate": 0.005681818181818182,
-      "insertion_rate": 0.002840909090909091,
-      "utterance_failure_rate": 0.125,
-      "severe_failure_rate": 0.0,
-      "empty_hypothesis_rate": 0.0,
-      "leading_omission_rate": 0.0,
-      "ending_omission_rate": 0.041666666666666664,
-      "insertion_burst_rate": 0.0,
-      "adjacent_phrase_repetition_rate": 0.0
-    },
-    "kitten-nano-bruno::numbers": {
-      "utterances": 6,
-      "reference_words": 64,
-      "semantic_wer": 0.09375,
-      "substitution_rate": 0.0625,
-      "deletion_rate": 0.0,
-      "insertion_rate": 0.03125,
-      "utterance_failure_rate": 0.5,
-      "severe_failure_rate": 0.16666666666666666,
-      "empty_hypothesis_rate": 0.0,
-      "leading_omission_rate": 0.0,
-      "ending_omission_rate": 0.0,
-      "insertion_burst_rate": 0.0,
-      "adjacent_phrase_repetition_rate": 0.0
-    },
-    "kitten-nano-bruno::punctuation": {
-      "utterances": 6,
-      "reference_words": 65,
-      "semantic_wer": 0.0,
-      "substitution_rate": 0.0,
-      "deletion_rate": 0.0,
-      "insertion_rate": 0.0,
-      "utterance_failure_rate": 0.0,
-      "severe_failure_rate": 0.0,
-      "empty_hypothesis_rate": 0.0,
-      "leading_omission_rate": 0.0,
-      "ending_omission_rate": 0.0,
-      "insertion_burst_rate": 0.0,
-      "adjacent_phrase_repetition_rate": 0.0
-    },
-    "kitten-nano-bruno::question": {
-      "utterances": 15,
-      "reference_words": 165,
-      "semantic_wer": 0.0,
-      "substitution_rate": 0.0,
-      "deletion_rate": 0.0,
-      "insertion_rate": 0.0,
-      "utterance_failure_rate": 0.0,
-      "severe_failure_rate": 0.0,
-      "empty_hypothesis_rate": 0.0,
-      "leading_omission_rate": 0.0,
-      "ending_omission_rate": 0.0,
-      "insertion_burst_rate": 0.0,
-      "adjacent_phrase_repetition_rate": 0.0
-    },
-    "kitten-nano-bruno::rare_words": {
-      "utterances": 6,
-      "reference_words": 57,
-      "semantic_wer": 0.03508771929824561,
-      "substitution_rate": 0.017543859649122806,
-      "deletion_rate": 0.0,
-      "insertion_rate": 0.017543859649122806,
-      "utterance_failure_rate": 0.16666666666666666,
-      "severe_failure_rate": 0.0,
-      "empty_hypothesis_rate": 0.0,
-      "leading_omission_rate": 0.0,
-      "ending_omission_rate": 0.0,
-      "insertion_burst_rate": 0.0,
-      "adjacent_phrase_repetition_rate": 0.0
-    },
-    "kitten-nano-bruno::short": {
-      "utterances": 24,
-      "reference_words": 105,
-      "semantic_wer": 0.01904761904761905,
-      "substitution_rate": 0.01904761904761905,
-      "deletion_rate": 0.0,
-      "insertion_rate": 0.0,
-      "utterance_failure_rate": 0.08333333333333333,
-      "severe_failure_rate": 0.0,
-      "empty_hypothesis_rate": 0.0,
-      "leading_omission_rate": 0.0,
-      "ending_omission_rate": 0.0,
-      "insertion_burst_rate": 0.0,
-      "adjacent_phrase_repetition_rate": 0.08333333333333333
-    },
-    "kitten-nano-bruno::technical": {
-      "utterances": 21,
-      "reference_words": 256,
-      "semantic_wer": 0.01953125,
-      "substitution_rate": 0.0078125,
-      "deletion_rate": 0.0078125,
-      "insertion_rate": 0.00390625,
-      "utterance_failure_rate": 0.09523809523809523,
-      "severe_failure_rate": 0.0,
-      "empty_hypothesis_rate": 0.0,
-      "leading_omission_rate": 0.0,
-      "ending_omission_rate": 0.0,
-      "insertion_burst_rate": 0.0,
-      "adjacent_phrase_repetition_rate": 0.0
-    },
-    "piper-ryan-low::conversational": {
-      "utterances": 25,
-      "reference_words": 309,
-      "semantic_wer": 0.006472491909385114,
-      "substitution_rate": 0.006472491909385114,
-      "deletion_rate": 0.0,
-      "insertion_rate": 0.0,
-      "utterance_failure_rate": 0.04,
-      "severe_failure_rate": 0.0,
-      "empty_hypothesis_rate": 0.0,
-      "leading_omission_rate": 0.0,
-      "ending_omission_rate": 0.0,
-      "insertion_burst_rate": 0.0,
-      "adjacent_phrase_repetition_rate": 0.0
-    },
-    "piper-ryan-low::descriptive": {
-      "utterances": 16,
-      "reference_words": 226,
-      "semantic_wer": 0.008849557522123894,
-      "substitution_rate": 0.008849557522123894,
-      "deletion_rate": 0.0,
-      "insertion_rate": 0.0,
-      "utterance_failure_rate": 0.125,
-      "severe_failure_rate": 0.0,
-      "empty_hypothesis_rate": 0.0,
-      "leading_omission_rate": 0.0,
-      "ending_omission_rate": 0.0,
-      "insertion_burst_rate": 0.0,
-      "adjacent_phrase_repetition_rate": 0.0625
-    },
-    "piper-ryan-low::emotional": {
-      "utterances": 24,
-      "reference_words": 329,
-      "semantic_wer": 0.0,
-      "substitution_rate": 0.0,
-      "deletion_rate": 0.0,
-      "insertion_rate": 0.0,
-      "utterance_failure_rate": 0.0,
-      "severe_failure_rate": 0.0,
-      "empty_hypothesis_rate": 0.0,
-      "leading_omission_rate": 0.0,
-      "ending_omission_rate": 0.0,
-      "insertion_burst_rate": 0.0,
-      "adjacent_phrase_repetition_rate": 0.041666666666666664
-    },
-    "piper-ryan-low::homographs": {
-      "utterances": 6,
-      "reference_words": 70,
-      "semantic_wer": 0.014285714285714285,
-      "substitution_rate": 0.014285714285714285,
-      "deletion_rate": 0.0,
-      "insertion_rate": 0.0,
-      "utterance_failure_rate": 0.16666666666666666,
-      "severe_failure_rate": 0.0,
-      "empty_hypothesis_rate": 0.0,
-      "leading_omission_rate": 0.0,
-      "ending_omission_rate": 0.0,
-      "insertion_burst_rate": 0.0,
-      "adjacent_phrase_repetition_rate": 0.0
-    },
-    "piper-ryan-low::long": {
-      "utterances": 15,
-      "reference_words": 432,
-      "semantic_wer": 0.004629629629629629,
-      "substitution_rate": 0.0023148148148148147,
-      "deletion_rate": 0.0023148148148148147,
-      "insertion_rate": 0.0,
-      "utterance_failure_rate": 0.13333333333333333,
-      "severe_failure_rate": 0.0,
-      "empty_hypothesis_rate": 0.0,
-      "leading_omission_rate": 0.0,
-      "ending_omission_rate": 0.0,
-      "insertion_burst_rate": 0.0,
-      "adjacent_phrase_repetition_rate": 0.0
-    },
-    "piper-ryan-low::long_range": {
-      "utterances": 6,
-      "reference_words": 121,
-      "semantic_wer": 0.0,
-      "substitution_rate": 0.0,
-      "deletion_rate": 0.0,
-      "insertion_rate": 0.0,
-      "utterance_failure_rate": 0.0,
-      "severe_failure_rate": 0.0,
-      "empty_hypothesis_rate": 0.0,
-      "leading_omission_rate": 0.0,
-      "ending_omission_rate": 0.0,
-      "insertion_burst_rate": 0.0,
-      "adjacent_phrase_repetition_rate": 0.0
-    },
-    "piper-ryan-low::names_places": {
-      "utterances": 6,
-      "reference_words": 57,
-      "semantic_wer": 0.07017543859649122,
-      "substitution_rate": 0.07017543859649122,
-      "deletion_rate": 0.0,
-      "insertion_rate": 0.0,
-      "utterance_failure_rate": 0.3333333333333333,
-      "severe_failure_rate": 0.16666666666666666,
-      "empty_hypothesis_rate": 0.0,
-      "leading_omission_rate": 0.0,
-      "ending_omission_rate": 0.0,
-      "insertion_burst_rate": 0.0,
-      "adjacent_phrase_repetition_rate": 0.0
-    },
-    "piper-ryan-low::narrative": {
-      "utterances": 24,
-      "reference_words": 352,
-      "semantic_wer": 0.0,
-      "substitution_rate": 0.0,
-      "deletion_rate": 0.0,
-      "insertion_rate": 0.0,
-      "utterance_failure_rate": 0.0,
-      "severe_failure_rate": 0.0,
-      "empty_hypothesis_rate": 0.0,
-      "leading_omission_rate": 0.0,
-      "ending_omission_rate": 0.0,
-      "insertion_burst_rate": 0.0,
-      "adjacent_phrase_repetition_rate": 0.0
-    },
-    "piper-ryan-low::numbers": {
-      "utterances": 6,
-      "reference_words": 64,
-      "semantic_wer": 0.078125,
-      "substitution_rate": 0.046875,
-      "deletion_rate": 0.0,
-      "insertion_rate": 0.03125,
-      "utterance_failure_rate": 0.3333333333333333,
-      "severe_failure_rate": 0.16666666666666666,
-      "empty_hypothesis_rate": 0.0,
-      "leading_omission_rate": 0.0,
-      "ending_omission_rate": 0.0,
-      "insertion_burst_rate": 0.0,
-      "adjacent_phrase_repetition_rate": 0.0
-    },
-    "piper-ryan-low::punctuation": {
-      "utterances": 6,
-      "reference_words": 65,
-      "semantic_wer": 0.0,
-      "substitution_rate": 0.0,
-      "deletion_rate": 0.0,
-      "insertion_rate": 0.0,
-      "utterance_failure_rate": 0.0,
-      "severe_failure_rate": 0.0,
-      "empty_hypothesis_rate": 0.0,
-      "leading_omission_rate": 0.0,
-      "ending_omission_rate": 0.0,
-      "insertion_burst_rate": 0.0,
-      "adjacent_phrase_repetition_rate": 0.0
-    },
-    "piper-ryan-low::question": {
-      "utterances": 15,
-      "reference_words": 165,
-      "semantic_wer": 0.0,
-      "substitution_rate": 0.0,
-      "deletion_rate": 0.0,
-      "insertion_rate": 0.0,
-      "utterance_failure_rate": 0.0,
-      "severe_failure_rate": 0.0,
-      "empty_hypothesis_rate": 0.0,
-      "leading_omission_rate": 0.0,
-      "ending_omission_rate": 0.0,
-      "insertion_burst_rate": 0.0,
-      "adjacent_phrase_repetition_rate": 0.0
-    },
-    "piper-ryan-low::rare_words": {
-      "utterances": 6,
-      "reference_words": 57,
-      "semantic_wer": 0.08771929824561403,
-      "substitution_rate": 0.07017543859649122,
-      "deletion_rate": 0.0,
-      "insertion_rate": 0.017543859649122806,
-      "utterance_failure_rate": 0.5,
-      "severe_failure_rate": 0.0,
-      "empty_hypothesis_rate": 0.0,
-      "leading_omission_rate": 0.0,
-      "ending_omission_rate": 0.0,
-      "insertion_burst_rate": 0.0,
-      "adjacent_phrase_repetition_rate": 0.0
-    },
-    "piper-ryan-low::short": {
-      "utterances": 24,
-      "reference_words": 105,
-      "semantic_wer": 0.0380952380952381,
-      "substitution_rate": 0.0380952380952381,
-      "deletion_rate": 0.0,
-      "insertion_rate": 0.0,
-      "utterance_failure_rate": 0.08333333333333333,
-      "severe_failure_rate": 0.08333333333333333,
-      "empty_hypothesis_rate": 0.0,
-      "leading_omission_rate": 0.0,
-      "ending_omission_rate": 0.0,
-      "insertion_burst_rate": 0.0,
-      "adjacent_phrase_repetition_rate": 0.08333333333333333
-    },
-    "piper-ryan-low::technical": {
-      "utterances": 21,
-      "reference_words": 256,
-      "semantic_wer": 0.02734375,
-      "substitution_rate": 0.015625,
-      "deletion_rate": 0.0078125,
-      "insertion_rate": 0.00390625,
-      "utterance_failure_rate": 0.19047619047619047,
-      "severe_failure_rate": 0.0,
-      "empty_hypothesis_rate": 0.0,
-      "leading_omission_rate": 0.0,
-      "ending_omission_rate": 0.0,
-      "insertion_burst_rate": 0.0,
-      "adjacent_phrase_repetition_rate": 0.0
-    }
-  },
-  "worst_utterances": [
-    {
-      "model": "inflect-micro-v2-finalist",
-      "id": "utmos200_176",
-      "category": "short",
-      "reference": "Noted.",
-      "hypothesis": "Noid.",
-      "reference_words": 1,
-      "hypothesis_words": 1,
-      "substitutions": 1,
-      "deletions": 0,
-      "insertions": 0,
-      "semantic_wer": 1.0,
-      "utterance_failure": true,
-      "severe_failure": true,
-      "empty_hypothesis": false,
-      "leading_omission": false,
-      "ending_omission": false,
-      "insertion_burst": false,
-      "adjacent_phrase_repetition": false,
-      "audio": "release_polish_overnight_20260720/final_large200/audio/inflect-micro-v2-finalist/utmos200_176.wav"
-    },
-    {
-      "model": "piper-ryan-low",
-      "id": "utmos200_041",
-      "category": "short",
-      "reference": "I mean. Yeah. Kind of.",
-      "hypothesis": "I mean, no, I know.",
-      "reference_words": 5,
-      "hypothesis_words": 5,
-      "substitutions": 3,
-      "deletions": 0,
-      "insertions": 0,
-      "semantic_wer": 0.6,
-      "utterance_failure": true,
-      "severe_failure": true,
-      "empty_hypothesis": false,
-      "leading_omission": false,
-      "ending_omission": false,
-      "insertion_burst": false,
-      "adjacent_phrase_repetition": false,
-      "audio": "utmos22_large200_v1/audio/piper-ryan-low/utmos200_041.wav"
-    },
-    {
-      "model": "inflect-nano-v2-finalist",
-      "id": "utmos200_041",
-      "category": "short",
-      "reference": "I mean. Yeah. Kind of.",
-      "hypothesis": "I mean that, yeah, that kind of,",
-      "reference_words": 5,
-      "hypothesis_words": 7,
-      "substitutions": 0,
-      "deletions": 0,
-      "insertions": 2,
-      "semantic_wer": 0.4,
-      "utterance_failure": true,
-      "severe_failure": true,
-      "empty_hypothesis": false,
-      "leading_omission": false,
-      "ending_omission": false,
-      "insertion_burst": false,
-      "adjacent_phrase_repetition": false,
-      "audio": "release_polish_overnight_20260720/final_large200/audio/inflect-nano-v2-finalist/utmos200_041.wav"
-    },
-    {
-      "model": "inflect-micro-v2-finalist",
-      "id": "utmos200_065",
-      "category": "numbers",
-      "reference": "Call extension zero four nine after eight thirty in the morning.",
-      "hypothesis": "Call extension 049 after 8.30 in the morning.",
-      "reference_words": 8,
-      "hypothesis_words": 9,
-      "substitutions": 2,
-      "deletions": 0,
-      "insertions": 1,
-      "semantic_wer": 0.375,
-      "utterance_failure": true,
-      "severe_failure": true,
-      "empty_hypothesis": false,
-      "leading_omission": false,
-      "ending_omission": false,
-      "insertion_burst": false,
-      "adjacent_phrase_repetition": false,
-      "audio": "release_polish_overnight_20260720/final_large200/audio/inflect-micro-v2-finalist/utmos200_065.wav"
-    },
-    {
-      "model": "inflect-nano-v2-finalist",
-      "id": "utmos200_065",
-      "category": "numbers",
-      "reference": "Call extension zero four nine after eight thirty in the morning.",
-      "hypothesis": "Call extension 049 after 8.30 in the morning.",
-      "reference_words": 8,
-      "hypothesis_words": 9,
-      "substitutions": 2,
-      "deletions": 0,
-      "insertions": 1,
-      "semantic_wer": 0.375,
-      "utterance_failure": true,
-      "severe_failure": true,
-      "empty_hypothesis": false,
-      "leading_omission": false,
-      "ending_omission": false,
-      "insertion_burst": false,
-      "adjacent_phrase_repetition": false,
-      "audio": "release_polish_overnight_20260720/final_large200/audio/inflect-nano-v2-finalist/utmos200_065.wav"
-    },
-    {
-      "model": "piper-ryan-low",
-      "id": "utmos200_065",
-      "category": "numbers",
-      "reference": "Call extension zero four nine after eight thirty in the morning.",
-      "hypothesis": "Call extension 049 after 8.30 in the morning.",
-      "reference_words": 8,
-      "hypothesis_words": 9,
-      "substitutions": 2,
-      "deletions": 0,
-      "insertions": 1,
-      "semantic_wer": 0.375,
-      "utterance_failure": true,
-      "severe_failure": true,
-      "empty_hypothesis": false,
-      "leading_omission": false,
-      "ending_omission": false,
-      "insertion_burst": false,
-      "adjacent_phrase_repetition": false,
-      "audio": "utmos22_large200_v1/audio/piper-ryan-low/utmos200_065.wav"
-    },
-    {
-      "model": "kitten-nano-bruno",
-      "id": "utmos200_065",
-      "category": "numbers",
-      "reference": "Call extension zero four nine after eight thirty in the morning.",
-      "hypothesis": "Call extension 049 after 8.30 in the morning.",
-      "reference_words": 8,
-      "hypothesis_words": 9,
-      "substitutions": 2,
-      "deletions": 0,
-      "insertions": 1,
-      "semantic_wer": 0.375,
-      "utterance_failure": true,
-      "severe_failure": true,
-      "empty_hypothesis": false,
-      "leading_omission": false,
-      "ending_omission": false,
-      "insertion_burst": false,
-      "adjacent_phrase_repetition": false,
-      "audio": "utmos22_large200_v1/audio/kitten-nano-bruno/utmos200_065.wav"
-    },
-    {
-      "model": "inflect-nano-v2-finalist",
-      "id": "utmos200_035",
-      "category": "names_places",
-      "reference": "Aurelia and Joaquin crossed the Schuylkill River before noon.",
-      "hypothesis": "Uralaya and Jokwing crossed the Sialkal River before noon.",
-      "reference_words": 9,
-      "hypothesis_words": 9,
-      "substitutions": 3,
-      "deletions": 0,
-      "insertions": 0,
-      "semantic_wer": 0.3333333333333333,
-      "utterance_failure": true,
-      "severe_failure": true,
-      "empty_hypothesis": false,
-      "leading_omission": false,
-      "ending_omission": false,
-      "insertion_burst": false,
-      "adjacent_phrase_repetition": false,
-      "audio": "release_polish_overnight_20260720/final_large200/audio/inflect-nano-v2-finalist/utmos200_035.wav"
-    },
-    {
-      "model": "inflect-nano-v2-finalist",
-      "id": "utmos200_191",
-      "category": "short",
-      "reference": "Right. Moving on.",
-      "hypothesis": "Right at moving on.",
-      "reference_words": 3,
-      "hypothesis_words": 4,
-      "substitutions": 0,
-      "deletions": 0,
-      "insertions": 1,
-      "semantic_wer": 0.3333333333333333,
-      "utterance_failure": true,
-      "severe_failure": true,
-      "empty_hypothesis": false,
-      "leading_omission": false,
-      "ending_omission": false,
-      "insertion_burst": false,
-      "adjacent_phrase_repetition": false,
-      "audio": "release_polish_overnight_20260720/final_large200/audio/inflect-nano-v2-finalist/utmos200_191.wav"
-    },
-    {
-      "model": "piper-ryan-low",
-      "id": "utmos200_049",
-      "category": "names_places",
-      "reference": "Xiomara met Siobhan near the old library in Worcestershire.",
-      "hypothesis": "See Amaru Mechivan near the Old Library in Worcestershire.",
-      "reference_words": 9,
-      "hypothesis_words": 9,
-      "substitutions": 3,
-      "deletions": 0,
-      "insertions": 0,
-      "semantic_wer": 0.3333333333333333,
-      "utterance_failure": true,
-      "severe_failure": true,
-      "empty_hypothesis": false,
-      "leading_omission": false,
-      "ending_omission": false,
-      "insertion_burst": false,
-      "adjacent_phrase_repetition": false,
-      "audio": "utmos22_large200_v1/audio/piper-ryan-low/utmos200_049.wav"
-    },
-    {
-      "model": "piper-ryan-low",
-      "id": "utmos200_091",
-      "category": "short",
-      "reference": "That's fair.",
-      "hypothesis": "That was fair.",
-      "reference_words": 3,
-      "hypothesis_words": 3,
-      "substitutions": 1,
-      "deletions": 0,
-      "insertions": 0,
-      "semantic_wer": 0.3333333333333333,
-      "utterance_failure": true,
-      "severe_failure": true,
-      "empty_hypothesis": false,
-      "leading_omission": false,
-      "ending_omission": false,
-      "insertion_burst": false,
-      "adjacent_phrase_repetition": false,
-      "audio": "utmos22_large200_v1/audio/piper-ryan-low/utmos200_091.wav"
-    },
-    {
-      "model": "kitten-nano-bruno",
-      "id": "utmos200_035",
-      "category": "names_places",
-      "reference": "Aurelia and Joaquin crossed the Schuylkill River before noon.",
-      "hypothesis": "Auralaya and Jokwan crossed the Shilkal river before noon.",
-      "reference_words": 9,
-      "hypothesis_words": 9,
-      "substitutions": 3,
-      "deletions": 0,
-      "insertions": 0,
-      "semantic_wer": 0.3333333333333333,
-      "utterance_failure": true,
-      "severe_failure": true,
-      "empty_hypothesis": false,
-      "leading_omission": false,
-      "ending_omission": false,
-      "insertion_burst": false,
-      "adjacent_phrase_repetition": false,
-      "audio": "utmos22_large200_v1/audio/kitten-nano-bruno/utmos200_035.wav"
-    },
-    {
-      "model": "inflect-micro-v2-finalist",
-      "id": "utmos200_051",
-      "category": "numbers",
-      "reference": "At exactly seven forty-five, Morgan placed eighteen dollars and fifty cents beside the notebook.",
-      "hypothesis": "At exactly $7.45, Morton placed $18.50 beside the notebook.",
-      "reference_words": 10,
-      "hypothesis_words": 11,
-      "substitutions": 2,
-      "deletions": 0,
-      "insertions": 1,
-      "semantic_wer": 0.3,
-      "utterance_failure": true,
-      "severe_failure": true,
-      "empty_hypothesis": false,
-      "leading_omission": false,
-      "ending_omission": false,
-      "insertion_burst": false,
-      "adjacent_phrase_repetition": false,
-      "audio": "release_polish_overnight_20260720/final_large200/audio/inflect-micro-v2-finalist/utmos200_051.wav"
-    },
-    {
-      "model": "inflect-nano-v2-finalist",
-      "id": "utmos200_051",
-      "category": "numbers",
-      "reference": "At exactly seven forty-five, Morgan placed eighteen dollars and fifty cents beside the notebook.",
-      "hypothesis": "Exactly $7.45, Morgan placed $18.50 beside the notebook.",
-      "reference_words": 10,
-      "hypothesis_words": 10,
-      "substitutions": 1,
-      "deletions": 1,
-      "insertions": 1,
-      "semantic_wer": 0.3,
-      "utterance_failure": true,
-      "severe_failure": true,
-      "empty_hypothesis": false,
-      "leading_omission": true,
-      "ending_omission": false,
-      "insertion_burst": false,
-      "adjacent_phrase_repetition": false,
-      "audio": "release_polish_overnight_20260720/final_large200/audio/inflect-nano-v2-finalist/utmos200_051.wav"
-    },
-    {
-      "model": "inflect-micro-v2-finalist",
-      "id": "utmos200_028",
-      "category": "technical",
-      "reference": "Hash the UTF eight payload with S H A two fifty-six before opening the checkpoint.",
-      "hypothesis": "Cache the UTF-8 payload with SH-256 before opening the checkpoint.",
-      "reference_words": 14,
-      "hypothesis_words": 12,
-      "substitutions": 2,
-      "deletions": 2,
-      "insertions": 0,
-      "semantic_wer": 0.2857142857142857,
-      "utterance_failure": true,
-      "severe_failure": true,
-      "empty_hypothesis": false,
-      "leading_omission": false,
-      "ending_omission": false,
-      "insertion_burst": false,
-      "adjacent_phrase_repetition": false,
-      "audio": "release_polish_overnight_20260720/final_large200/audio/inflect-micro-v2-finalist/utmos200_028.wav"
-    },
-    {
-      "model": "inflect-nano-v2-finalist",
-      "id": "utmos200_028",
-      "category": "technical",
-      "reference": "Hash the UTF eight payload with S H A two fifty-six before opening the checkpoint.",
-      "hypothesis": "Ash the UTF-8 payload with SHA-256 before opening the checkpoint.",
-      "reference_words": 14,
-      "hypothesis_words": 12,
-      "substitutions": 2,
-      "deletions": 2,
-      "insertions": 0,
-      "semantic_wer": 0.2857142857142857,
-      "utterance_failure": true,
-      "severe_failure": true,
-      "empty_hypothesis": false,
-      "leading_omission": false,
-      "ending_omission": false,
-      "insertion_burst": false,
-      "adjacent_phrase_repetition": false,
-      "audio": "release_polish_overnight_20260720/final_large200/audio/inflect-nano-v2-finalist/utmos200_028.wav"
-    },
-    {
-      "model": "inflect-micro-v2-finalist",
-      "id": "utmos200_139",
-      "category": "short",
-      "reference": "No way. Absolutely not.",
-      "hypothesis": "No wait, absolutely not.",
-      "reference_words": 4,
-      "hypothesis_words": 4,
-      "substitutions": 1,
-      "deletions": 0,
-      "insertions": 0,
-      "semantic_wer": 0.25,
-      "utterance_failure": true,
-      "severe_failure": false,
-      "empty_hypothesis": false,
-      "leading_omission": false,
-      "ending_omission": false,
-      "insertion_burst": false,
-      "adjacent_phrase_repetition": false,
-      "audio": "release_polish_overnight_20260720/final_large200/audio/inflect-micro-v2-finalist/utmos200_139.wav"
-    },
-    {
-      "model": "inflect-micro-v2-finalist",
-      "id": "utmos200_181",
-      "category": "short",
-      "reference": "Yeah, no. Hard pass.",
-      "hypothesis": "Yeah, no but hard pass.",
-      "reference_words": 4,
-      "hypothesis_words": 5,
-      "substitutions": 0,
-      "deletions": 0,
-      "insertions": 1,
-      "semantic_wer": 0.25,
-      "utterance_failure": true,
-      "severe_failure": false,
-      "empty_hypothesis": false,
-      "leading_omission": false,
-      "ending_omission": false,
-      "insertion_burst": false,
-      "adjacent_phrase_repetition": false,
-      "audio": "release_polish_overnight_20260720/final_large200/audio/inflect-micro-v2-finalist/utmos200_181.wav"
-    },
-    {
-      "model": "inflect-nano-v2-finalist",
-      "id": "utmos200_139",
-      "category": "short",
-      "reference": "No way. Absolutely not.",
-      "hypothesis": "No way to absolutely not.",
-      "reference_words": 4,
-      "hypothesis_words": 5,
-      "substitutions": 0,
-      "deletions": 0,
-      "insertions": 1,
-      "semantic_wer": 0.25,
-      "utterance_failure": true,
-      "severe_failure": false,
-      "empty_hypothesis": false,
-      "leading_omission": false,
-      "ending_omission": false,
-      "insertion_burst": false,
-      "adjacent_phrase_repetition": false,
-      "audio": "release_polish_overnight_20260720/final_large200/audio/inflect-nano-v2-finalist/utmos200_139.wav"
-    },
-    {
-      "model": "inflect-nano-v2-finalist",
-      "id": "utmos200_181",
-      "category": "short",
-      "reference": "Yeah, no. Hard pass.",
-      "hypothesis": "Yeah, no.Card pass.",
-      "reference_words": 4,
-      "hypothesis_words": 4,
-      "substitutions": 1,
-      "deletions": 0,
-      "insertions": 0,
-      "semantic_wer": 0.25,
-      "utterance_failure": true,
-      "severe_failure": false,
-      "empty_hypothesis": false,
-      "leading_omission": false,
-      "ending_omission": false,
-      "insertion_burst": false,
-      "adjacent_phrase_repetition": false,
-      "audio": "release_polish_overnight_20260720/final_large200/audio/inflect-nano-v2-finalist/utmos200_181.wav"
-    },
-    {
-      "model": "kitten-nano-bruno",
-      "id": "utmos200_181",
-      "category": "short",
-      "reference": "Yeah, no. Hard pass.",
-      "hypothesis": "Yeth no. Hard pass.",
-      "reference_words": 4,
-      "hypothesis_words": 4,
-      "substitutions": 1,
-      "deletions": 0,
-      "insertions": 0,
-      "semantic_wer": 0.25,
-      "utterance_failure": true,
-      "severe_failure": false,
-      "empty_hypothesis": false,
-      "leading_omission": false,
-      "ending_omission": false,
-      "insertion_burst": false,
-      "adjacent_phrase_repetition": false,
-      "audio": "utmos22_large200_v1/audio/kitten-nano-bruno/utmos200_181.wav"
-    },
-    {
-      "model": "inflect-micro-v2-finalist",
-      "id": "utmos200_035",
-      "category": "names_places",
-      "reference": "Aurelia and Joaquin crossed the Schuylkill River before noon.",
-      "hypothesis": "Aurelia and Joachim crossed the Schalke river before noon.",
-      "reference_words": 9,
-      "hypothesis_words": 9,
-      "substitutions": 2,
-      "deletions": 0,
-      "insertions": 0,
-      "semantic_wer": 0.2222222222222222,
-      "utterance_failure": true,
-      "severe_failure": false,
-      "empty_hypothesis": false,
-      "leading_omission": false,
-      "ending_omission": false,
-      "insertion_burst": false,
-      "adjacent_phrase_repetition": false,
-      "audio": "release_polish_overnight_20260720/final_large200/audio/inflect-micro-v2-finalist/utmos200_035.wav"
-    },
-    {
-      "model": "piper-ryan-low",
-      "id": "utmos200_028",
-      "category": "technical",
-      "reference": "Hash the UTF eight payload with S H A two fifty-six before opening the checkpoint.",
-      "hypothesis": "Hash the UTF-8 payload with SHA-256 before opening the checkpoint.",
-      "reference_words": 14,
-      "hypothesis_words": 12,
-      "substitutions": 1,
-      "deletions": 2,
-      "insertions": 0,
-      "semantic_wer": 0.21428571428571427,
-      "utterance_failure": true,
-      "severe_failure": false,
-      "empty_hypothesis": false,
-      "leading_omission": false,
-      "ending_omission": false,
-      "insertion_burst": false,
-      "adjacent_phrase_repetition": false,
-      "audio": "utmos22_large200_v1/audio/piper-ryan-low/utmos200_028.wav"
-    },
-    {
-      "model": "kitten-nano-bruno",
-      "id": "utmos200_028",
-      "category": "technical",
-      "reference": "Hash the UTF eight payload with S H A two fifty-six before opening the checkpoint.",
-      "hypothesis": "Hash the UTF-8 payload with SHA-256 before opening the checkpoint.",
-      "reference_words": 14,
-      "hypothesis_words": 12,
-      "substitutions": 1,
-      "deletions": 2,
-      "insertions": 0,
-      "semantic_wer": 0.21428571428571427,
-      "utterance_failure": true,
-      "severe_failure": false,
-      "empty_hypothesis": false,
-      "leading_omission": false,
-      "ending_omission": false,
-      "insertion_burst": false,
-      "adjacent_phrase_repetition": false,
-      "audio": "utmos22_large200_v1/audio/kitten-nano-bruno/utmos200_028.wav"
-    },
-    {
-      "model": "inflect-micro-v2-finalist",
-      "id": "utmos200_041",
-      "category": "short",
-      "reference": "I mean. Yeah. Kind of.",
-      "hypothesis": "I mean, yeah, I kind of.",
-      "reference_words": 5,
-      "hypothesis_words": 6,
-      "substitutions": 0,
-      "deletions": 0,
-      "insertions": 1,
-      "semantic_wer": 0.2,
-      "utterance_failure": true,
-      "severe_failure": false,
-      "empty_hypothesis": false,
-      "leading_omission": false,
-      "ending_omission": false,
-      "insertion_burst": false,
-      "adjacent_phrase_repetition": false,
-      "audio": "release_polish_overnight_20260720/final_large200/audio/inflect-micro-v2-finalist/utmos200_041.wav"
-    },
-    {
-      "model": "inflect-micro-v2-finalist",
-      "id": "utmos200_084",
-      "category": "technical",
-      "reference": "The performance improvement is real, but it comes with tradeoffs.",
-      "hypothesis": "The performance improvement is real, but it comes with trade-offs.",
-      "reference_words": 10,
-      "hypothesis_words": 11,
-      "substitutions": 1,
-      "deletions": 0,
-      "insertions": 1,
-      "semantic_wer": 0.2,
-      "utterance_failure": true,
-      "severe_failure": false,
-      "empty_hypothesis": false,
-      "leading_omission": false,
-      "ending_omission": false,
-      "insertion_burst": false,
-      "adjacent_phrase_repetition": false,
-      "audio": "release_polish_overnight_20260720/final_large200/audio/inflect-micro-v2-finalist/utmos200_084.wav"
-    },
-    {
-      "model": "inflect-nano-v2-finalist",
-      "id": "utmos200_074",
-      "category": "homographs",
-      "reference": "The dove dove beneath the branch while the wind began to wind the loose cable.",
-      "hypothesis": "The dub-dub beneath the branch wall the wind began to wind the loose cable.",
-      "reference_words": 15,
-      "hypothesis_words": 15,
-      "substitutions": 3,
-      "deletions": 0,
-      "insertions": 0,
-      "semantic_wer": 0.2,
-      "utterance_failure": true,
-      "severe_failure": false,
-      "empty_hypothesis": false,
-      "leading_omission": false,
-      "ending_omission": false,
-      "insertion_burst": false,
-      "adjacent_phrase_repetition": false,
-      "audio": "release_polish_overnight_20260720/final_large200/audio/inflect-nano-v2-finalist/utmos200_074.wav"
-    },
-    {
-      "model": "inflect-nano-v2-finalist",
-      "id": "utmos200_084",
-      "category": "technical",
-      "reference": "The performance improvement is real, but it comes with tradeoffs.",
-      "hypothesis": "The performance improvement is real, but it comes with trade-offs.",
-      "reference_words": 10,
-      "hypothesis_words": 11,
-      "substitutions": 1,
-      "deletions": 0,
-      "insertions": 1,
-      "semantic_wer": 0.2,
-      "utterance_failure": true,
-      "severe_failure": false,
-      "empty_hypothesis": false,
-      "leading_omission": false,
-      "ending_omission": false,
-      "insertion_burst": false,
-      "adjacent_phrase_repetition": false,
-      "audio": "release_polish_overnight_20260720/final_large200/audio/inflect-nano-v2-finalist/utmos200_084.wav"
-    },
-    {
-      "model": "piper-ryan-low",
-      "id": "utmos200_012",
-      "category": "rare_words",
-      "reference": "The archaeologist catalogued a Byzantine reliquary and several anachronistic fragments.",
-      "hypothesis": "the archaeologists cataloged a Byzantine reliquary and several anachronistic fragments.",
-      "reference_words": 10,
-      "hypothesis_words": 10,
-      "substitutions": 2,
-      "deletions": 0,
-      "insertions": 0,
-      "semantic_wer": 0.2,
-      "utterance_failure": true,
-      "severe_failure": false,
-      "empty_hypothesis": false,
-      "leading_omission": false,
-      "ending_omission": false,
-      "insertion_burst": false,
-      "adjacent_phrase_repetition": false,
-      "audio": "utmos22_large200_v1/audio/piper-ryan-low/utmos200_012.wav"
-    },
-    {
-      "model": "piper-ryan-low",
-      "id": "utmos200_051",
-      "category": "numbers",
-      "reference": "At exactly seven forty-five, Morgan placed eighteen dollars and fifty cents beside the notebook.",
-      "hypothesis": "At exactly 7.45, Morgan placed $18.50 beside the notebook.",
-      "reference_words": 10,
-      "hypothesis_words": 11,
-      "substitutions": 1,
-      "deletions": 0,
-      "insertions": 1,
-      "semantic_wer": 0.2,
-      "utterance_failure": true,
-      "severe_failure": false,
-      "empty_hypothesis": false,
-      "leading_omission": false,
-      "ending_omission": false,
-      "insertion_burst": false,
-      "adjacent_phrase_repetition": false,
-      "audio": "utmos22_large200_v1/audio/piper-ryan-low/utmos200_051.wav"
-    },
-    {
-      "model": "piper-ryan-low",
-      "id": "utmos200_084",
-      "category": "technical",
-      "reference": "The performance improvement is real, but it comes with tradeoffs.",
-      "hypothesis": "The performance improvement is real, but it comes with trade-offs.",
-      "reference_words": 10,
-      "hypothesis_words": 11,
-      "substitutions": 1,
-      "deletions": 0,
-      "insertions": 1,
-      "semantic_wer": 0.2,
-      "utterance_failure": true,
-      "severe_failure": false,
-      "empty_hypothesis": false,
-      "leading_omission": false,
-      "ending_omission": false,
-      "insertion_burst": false,
-      "adjacent_phrase_repetition": false,
-      "audio": "utmos22_large200_v1/audio/piper-ryan-low/utmos200_084.wav"
-    },
-    {
-      "model": "piper-ryan-low",
-      "id": "utmos200_188",
-      "category": "conversational",
-      "reference": "You got engaged? When? How? Tell me everything right now.",
-      "hypothesis": "You got engaged. What? Oh. Tell me everything right now.",
-      "reference_words": 10,
-      "hypothesis_words": 10,
-      "substitutions": 2,
-      "deletions": 0,
-      "insertions": 0,
-      "semantic_wer": 0.2,
-      "utterance_failure": true,
-      "severe_failure": false,
-      "empty_hypothesis": false,
-      "leading_omission": false,
-      "ending_omission": false,
-      "insertion_burst": false,
-      "adjacent_phrase_repetition": false,
-      "audio": "utmos22_large200_v1/audio/piper-ryan-low/utmos200_188.wav"
-    },
-    {
-      "model": "kitten-nano-bruno",
-      "id": "utmos200_041",
-      "category": "short",
-      "reference": "I mean. Yeah. Kind of.",
-      "hypothesis": "I mean. Yes. Kind of.",
-      "reference_words": 5,
-      "hypothesis_words": 5,
-      "substitutions": 1,
-      "deletions": 0,
-      "insertions": 0,
-      "semantic_wer": 0.2,
-      "utterance_failure": true,
-      "severe_failure": false,
-      "empty_hypothesis": false,
-      "leading_omission": false,
-      "ending_omission": false,
-      "insertion_burst": false,
-      "adjacent_phrase_repetition": false,
-      "audio": "utmos22_large200_v1/audio/kitten-nano-bruno/utmos200_041.wav"
-    },
-    {
-      "model": "kitten-nano-bruno",
-      "id": "utmos200_051",
-      "category": "numbers",
-      "reference": "At exactly seven forty-five, Morgan placed eighteen dollars and fifty cents beside the notebook.",
-      "hypothesis": "At exactly 7.45, Morgan placed $18.50 beside the notebook.",
-      "reference_words": 10,
-      "hypothesis_words": 11,
-      "substitutions": 1,
-      "deletions": 0,
-      "insertions": 1,
-      "semantic_wer": 0.2,
-      "utterance_failure": true,
-      "severe_failure": false,
-      "empty_hypothesis": false,
-      "leading_omission": false,
-      "ending_omission": false,
-      "insertion_burst": false,
-      "adjacent_phrase_repetition": false,
-      "audio": "utmos22_large200_v1/audio/kitten-nano-bruno/utmos200_051.wav"
-    },
-    {
-      "model": "kitten-nano-bruno",
-      "id": "utmos200_084",
-      "category": "technical",
-      "reference": "The performance improvement is real, but it comes with tradeoffs.",
-      "hypothesis": "The performance improvement is real, but it comes with trade-offs.",
-      "reference_words": 10,
-      "hypothesis_words": 11,
-      "substitutions": 1,
-      "deletions": 0,
-      "insertions": 1,
-      "semantic_wer": 0.2,
-      "utterance_failure": true,
-      "severe_failure": false,
-      "empty_hypothesis": false,
-      "leading_omission": false,
-      "ending_omission": false,
-      "insertion_burst": false,
-      "adjacent_phrase_repetition": false,
-      "audio": "utmos22_large200_v1/audio/kitten-nano-bruno/utmos200_084.wav"
-    },
-    {
-      "model": "inflect-micro-v2-finalist",
-      "id": "utmos200_009",
-      "category": "numbers",
-      "reference": "The package weighs twelve point six kilograms and arrived on July twenty-first.",
-      "hypothesis": "The package weighs 12.6kg and arrived on July 21.",
-      "reference_words": 11,
-      "hypothesis_words": 11,
-      "substitutions": 2,
-      "deletions": 0,
-      "insertions": 0,
-      "semantic_wer": 0.18181818181818182,
-      "utterance_failure": true,
-      "severe_failure": false,
-      "empty_hypothesis": false,
-      "leading_omission": false,
-      "ending_omission": false,
-      "insertion_burst": false,
-      "adjacent_phrase_repetition": false,
-      "audio": "release_polish_overnight_20260720/final_large200/audio/inflect-micro-v2-finalist/utmos200_009.wav"
-    },
-    {
-      "model": "inflect-micro-v2-finalist",
-      "id": "utmos200_082",
-      "category": "rare_words",
-      "reference": "The physician recommended a noninvasive procedure for the recurring neurological symptoms.",
-      "hypothesis": "The physician recommended a non-invasive procedure for the recurring neurological symptoms.",
-      "reference_words": 11,
-      "hypothesis_words": 12,
-      "substitutions": 1,
-      "deletions": 0,
-      "insertions": 1,
-      "semantic_wer": 0.18181818181818182,
-      "utterance_failure": true,
-      "severe_failure": false,
-      "empty_hypothesis": false,
-      "leading_omission": false,
-      "ending_omission": false,
-      "insertion_burst": false,
-      "adjacent_phrase_repetition": false,
-      "audio": "release_polish_overnight_20260720/final_large200/audio/inflect-micro-v2-finalist/utmos200_082.wav"
-    },
-    {
-      "model": "inflect-nano-v2-finalist",
-      "id": "utmos200_009",
-      "category": "numbers",
-      "reference": "The package weighs twelve point six kilograms and arrived on July twenty-first.",
-      "hypothesis": "The package weighs 12.6kg and arrived on July 21.",
-      "reference_words": 11,
-      "hypothesis_words": 11,
-      "substitutions": 2,
-      "deletions": 0,
-      "insertions": 0,
-      "semantic_wer": 0.18181818181818182,
-      "utterance_failure": true,
-      "severe_failure": false,
-      "empty_hypothesis": false,
-      "leading_omission": false,
-      "ending_omission": false,
-      "insertion_burst": false,
-      "adjacent_phrase_repetition": false,
-      "audio": "release_polish_overnight_20260720/final_large200/audio/inflect-nano-v2-finalist/utmos200_009.wav"
-    },
-    {
-      "model": "inflect-nano-v2-finalist",
-      "id": "utmos200_082",
-      "category": "rare_words",
-      "reference": "The physician recommended a noninvasive procedure for the recurring neurological symptoms.",
-      "hypothesis": "The physician recommended a non-invasive procedure for the recurring neurological symptoms.",
-      "reference_words": 11,
-      "hypothesis_words": 12,
-      "substitutions": 1,
-      "deletions": 0,
-      "insertions": 1,
-      "semantic_wer": 0.18181818181818182,
-      "utterance_failure": true,
-      "severe_failure": false,
-      "empty_hypothesis": false,
-      "leading_omission": false,
-      "ending_omission": false,
-      "insertion_burst": false,
-      "adjacent_phrase_repetition": false,
-      "audio": "release_polish_overnight_20260720/final_large200/audio/inflect-nano-v2-finalist/utmos200_082.wav"
-    },
-    {
-      "model": "piper-ryan-low",
-      "id": "utmos200_082",
-      "category": "rare_words",
-      "reference": "The physician recommended a noninvasive procedure for the recurring neurological symptoms.",
-      "hypothesis": "the physician recommended a non-invasive procedure for the recurring neurological symptoms.",
-      "reference_words": 11,
-      "hypothesis_words": 12,
-      "substitutions": 1,
-      "deletions": 0,
-      "insertions": 1,
-      "semantic_wer": 0.18181818181818182,
-      "utterance_failure": true,
-      "severe_failure": false,
-      "empty_hypothesis": false,
-      "leading_omission": false,
-      "ending_omission": false,
-      "insertion_burst": false,
-      "adjacent_phrase_repetition": false,
-      "audio": "utmos22_large200_v1/audio/piper-ryan-low/utmos200_082.wav"
-    },
-    {
-      "model": "kitten-nano-bruno",
-      "id": "utmos200_082",
-      "category": "rare_words",
-      "reference": "The physician recommended a noninvasive procedure for the recurring neurological symptoms.",
-      "hypothesis": "The physician recommended a non-invasive procedure for the recurring neurological symptoms.",
-      "reference_words": 11,
-      "hypothesis_words": 12,
-      "substitutions": 1,
-      "deletions": 0,
-      "insertions": 1,
-      "semantic_wer": 0.18181818181818182,
-      "utterance_failure": true,
-      "severe_failure": false,
-      "empty_hypothesis": false,
-      "leading_omission": false,
-      "ending_omission": false,
-      "insertion_burst": false,
-      "adjacent_phrase_repetition": false,
-      "audio": "utmos22_large200_v1/audio/kitten-nano-bruno/utmos200_082.wav"
-    },
-    {
-      "model": "inflect-nano-v2-finalist",
-      "id": "utmos200_180",
-      "category": "narrative",
-      "reference": "She knew. She had always known. She just waited for the right moment.",
-      "hypothesis": "Ji knew but she had always known, she just waited for the right moment.",
-      "reference_words": 13,
-      "hypothesis_words": 14,
-      "substitutions": 1,
-      "deletions": 0,
-      "insertions": 1,
-      "semantic_wer": 0.15384615384615385,
-      "utterance_failure": true,
-      "severe_failure": false,
-      "empty_hypothesis": false,
-      "leading_omission": false,
-      "ending_omission": false,
-      "insertion_burst": false,
-      "adjacent_phrase_repetition": false,
-      "audio": "release_polish_overnight_20260720/final_large200/audio/inflect-nano-v2-finalist/utmos200_180.wav"
-    },
-    {
-      "model": "kitten-nano-bruno",
-      "id": "utmos200_175",
-      "category": "narrative",
-      "reference": "The note was short, which was somehow more frightening than a long one would have been.",
-      "hypothesis": "The note was short, which was somehow more fright, ing than a long one would have been.",
-      "reference_words": 16,
-      "hypothesis_words": 17,
-      "substitutions": 1,
-      "deletions": 0,
-      "insertions": 1,
-      "semantic_wer": 0.125,
-      "utterance_failure": true,
-      "severe_failure": false,
-      "empty_hypothesis": false,
-      "leading_omission": false,
-      "ending_omission": false,
-      "insertion_burst": false,
-      "adjacent_phrase_repetition": false,
-      "audio": "utmos22_large200_v1/audio/kitten-nano-bruno/utmos200_175.wav"
-    },
-    {
-      "model": "inflect-micro-v2-finalist",
-      "id": "utmos200_049",
-      "category": "names_places",
-      "reference": "Xiomara met Siobhan near the old library in Worcestershire.",
-      "hypothesis": "Zamara met Siobhan near the old library in Worcestershire.",
-      "reference_words": 9,
-      "hypothesis_words": 9,
-      "substitutions": 1,
-      "deletions": 0,
-      "insertions": 0,
-      "semantic_wer": 0.1111111111111111,
-      "utterance_failure": true,
-      "severe_failure": false,
-      "empty_hypothesis": false,
-      "leading_omission": false,
-      "ending_omission": false,
-      "insertion_burst": false,
-      "adjacent_phrase_repetition": false,
-      "audio": "release_polish_overnight_20260720/final_large200/audio/inflect-micro-v2-finalist/utmos200_049.wav"
-    },
-    {
-      "model": "inflect-micro-v2-finalist",
-      "id": "utmos200_077",
-      "category": "names_places",
-      "reference": "Saskatchewan looked unusually bright beneath the pale February sunrise.",
-      "hypothesis": "Saskatchewan looked unusually bright beneath that pale February sunrise.",
-      "reference_words": 9,
-      "hypothesis_words": 9,
-      "substitutions": 1,
-      "deletions": 0,
-      "insertions": 0,
-      "semantic_wer": 0.1111111111111111,
-      "utterance_failure": true,
-      "severe_failure": false,
-      "empty_hypothesis": false,
-      "leading_omission": false,
-      "ending_omission": false,
-      "insertion_burst": false,
-      "adjacent_phrase_repetition": false,
-      "audio": "release_polish_overnight_20260720/final_large200/audio/inflect-micro-v2-finalist/utmos200_077.wav"
-    },
-    {
-      "model": "inflect-nano-v2-finalist",
-      "id": "utmos200_022",
-      "category": "narrative",
-      "reference": "The plan was simple. The execution was anything but.",
-      "hypothesis": "The plan was simple. The execution was anything but perfect.",
-      "reference_words": 9,
-      "hypothesis_words": 10,
-      "substitutions": 0,
-      "deletions": 0,
-      "insertions": 1,
-      "semantic_wer": 0.1111111111111111,
-      "utterance_failure": true,
-      "severe_failure": false,
-      "empty_hypothesis": false,
-      "leading_omission": false,
-      "ending_omission": false,
-      "insertion_burst": false,
-      "adjacent_phrase_repetition": false,
-      "audio": "release_polish_overnight_20260720/final_large200/audio/inflect-nano-v2-finalist/utmos200_022.wav"
-    },
-    {
-      "model": "inflect-nano-v2-finalist",
-      "id": "utmos200_049",
-      "category": "names_places",
-      "reference": "Xiomara met Siobhan near the old library in Worcestershire.",
-      "hypothesis": "Damara met Siobhan near the old library in Worcestershire.",
-      "reference_words": 9,
-      "hypothesis_words": 9,
-      "substitutions": 1,
-      "deletions": 0,
-      "insertions": 0,
-      "semantic_wer": 0.1111111111111111,
-      "utterance_failure": true,
-      "severe_failure": false,
-      "empty_hypothesis": false,
-      "leading_omission": false,
-      "ending_omission": false,
-      "insertion_burst": false,
-      "adjacent_phrase_repetition": false,
-      "audio": "release_polish_overnight_20260720/final_large200/audio/inflect-nano-v2-finalist/utmos200_049.wav"
-    },
-    {
-      "model": "piper-ryan-low",
-      "id": "utmos200_035",
-      "category": "names_places",
-      "reference": "Aurelia and Joaquin crossed the Schuylkill River before noon.",
-      "hypothesis": "Aurelia and Joaquin crossed the Chiocul River before noon.",
-      "reference_words": 9,
-      "hypothesis_words": 9,
-      "substitutions": 1,
-      "deletions": 0,
-      "insertions": 0,
-      "semantic_wer": 0.1111111111111111,
-      "utterance_failure": true,
-      "severe_failure": false,
-      "empty_hypothesis": false,
-      "leading_omission": false,
-      "ending_omission": false,
-      "insertion_burst": false,
-      "adjacent_phrase_repetition": false,
-      "audio": "utmos22_large200_v1/audio/piper-ryan-low/utmos200_035.wav"
-    },
-    {
-      "model": "inflect-micro-v2-finalist",
-      "id": "utmos200_018",
-      "category": "homographs",
-      "reference": "They refuse to place the refuse beside the produce aisle.",
-      "hypothesis": "They refused to place the refuse beside the produce aisle.",
-      "reference_words": 10,
-      "hypothesis_words": 10,
-      "substitutions": 1,
-      "deletions": 0,
-      "insertions": 0,
-      "semantic_wer": 0.1,
-      "utterance_failure": true,
-      "severe_failure": false,
-      "empty_hypothesis": false,
-      "leading_omission": false,
-      "ending_omission": false,
-      "insertion_burst": false,
-      "adjacent_phrase_repetition": false,
-      "audio": "release_polish_overnight_20260720/final_large200/audio/inflect-micro-v2-finalist/utmos200_018.wav"
-    },
-    {
-      "model": "inflect-micro-v2-finalist",
-      "id": "utmos200_023",
-      "category": "numbers",
-      "reference": "Her score improved from eighty-two percent to ninety-seven percent in two weeks.",
-      "hypothesis": "GERS score improved from 82% to 97% in two weeks.",
-      "reference_words": 10,
-      "hypothesis_words": 10,
-      "substitutions": 1,
-      "deletions": 0,
-      "insertions": 0,
-      "semantic_wer": 0.1,
-      "utterance_failure": true,
-      "severe_failure": false,
-      "empty_hypothesis": false,
-      "leading_omission": false,
-      "ending_omission": false,
-      "insertion_burst": false,
-      "adjacent_phrase_repetition": false,
-      "audio": "release_polish_overnight_20260720/final_large200/audio/inflect-micro-v2-finalist/utmos200_023.wav"
-    }
-  ]
-}

evaluation/asr_robustness.json

@@ -1,928 +0,0 @@
-{
-  "format": "inflect_tts_asr_robustness_summary_v1",
-  "source_format": "inflect_tts_multi_asr_wer_v1",
-  "asr": "whisper-large-v3",
-  "notes": [
-    "Character error rate is calculated over semantic-normalized ASR transcripts.",
-    "Sentence error rate counts any utterance with at least one semantic word edit.",
-    "These metrics measure ASR recoverability and do not replace human listening."
-  ],
-  "systems": {
-    "inflect-micro-v2-finalist": {
-      "overall": {
-        "utterances": 200,
-        "semantic_errors": 32,
-        "semantic_words": 2608,
-        "semantic_wer": 0.012269938650306749,
-        "failed_utterances": 21,
-        "sentence_error_rate": 0.105,
-        "exact_sentence_rate": 0.895,
-        "character_errors": 62,
-        "reference_characters": 13718,
-        "character_error_rate": 0.004519609272488701,
-        "mean_utterance_wer": 0.021512501387501385,
-        "p95_utterance_wer": 0.18181818181818182,
-        "worst_utterance_wer": 1.0
-      },
-      "categories": {
-        "conversational": {
-          "utterances": 25,
-          "semantic_errors": 0,
-          "semantic_words": 309,
-          "semantic_wer": 0.0,
-          "failed_utterances": 0,
-          "sentence_error_rate": 0.0,
-          "exact_sentence_rate": 1.0,
-          "character_errors": 0,
-          "reference_characters": 1501,
-          "character_error_rate": 0.0,
-          "mean_utterance_wer": 0.0,
-          "p95_utterance_wer": 0.0,
-          "worst_utterance_wer": 0.0
-        },
-        "descriptive": {
-          "utterances": 16,
-          "semantic_errors": 0,
-          "semantic_words": 226,
-          "semantic_wer": 0.0,
-          "failed_utterances": 0,
-          "sentence_error_rate": 0.0,
-          "exact_sentence_rate": 1.0,
-          "character_errors": 0,
-          "reference_characters": 1146,
-          "character_error_rate": 0.0,
-          "mean_utterance_wer": 0.0,
-          "p95_utterance_wer": 0.0,
-          "worst_utterance_wer": 0.0
-        },
-        "emotional": {
-          "utterances": 24,
-          "semantic_errors": 0,
-          "semantic_words": 329,
-          "semantic_wer": 0.0,
-          "failed_utterances": 0,
-          "sentence_error_rate": 0.0,
-          "exact_sentence_rate": 1.0,
-          "character_errors": 0,
-          "reference_characters": 1574,
-          "character_error_rate": 0.0,
-          "mean_utterance_wer": 0.0,
-          "p95_utterance_wer": 0.0,
-          "worst_utterance_wer": 0.0
-        },
-        "homographs": {
-          "utterances": 6,
-          "semantic_errors": 1,
-          "semantic_words": 70,
-          "semantic_wer": 0.014285714285714285,
-          "failed_utterances": 1,
-          "sentence_error_rate": 0.16666666666666666,
-          "exact_sentence_rate": 0.8333333333333334,
-          "character_errors": 1,
-          "reference_characters": 375,
-          "character_error_rate": 0.0026666666666666666,
-          "mean_utterance_wer": 0.016666666666666666,
-          "p95_utterance_wer": 0.07500000000000001,
-          "worst_utterance_wer": 0.1
-        },
-        "long": {
-          "utterances": 15,
-          "semantic_errors": 1,
-          "semantic_words": 432,
-          "semantic_wer": 0.0023148148148148147,
-          "failed_utterances": 1,
-          "sentence_error_rate": 0.06666666666666667,
-          "exact_sentence_rate": 0.9333333333333333,
-          "character_errors": 6,
-          "reference_characters": 2206,
-          "character_error_rate": 0.0027198549410698096,
-          "mean_utterance_wer": 0.0018518518518518517,
-          "p95_utterance_wer": 0.008333333333333304,
-          "worst_utterance_wer": 0.027777777777777776
-        },
-        "long_range": {
-          "utterances": 6,
-          "semantic_errors": 0,
-          "semantic_words": 121,
-          "semantic_wer": 0.0,
-          "failed_utterances": 0,
-          "sentence_error_rate": 0.0,
-          "exact_sentence_rate": 1.0,
-          "character_errors": 0,
-          "reference_characters": 744,
-          "character_error_rate": 0.0,
-          "mean_utterance_wer": 0.0,
-          "p95_utterance_wer": 0.0,
-          "worst_utterance_wer": 0.0
-        },
-        "names_places": {
-          "utterances": 6,
-          "semantic_errors": 4,
-          "semantic_words": 57,
-          "semantic_wer": 0.07017543859649122,
-          "failed_utterances": 3,
-          "sentence_error_rate": 0.5,
-          "exact_sentence_rate": 0.5,
-          "character_errors": 13,
-          "reference_characters": 397,
-          "character_error_rate": 0.0327455919395466,
-          "mean_utterance_wer": 0.07407407407407407,
-          "p95_utterance_wer": 0.19444444444444442,
-          "worst_utterance_wer": 0.2222222222222222
-        },
-        "narrative": {
-          "utterances": 24,
-          "semantic_errors": 1,
-          "semantic_words": 352,
-          "semantic_wer": 0.002840909090909091,
-          "failed_utterances": 1,
-          "sentence_error_rate": 0.041666666666666664,
-          "exact_sentence_rate": 0.9583333333333334,
-          "character_errors": 1,
-          "reference_characters": 1762,
-          "character_error_rate": 0.0005675368898978433,
-          "mean_utterance_wer": 0.002777777777777778,
-          "p95_utterance_wer": 0.0,
-          "worst_utterance_wer": 0.06666666666666667
-        },
-        "numbers": {
-          "utterances": 6,
-          "semantic_errors": 10,
-          "semantic_words": 64,
-          "semantic_wer": 0.15625,
-          "failed_utterances": 5,
-          "sentence_error_rate": 0.8333333333333334,
-          "exact_sentence_rate": 0.16666666666666663,
-          "character_errors": 18,
-          "reference_characters": 322,
-          "character_error_rate": 0.055900621118012424,
-          "mean_utterance_wer": 0.17462121212121215,
-          "p95_utterance_wer": 0.35625,
-          "worst_utterance_wer": 0.375
-        },
-        "punctuation": {
-          "utterances": 6,
-          "semantic_errors": 0,
-          "semantic_words": 65,
-          "semantic_wer": 0.0,
-          "failed_utterances": 0,
-          "sentence_error_rate": 0.0,
-          "exact_sentence_rate": 1.0,
-          "character_errors": 0,
-          "reference_characters": 402,
-          "character_error_rate": 0.0,
-          "mean_utterance_wer": 0.0,
-          "p95_utterance_wer": 0.0,
-          "worst_utterance_wer": 0.0
-        },
-        "question": {
-          "utterances": 15,
-          "semantic_errors": 0,
-          "semantic_words": 165,
-          "semantic_wer": 0.0,
-          "failed_utterances": 0,
-          "sentence_error_rate": 0.0,
-          "exact_sentence_rate": 1.0,
-          "character_errors": 0,
-          "reference_characters": 834,
-          "character_error_rate": 0.0,
-          "mean_utterance_wer": 0.0,
-          "p95_utterance_wer": 0.0,
-          "worst_utterance_wer": 0.0
-        },
-        "rare_words": {
-          "utterances": 6,
-          "semantic_errors": 3,
-          "semantic_words": 57,
-          "semantic_wer": 0.05263157894736842,
-          "failed_utterances": 2,
-          "sentence_error_rate": 0.3333333333333333,
-          "exact_sentence_rate": 0.6666666666666667,
-          "character_errors": 3,
-          "reference_characters": 500,
-          "character_error_rate": 0.006,
-          "mean_utterance_wer": 0.046969696969696974,
-          "p95_utterance_wer": 0.16136363636363635,
-          "worst_utterance_wer": 0.18181818181818182
-        },
-        "short": {
-          "utterances": 24,
-          "semantic_errors": 4,
-          "semantic_words": 105,
-          "semantic_wer": 0.0380952380952381,
-          "failed_utterances": 4,
-          "sentence_error_rate": 0.16666666666666666,
-          "exact_sentence_rate": 0.8333333333333334,
-          "character_errors": 10,
-          "reference_characters": 458,
-          "character_error_rate": 0.021834061135371178,
-          "mean_utterance_wer": 0.07083333333333333,
-          "p95_utterance_wer": 0.25,
-          "worst_utterance_wer": 1.0
-        },
-        "technical": {
-          "utterances": 21,
-          "semantic_errors": 8,
-          "semantic_words": 256,
-          "semantic_wer": 0.03125,
-          "failed_utterances": 4,
-          "sentence_error_rate": 0.19047619047619047,
-          "exact_sentence_rate": 0.8095238095238095,
-          "character_errors": 10,
-          "reference_characters": 1497,
-          "character_error_rate": 0.006680026720106881,
-          "mean_utterance_wer": 0.030193615907901622,
-          "p95_utterance_wer": 0.2,
-          "worst_utterance_wer": 0.2857142857142857
-        }
-      }
-    },
-    "inflect-nano-v2-finalist": {
-      "overall": {
-        "utterances": 200,
-        "semantic_errors": 40,
-        "semantic_words": 2608,
-        "semantic_wer": 0.015337423312883436,
-        "failed_utterances": 23,
-        "sentence_error_rate": 0.115,
-        "exact_sentence_rate": 0.885,
-        "character_errors": 102,
-        "reference_characters": 13718,
-        "character_error_rate": 0.007435486222481412,
-        "mean_utterance_wer": 0.021362234987234986,
-        "p95_utterance_wer": 0.18272727272727243,
-        "worst_utterance_wer": 0.4
-      },
-      "categories": {
-        "conversational": {
-          "utterances": 25,
-          "semantic_errors": 1,
-          "semantic_words": 309,
-          "semantic_wer": 0.003236245954692557,
-          "failed_utterances": 1,
-          "sentence_error_rate": 0.04,
-          "exact_sentence_rate": 0.96,
-          "character_errors": 5,
-          "reference_characters": 1501,
-          "character_error_rate": 0.0033311125916055963,
-          "mean_utterance_wer": 0.0036363636363636364,
-          "p95_utterance_wer": 0.0,
-          "worst_utterance_wer": 0.09090909090909091
-        },
-        "descriptive": {
-          "utterances": 16,
-          "semantic_errors": 0,
-          "semantic_words": 226,
-          "semantic_wer": 0.0,
-          "failed_utterances": 0,
-          "sentence_error_rate": 0.0,
-          "exact_sentence_rate": 1.0,
-          "character_errors": 0,
-          "reference_characters": 1146,
-          "character_error_rate": 0.0,
-          "mean_utterance_wer": 0.0,
-          "p95_utterance_wer": 0.0,
-          "worst_utterance_wer": 0.0
-        },
-        "emotional": {
-          "utterances": 24,
-          "semantic_errors": 0,
-          "semantic_words": 329,
-          "semantic_wer": 0.0,
-          "failed_utterances": 0,
-          "sentence_error_rate": 0.0,
-          "exact_sentence_rate": 1.0,
-          "character_errors": 0,
-          "reference_characters": 1574,
-          "character_error_rate": 0.0,
-          "mean_utterance_wer": 0.0,
-          "p95_utterance_wer": 0.0,
-          "worst_utterance_wer": 0.0
-        },
-        "homographs": {
-          "utterances": 6,
-          "semantic_errors": 4,
-          "semantic_words": 70,
-          "semantic_wer": 0.05714285714285714,
-          "failed_utterances": 2,
-          "sentence_error_rate": 0.3333333333333333,
-          "exact_sentence_rate": 0.6666666666666667,
-          "character_errors": 10,
-          "reference_characters": 375,
-          "character_error_rate": 0.02666666666666667,
-          "mean_utterance_wer": 0.05000000000000001,
-          "p95_utterance_wer": 0.17500000000000002,
-          "worst_utterance_wer": 0.2
-        },
-        "long": {
-          "utterances": 15,
-          "semantic_errors": 2,
-          "semantic_words": 432,
-          "semantic_wer": 0.004629629629629629,
-          "failed_utterances": 1,
-          "sentence_error_rate": 0.06666666666666667,
-          "exact_sentence_rate": 0.9333333333333333,
-          "character_errors": 5,
-          "reference_characters": 2206,
-          "character_error_rate": 0.0022665457842248413,
-          "mean_utterance_wer": 0.00404040404040404,
-          "p95_utterance_wer": 0.01818181818181812,
-          "worst_utterance_wer": 0.06060606060606061
-        },
-        "long_range": {
-          "utterances": 6,
-          "semantic_errors": 1,
-          "semantic_words": 121,
-          "semantic_wer": 0.008264462809917356,
-          "failed_utterances": 1,
-          "sentence_error_rate": 0.16666666666666666,
-          "exact_sentence_rate": 0.8333333333333334,
-          "character_errors": 2,
-          "reference_characters": 744,
-          "character_error_rate": 0.002688172043010753,
-          "mean_utterance_wer": 0.008333333333333333,
-          "p95_utterance_wer": 0.037500000000000006,
-          "worst_utterance_wer": 0.05
-        },
-        "names_places": {
-          "utterances": 6,
-          "semantic_errors": 5,
-          "semantic_words": 57,
-          "semantic_wer": 0.08771929824561403,
-          "failed_utterances": 3,
-          "sentence_error_rate": 0.5,
-          "exact_sentence_rate": 0.5,
-          "character_errors": 21,
-          "reference_characters": 397,
-          "character_error_rate": 0.05289672544080604,
-          "mean_utterance_wer": 0.09074074074074073,
-          "p95_utterance_wer": 0.2777777777777778,
-          "worst_utterance_wer": 0.3333333333333333
-        },
-        "narrative": {
-          "utterances": 24,
-          "semantic_errors": 4,
-          "semantic_words": 352,
-          "semantic_wer": 0.011363636363636364,
-          "failed_utterances": 3,
-          "sentence_error_rate": 0.125,
-          "exact_sentence_rate": 0.875,
-          "character_errors": 19,
-          "reference_characters": 1762,
-          "character_error_rate": 0.010783200908059024,
-          "mean_utterance_wer": 0.013123219373219372,
-          "p95_utterance_wer": 0.10194444444444431,
-          "worst_utterance_wer": 0.15384615384615385
-        },
-        "numbers": {
-          "utterances": 6,
-          "semantic_errors": 8,
-          "semantic_words": 64,
-          "semantic_wer": 0.125,
-          "failed_utterances": 3,
-          "sentence_error_rate": 0.5,
-          "exact_sentence_rate": 0.5,
-          "character_errors": 16,
-          "reference_characters": 322,
-          "character_error_rate": 0.049689440993788817,
-          "mean_utterance_wer": 0.1428030303030303,
-          "p95_utterance_wer": 0.35625,
-          "worst_utterance_wer": 0.375
-        },
-        "punctuation": {
-          "utterances": 6,
-          "semantic_errors": 0,
-          "semantic_words": 65,
-          "semantic_wer": 0.0,
-          "failed_utterances": 0,
-          "sentence_error_rate": 0.0,
-          "exact_sentence_rate": 1.0,
-          "character_errors": 0,
-          "reference_characters": 402,
-          "character_error_rate": 0.0,
-          "mean_utterance_wer": 0.0,
-          "p95_utterance_wer": 0.0,
-          "worst_utterance_wer": 0.0
-        },
-        "question": {
-          "utterances": 15,
-          "semantic_errors": 0,
-          "semantic_words": 165,
-          "semantic_wer": 0.0,
-          "failed_utterances": 0,
-          "sentence_error_rate": 0.0,
-          "exact_sentence_rate": 1.0,
-          "character_errors": 0,
-          "reference_characters": 834,
-          "character_error_rate": 0.0,
-          "mean_utterance_wer": 0.0,
-          "p95_utterance_wer": 0.0,
-          "worst_utterance_wer": 0.0
-        },
-        "rare_words": {
-          "utterances": 6,
-          "semantic_errors": 2,
-          "semantic_words": 57,
-          "semantic_wer": 0.03508771929824561,
-          "failed_utterances": 1,
-          "sentence_error_rate": 0.16666666666666666,
-          "exact_sentence_rate": 0.8333333333333334,
-          "character_errors": 1,
-          "reference_characters": 500,
-          "character_error_rate": 0.002,
-          "mean_utterance_wer": 0.030303030303030304,
-          "p95_utterance_wer": 0.13636363636363635,
-          "worst_utterance_wer": 0.18181818181818182
-        },
-        "short": {
-          "utterances": 24,
-          "semantic_errors": 5,
-          "semantic_words": 105,
-          "semantic_wer": 0.047619047619047616,
-          "failed_utterances": 4,
-          "sentence_error_rate": 0.16666666666666666,
-          "exact_sentence_rate": 0.8333333333333334,
-          "character_errors": 17,
-          "reference_characters": 458,
-          "character_error_rate": 0.03711790393013101,
-          "mean_utterance_wer": 0.051388888888888894,
-          "p95_utterance_wer": 0.32083333333333314,
-          "worst_utterance_wer": 0.4
-        },
-        "technical": {
-          "utterances": 21,
-          "semantic_errors": 8,
-          "semantic_words": 256,
-          "semantic_wer": 0.03125,
-          "failed_utterances": 4,
-          "sentence_error_rate": 0.19047619047619047,
-          "exact_sentence_rate": 0.8095238095238095,
-          "character_errors": 6,
-          "reference_characters": 1497,
-          "character_error_rate": 0.004008016032064128,
-          "mean_utterance_wer": 0.030455259026687595,
-          "p95_utterance_wer": 0.2,
-          "worst_utterance_wer": 0.2857142857142857
-        }
-      }
-    },
-    "kitten-nano-bruno": {
-      "overall": {
-        "utterances": 200,
-        "semantic_errors": 25,
-        "semantic_words": 2608,
-        "semantic_wer": 0.009585889570552147,
-        "failed_utterances": 15,
-        "sentence_error_rate": 0.075,
-        "exact_sentence_rate": 0.925,
-        "character_errors": 41,
-        "reference_characters": 13718,
-        "character_error_rate": 0.002988773873742528,
-        "mean_utterance_wer": 0.012458457692977818,
-        "p95_utterance_wer": 0.09136363636363622,
-        "worst_utterance_wer": 0.375
-      },
-      "categories": {
-        "conversational": {
-          "utterances": 25,
-          "semantic_errors": 1,
-          "semantic_words": 309,
-          "semantic_wer": 0.003236245954692557,
-          "failed_utterances": 1,
-          "sentence_error_rate": 0.04,
-          "exact_sentence_rate": 0.96,
-          "character_errors": 2,
-          "reference_characters": 1501,
-          "character_error_rate": 0.0013324450366422385,
-          "mean_utterance_wer": 0.002857142857142857,
-          "p95_utterance_wer": 0.0,
-          "worst_utterance_wer": 0.07142857142857142
-        },
-        "descriptive": {
-          "utterances": 16,
-          "semantic_errors": 0,
-          "semantic_words": 226,
-          "semantic_wer": 0.0,
-          "failed_utterances": 0,
-          "sentence_error_rate": 0.0,
-          "exact_sentence_rate": 1.0,
-          "character_errors": 0,
-          "reference_characters": 1146,
-          "character_error_rate": 0.0,
-          "mean_utterance_wer": 0.0,
-          "p95_utterance_wer": 0.0,
-          "worst_utterance_wer": 0.0
-        },
-        "emotional": {
-          "utterances": 24,
-          "semantic_errors": 0,
-          "semantic_words": 329,
-          "semantic_wer": 0.0,
-          "failed_utterances": 0,
-          "sentence_error_rate": 0.0,
-          "exact_sentence_rate": 1.0,
-          "character_errors": 0,
-          "reference_characters": 1574,
-          "character_error_rate": 0.0,
-          "mean_utterance_wer": 0.0,
-          "p95_utterance_wer": 0.0,
-          "worst_utterance_wer": 0.0
-        },
-        "homographs": {
-          "utterances": 6,
-          "semantic_errors": 1,
-          "semantic_words": 70,
-          "semantic_wer": 0.014285714285714285,
-          "failed_utterances": 1,
-          "sentence_error_rate": 0.16666666666666666,
-          "exact_sentence_rate": 0.8333333333333334,
-          "character_errors": 1,
-          "reference_characters": 375,
-          "character_error_rate": 0.0026666666666666666,
-          "mean_utterance_wer": 0.016666666666666666,
-          "p95_utterance_wer": 0.07500000000000001,
-          "worst_utterance_wer": 0.1
-        },
-        "long": {
-          "utterances": 15,
-          "semantic_errors": 1,
-          "semantic_words": 432,
-          "semantic_wer": 0.0023148148148148147,
-          "failed_utterances": 1,
-          "sentence_error_rate": 0.06666666666666667,
-          "exact_sentence_rate": 0.9333333333333333,
-          "character_errors": 4,
-          "reference_characters": 2206,
-          "character_error_rate": 0.001813236627379873,
-          "mean_utterance_wer": 0.002564102564102564,
-          "p95_utterance_wer": 0.011538461538461497,
-          "worst_utterance_wer": 0.038461538461538464
-        },
-        "long_range": {
-          "utterances": 6,
-          "semantic_errors": 0,
-          "semantic_words": 121,
-          "semantic_wer": 0.0,
-          "failed_utterances": 0,
-          "sentence_error_rate": 0.0,
-          "exact_sentence_rate": 1.0,
-          "character_errors": 0,
-          "reference_characters": 744,
-          "character_error_rate": 0.0,
-          "mean_utterance_wer": 0.0,
-          "p95_utterance_wer": 0.0,
-          "worst_utterance_wer": 0.0
-        },
-        "names_places": {
-          "utterances": 6,
-          "semantic_errors": 3,
-          "semantic_words": 57,
-          "semantic_wer": 0.05263157894736842,
-          "failed_utterances": 1,
-          "sentence_error_rate": 0.16666666666666666,
-          "exact_sentence_rate": 0.8333333333333334,
-          "character_errors": 12,
-          "reference_characters": 397,
-          "character_error_rate": 0.030226700251889168,
-          "mean_utterance_wer": 0.05555555555555555,
-          "p95_utterance_wer": 0.25,
-          "worst_utterance_wer": 0.3333333333333333
-        },
-        "narrative": {
-          "utterances": 24,
-          "semantic_errors": 4,
-          "semantic_words": 352,
-          "semantic_wer": 0.011363636363636364,
-          "failed_utterances": 3,
-          "sentence_error_rate": 0.125,
-          "exact_sentence_rate": 0.875,
-          "character_errors": 10,
-          "reference_characters": 1762,
-          "character_error_rate": 0.0056753688989784334,
-          "mean_utterance_wer": 0.009852296181630547,
-          "p95_utterance_wer": 0.05789473684210525,
-          "worst_utterance_wer": 0.125
-        },
-        "numbers": {
-          "utterances": 6,
-          "semantic_errors": 6,
-          "semantic_words": 64,
-          "semantic_wer": 0.09375,
-          "failed_utterances": 3,
-          "sentence_error_rate": 0.5,
-          "exact_sentence_rate": 0.5,
-          "character_errors": 5,
-          "reference_characters": 322,
-          "character_error_rate": 0.015527950310559006,
-          "mean_utterance_wer": 0.11098484848484848,
-          "p95_utterance_wer": 0.33125,
-          "worst_utterance_wer": 0.375
-        },
-        "punctuation": {
-          "utterances": 6,
-          "semantic_errors": 0,
-          "semantic_words": 65,
-          "semantic_wer": 0.0,
-          "failed_utterances": 0,
-          "sentence_error_rate": 0.0,
-          "exact_sentence_rate": 1.0,
-          "character_errors": 0,
-          "reference_characters": 402,
-          "character_error_rate": 0.0,
-          "mean_utterance_wer": 0.0,
-          "p95_utterance_wer": 0.0,
-          "worst_utterance_wer": 0.0
-        },
-        "question": {
-          "utterances": 15,
-          "semantic_errors": 0,
-          "semantic_words": 165,
-          "semantic_wer": 0.0,
-          "failed_utterances": 0,
-          "sentence_error_rate": 0.0,
-          "exact_sentence_rate": 1.0,
-          "character_errors": 0,
-          "reference_characters": 834,
-          "character_error_rate": 0.0,
-          "mean_utterance_wer": 0.0,
-          "p95_utterance_wer": 0.0,
-          "worst_utterance_wer": 0.0
-        },
-        "rare_words": {
-          "utterances": 6,
-          "semantic_errors": 2,
-          "semantic_words": 57,
-          "semantic_wer": 0.03508771929824561,
-          "failed_utterances": 1,
-          "sentence_error_rate": 0.16666666666666666,
-          "exact_sentence_rate": 0.8333333333333334,
-          "character_errors": 1,
-          "reference_characters": 500,
-          "character_error_rate": 0.002,
-          "mean_utterance_wer": 0.030303030303030304,
-          "p95_utterance_wer": 0.13636363636363635,
-          "worst_utterance_wer": 0.18181818181818182
-        },
-        "short": {
-          "utterances": 24,
-          "semantic_errors": 2,
-          "semantic_words": 105,
-          "semantic_wer": 0.01904761904761905,
-          "failed_utterances": 2,
-          "sentence_error_rate": 0.08333333333333333,
-          "exact_sentence_rate": 0.9166666666666666,
-          "character_errors": 3,
-          "reference_characters": 458,
-          "character_error_rate": 0.006550218340611353,
-          "mean_utterance_wer": 0.01875,
-          "p95_utterance_wer": 0.1699999999999996,
-          "worst_utterance_wer": 0.25
-        },
-        "technical": {
-          "utterances": 21,
-          "semantic_errors": 5,
-          "semantic_words": 256,
-          "semantic_wer": 0.01953125,
-          "failed_utterances": 2,
-          "sentence_error_rate": 0.09523809523809523,
-          "exact_sentence_rate": 0.9047619047619048,
-          "character_errors": 3,
-          "reference_characters": 1497,
-          "character_error_rate": 0.002004008016032064,
-          "mean_utterance_wer": 0.019727891156462583,
-          "p95_utterance_wer": 0.2,
-          "worst_utterance_wer": 0.21428571428571427
-        }
-      }
-    },
-    "piper-ryan-low": {
-      "overall": {
-        "utterances": 200,
-        "semantic_errors": 32,
-        "semantic_words": 2608,
-        "semantic_wer": 0.012269938650306749,
-        "failed_utterances": 19,
-        "sentence_error_rate": 0.095,
-        "exact_sentence_rate": 0.905,
-        "character_errors": 67,
-        "reference_characters": 13718,
-        "character_error_rate": 0.00488409389123779,
-        "mean_utterance_wer": 0.01766635309135309,
-        "p95_utterance_wer": 0.11464646464646343,
-        "worst_utterance_wer": 0.6
-      },
-      "categories": {
-        "conversational": {
-          "utterances": 25,
-          "semantic_errors": 2,
-          "semantic_words": 309,
-          "semantic_wer": 0.006472491909385114,
-          "failed_utterances": 1,
-          "sentence_error_rate": 0.04,
-          "exact_sentence_rate": 0.96,
-          "character_errors": 5,
-          "reference_characters": 1501,
-          "character_error_rate": 0.0033311125916055963,
-          "mean_utterance_wer": 0.008,
-          "p95_utterance_wer": 0.0,
-          "worst_utterance_wer": 0.2
-        },
-        "descriptive": {
-          "utterances": 16,
-          "semantic_errors": 2,
-          "semantic_words": 226,
-          "semantic_wer": 0.008849557522123894,
-          "failed_utterances": 2,
-          "sentence_error_rate": 0.125,
-          "exact_sentence_rate": 0.875,
-          "character_errors": 5,
-          "reference_characters": 1146,
-          "character_error_rate": 0.004363001745200698,
-          "mean_utterance_wer": 0.008630952380952382,
-          "p95_utterance_wer": 0.06785714285714287,
-          "worst_utterance_wer": 0.07142857142857142
-        },
-        "emotional": {
-          "utterances": 24,
-          "semantic_errors": 0,
-          "semantic_words": 329,
-          "semantic_wer": 0.0,
-          "failed_utterances": 0,
-          "sentence_error_rate": 0.0,
-          "exact_sentence_rate": 1.0,
-          "character_errors": 0,
-          "reference_characters": 1574,
-          "character_error_rate": 0.0,
-          "mean_utterance_wer": 0.0,
-          "p95_utterance_wer": 0.0,
-          "worst_utterance_wer": 0.0
-        },
-        "homographs": {
-          "utterances": 6,
-          "semantic_errors": 1,
-          "semantic_words": 70,
-          "semantic_wer": 0.014285714285714285,
-          "failed_utterances": 1,
-          "sentence_error_rate": 0.16666666666666666,
-          "exact_sentence_rate": 0.8333333333333334,
-          "character_errors": 1,
-          "reference_characters": 375,
-          "character_error_rate": 0.0026666666666666666,
-          "mean_utterance_wer": 0.016666666666666666,
-          "p95_utterance_wer": 0.07500000000000001,
-          "worst_utterance_wer": 0.1
-        },
-        "long": {
-          "utterances": 15,
-          "semantic_errors": 2,
-          "semantic_words": 432,
-          "semantic_wer": 0.004629629629629629,
-          "failed_utterances": 2,
-          "sentence_error_rate": 0.13333333333333333,
-          "exact_sentence_rate": 0.8666666666666667,
-          "character_errors": 9,
-          "reference_characters": 2206,
-          "character_error_rate": 0.004079782411604714,
-          "mean_utterance_wer": 0.0052307692307692315,
-          "p95_utterance_wer": 0.03892307692307692,
-          "worst_utterance_wer": 0.04
-        },
-        "long_range": {
-          "utterances": 6,
-          "semantic_errors": 0,
-          "semantic_words": 121,
-          "semantic_wer": 0.0,
-          "failed_utterances": 0,
-          "sentence_error_rate": 0.0,
-          "exact_sentence_rate": 1.0,
-          "character_errors": 0,
-          "reference_characters": 744,
-          "character_error_rate": 0.0,
-          "mean_utterance_wer": 0.0,
-          "p95_utterance_wer": 0.0,
-          "worst_utterance_wer": 0.0
-        },
-        "names_places": {
-          "utterances": 6,
-          "semantic_errors": 4,
-          "semantic_words": 57,
-          "semantic_wer": 0.07017543859649122,
-          "failed_utterances": 2,
-          "sentence_error_rate": 0.3333333333333333,
-          "exact_sentence_rate": 0.6666666666666667,
-          "character_errors": 19,
-          "reference_characters": 397,
-          "character_error_rate": 0.04785894206549118,
-          "mean_utterance_wer": 0.07407407407407407,
-          "p95_utterance_wer": 0.2777777777777778,
-          "worst_utterance_wer": 0.3333333333333333
-        },
-        "narrative": {
-          "utterances": 24,
-          "semantic_errors": 0,
-          "semantic_words": 352,
-          "semantic_wer": 0.0,
-          "failed_utterances": 0,
-          "sentence_error_rate": 0.0,
-          "exact_sentence_rate": 1.0,
-          "character_errors": 0,
-          "reference_characters": 1762,
-          "character_error_rate": 0.0,
-          "mean_utterance_wer": 0.0,
-          "p95_utterance_wer": 0.0,
-          "worst_utterance_wer": 0.0
-        },
-        "numbers": {
-          "utterances": 6,
-          "semantic_errors": 5,
-          "semantic_words": 64,
-          "semantic_wer": 0.078125,
-          "failed_utterances": 2,
-          "sentence_error_rate": 0.3333333333333333,
-          "exact_sentence_rate": 0.6666666666666667,
-          "character_errors": 3,
-          "reference_characters": 322,
-          "character_error_rate": 0.009316770186335404,
-          "mean_utterance_wer": 0.09583333333333333,
-          "p95_utterance_wer": 0.33125,
-          "worst_utterance_wer": 0.375
-        },
-        "punctuation": {
-          "utterances": 6,
-          "semantic_errors": 0,
-          "semantic_words": 65,
-          "semantic_wer": 0.0,
-          "failed_utterances": 0,
-          "sentence_error_rate": 0.0,
-          "exact_sentence_rate": 1.0,
-          "character_errors": 0,
-          "reference_characters": 402,
-          "character_error_rate": 0.0,
-          "mean_utterance_wer": 0.0,
-          "p95_utterance_wer": 0.0,
-          "worst_utterance_wer": 0.0
-        },
-        "question": {
-          "utterances": 15,
-          "semantic_errors": 0,
-          "semantic_words": 165,
-          "semantic_wer": 0.0,
-          "failed_utterances": 0,
-          "sentence_error_rate": 0.0,
-          "exact_sentence_rate": 1.0,
-          "character_errors": 0,
-          "reference_characters": 834,
-          "character_error_rate": 0.0,
-          "mean_utterance_wer": 0.0,
-          "p95_utterance_wer": 0.0,
-          "worst_utterance_wer": 0.0
-        },
-        "rare_words": {
-          "utterances": 6,
-          "semantic_errors": 5,
-          "semantic_words": 57,
-          "semantic_wer": 0.08771929824561403,
-          "failed_utterances": 3,
-          "sentence_error_rate": 0.5,
-          "exact_sentence_rate": 0.5,
-          "character_errors": 9,
-          "reference_characters": 500,
-          "character_error_rate": 0.018,
-          "mean_utterance_wer": 0.0803030303030303,
-          "p95_utterance_wer": 0.1954545454545455,
-          "worst_utterance_wer": 0.2
-        },
-        "short": {
-          "utterances": 24,
-          "semantic_errors": 4,
-          "semantic_words": 105,
-          "semantic_wer": 0.0380952380952381,
-          "failed_utterances": 2,
-          "sentence_error_rate": 0.08333333333333333,
-          "exact_sentence_rate": 0.9166666666666666,
-          "character_errors": 10,
-          "reference_characters": 458,
-          "character_error_rate": 0.021834061135371178,
-          "mean_utterance_wer": 0.03888888888888889,
-          "p95_utterance_wer": 0.2833333333333326,
-          "worst_utterance_wer": 0.6
-        },
-        "technical": {
-          "utterances": 21,
-          "semantic_errors": 7,
-          "semantic_words": 256,
-          "semantic_wer": 0.02734375,
-          "failed_utterances": 4,
-          "sentence_error_rate": 0.19047619047619047,
-          "exact_sentence_rate": 0.8095238095238095,
-          "character_errors": 6,
-          "reference_characters": 1497,
-          "character_error_rate": 0.004008016032064128,
-          "mean_utterance_wer": 0.027719899148470575,
-          "p95_utterance_wer": 0.2,
-          "worst_utterance_wer": 0.21428571428571427
-        }
-      }
-    }
-  }
-}

evaluation/final/evidence-summary.json

@@ -0,0 +1,1990 @@
+{
+  "format": "inflect_v2_release_evidence_v1",
+  "systems": {
+    "inflect-micro-v2": {
+      "label": "Inflect-Micro-v2",
+      "weight_mb": 37.529995,
+      "semantic_wer": {
+        "wer": 0.019293218720152817,
+        "ci": [
+          0.014622733476311172,
+          0.024179280518969924
+        ],
+        "categories": {
+          "conversational": {
+            "raw": {
+              "utterances": 25,
+              "errors": 0,
+              "words": 296,
+              "wer": 0.0
+            },
+            "semantic": {
+              "utterances": 25,
+              "errors": 0,
+              "words": 309,
+              "wer": 0.0
+            }
+          },
+          "descriptive": {
+            "raw": {
+              "utterances": 16,
+              "errors": 2,
+              "words": 217,
+              "wer": 0.009216589861751152
+            },
+            "semantic": {
+              "utterances": 16,
+              "errors": 1,
+              "words": 226,
+              "wer": 0.004424778761061947
+            }
+          },
+          "emotional": {
+            "raw": {
+              "utterances": 24,
+              "errors": 0,
+              "words": 314,
+              "wer": 0.0
+            },
+            "semantic": {
+              "utterances": 24,
+              "errors": 0,
+              "words": 329,
+              "wer": 0.0
+            }
+          },
+          "homographs": {
+            "raw": {
+              "utterances": 6,
+              "errors": 2,
+              "words": 70,
+              "wer": 0.02857142857142857
+            },
+            "semantic": {
+              "utterances": 6,
+              "errors": 2,
+              "words": 70,
+              "wer": 0.02857142857142857
+            }
+          },
+          "long": {
+            "raw": {
+              "utterances": 15,
+              "errors": 3,
+              "words": 412,
+              "wer": 0.007281553398058253
+            },
+            "semantic": {
+              "utterances": 15,
+              "errors": 3,
+              "words": 432,
+              "wer": 0.006944444444444444
+            }
+          },
+          "long_range": {
+            "raw": {
+              "utterances": 6,
+              "errors": 0,
+              "words": 121,
+              "wer": 0.0
+            },
+            "semantic": {
+              "utterances": 6,
+              "errors": 0,
+              "words": 121,
+              "wer": 0.0
+            }
+          },
+          "names_places": {
+            "raw": {
+              "utterances": 6,
+              "errors": 4,
+              "words": 57,
+              "wer": 0.07017543859649122
+            },
+            "semantic": {
+              "utterances": 6,
+              "errors": 4,
+              "words": 57,
+              "wer": 0.07017543859649122
+            }
+          },
+          "narrative": {
+            "raw": {
+              "utterances": 24,
+              "errors": 2,
+              "words": 342,
+              "wer": 0.005847953216374269
+            },
+            "semantic": {
+              "utterances": 24,
+              "errors": 1,
+              "words": 352,
+              "wer": 0.002840909090909091
+            }
+          },
+          "numbers": {
+            "raw": {
+              "utterances": 6,
+              "errors": 33,
+              "words": 81,
+              "wer": 0.4074074074074074
+            },
+            "semantic": {
+              "utterances": 6,
+              "errors": 8,
+              "words": 64,
+              "wer": 0.125
+            }
+          },
+          "phonetic_balance": {
+            "raw": {
+              "utterances": 300,
+              "errors": 82,
+              "words": 2605,
+              "wer": 0.03147792706333973
+            },
+            "semantic": {
+              "utterances": 300,
+              "errors": 68,
+              "words": 2627,
+              "wer": 0.02588503996954701
+            }
+          },
+          "punctuation": {
+            "raw": {
+              "utterances": 6,
+              "errors": 0,
+              "words": 65,
+              "wer": 0.0
+            },
+            "semantic": {
+              "utterances": 6,
+              "errors": 0,
+              "words": 65,
+              "wer": 0.0
+            }
+          },
+          "question": {
+            "raw": {
+              "utterances": 15,
+              "errors": 0,
+              "words": 163,
+              "wer": 0.0
+            },
+            "semantic": {
+              "utterances": 15,
+              "errors": 0,
+              "words": 165,
+              "wer": 0.0
+            }
+          },
+          "rare_words": {
+            "raw": {
+              "utterances": 6,
+              "errors": 3,
+              "words": 57,
+              "wer": 0.05263157894736842
+            },
+            "semantic": {
+              "utterances": 6,
+              "errors": 3,
+              "words": 57,
+              "wer": 0.05263157894736842
+            }
+          },
+          "short": {
+            "raw": {
+              "utterances": 24,
+              "errors": 3,
+              "words": 98,
+              "wer": 0.030612244897959183
+            },
+            "semantic": {
+              "utterances": 24,
+              "errors": 3,
+              "words": 105,
+              "wer": 0.02857142857142857
+            }
+          },
+          "technical": {
+            "raw": {
+              "utterances": 21,
+              "errors": 12,
+              "words": 251,
+              "wer": 0.04780876494023904
+            },
+            "semantic": {
+              "utterances": 21,
+              "errors": 8,
+              "words": 256,
+              "wer": 0.03125
+            }
+          }
+        }
+      },
+      "utmos22": {
+        "mean": 4.395012595653534,
+        "ci": [
+          4.3812509111166,
+          4.4079569326162344
+        ]
+      }
+    },
+    "inflect-nano-v2": {
+      "label": "Inflect-Nano-v2",
+      "weight_mb": 15.971083,
+      "semantic_wer": {
+        "wer": 0.024832855778414518,
+        "ci": [
+          0.019525267993874426,
+          0.030727866333781446
+        ],
+        "categories": {
+          "conversational": {
+            "raw": {
+              "utterances": 25,
+              "errors": 5,
+              "words": 296,
+              "wer": 0.016891891891891893
+            },
+            "semantic": {
+              "utterances": 25,
+              "errors": 3,
+              "words": 309,
+              "wer": 0.009708737864077669
+            }
+          },
+          "descriptive": {
+            "raw": {
+              "utterances": 16,
+              "errors": 2,
+              "words": 217,
+              "wer": 0.009216589861751152
+            },
+            "semantic": {
+              "utterances": 16,
+              "errors": 1,
+              "words": 226,
+              "wer": 0.004424778761061947
+            }
+          },
+          "emotional": {
+            "raw": {
+              "utterances": 24,
+              "errors": 1,
+              "words": 314,
+              "wer": 0.0031847133757961785
+            },
+            "semantic": {
+              "utterances": 24,
+              "errors": 1,
+              "words": 329,
+              "wer": 0.00303951367781155
+            }
+          },
+          "homographs": {
+            "raw": {
+              "utterances": 6,
+              "errors": 3,
+              "words": 70,
+              "wer": 0.04285714285714286
+            },
+            "semantic": {
+              "utterances": 6,
+              "errors": 3,
+              "words": 70,
+              "wer": 0.04285714285714286
+            }
+          },
+          "long": {
+            "raw": {
+              "utterances": 15,
+              "errors": 3,
+              "words": 412,
+              "wer": 0.007281553398058253
+            },
+            "semantic": {
+              "utterances": 15,
+              "errors": 3,
+              "words": 432,
+              "wer": 0.006944444444444444
+            }
+          },
+          "long_range": {
+            "raw": {
+              "utterances": 6,
+              "errors": 1,
+              "words": 121,
+              "wer": 0.008264462809917356
+            },
+            "semantic": {
+              "utterances": 6,
+              "errors": 1,
+              "words": 121,
+              "wer": 0.008264462809917356
+            }
+          },
+          "names_places": {
+            "raw": {
+              "utterances": 6,
+              "errors": 3,
+              "words": 57,
+              "wer": 0.05263157894736842
+            },
+            "semantic": {
+              "utterances": 6,
+              "errors": 3,
+              "words": 57,
+              "wer": 0.05263157894736842
+            }
+          },
+          "narrative": {
+            "raw": {
+              "utterances": 24,
+              "errors": 5,
+              "words": 342,
+              "wer": 0.014619883040935672
+            },
+            "semantic": {
+              "utterances": 24,
+              "errors": 4,
+              "words": 352,
+              "wer": 0.011363636363636364
+            }
+          },
+          "numbers": {
+            "raw": {
+              "utterances": 6,
+              "errors": 33,
+              "words": 81,
+              "wer": 0.4074074074074074
+            },
+            "semantic": {
+              "utterances": 6,
+              "errors": 6,
+              "words": 64,
+              "wer": 0.09375
+            }
+          },
+          "phonetic_balance": {
+            "raw": {
+              "utterances": 300,
+              "errors": 96,
+              "words": 2605,
+              "wer": 0.03685220729366603
+            },
+            "semantic": {
+              "utterances": 300,
+              "errors": 83,
+              "words": 2627,
+              "wer": 0.031594975256947086
+            }
+          },
+          "punctuation": {
+            "raw": {
+              "utterances": 6,
+              "errors": 0,
+              "words": 65,
+              "wer": 0.0
+            },
+            "semantic": {
+              "utterances": 6,
+              "errors": 0,
+              "words": 65,
+              "wer": 0.0
+            }
+          },
+          "question": {
+            "raw": {
+              "utterances": 15,
+              "errors": 1,
+              "words": 163,
+              "wer": 0.006134969325153374
+            },
+            "semantic": {
+              "utterances": 15,
+              "errors": 1,
+              "words": 165,
+              "wer": 0.006060606060606061
+            }
+          },
+          "rare_words": {
+            "raw": {
+              "utterances": 6,
+              "errors": 5,
+              "words": 57,
+              "wer": 0.08771929824561403
+            },
+            "semantic": {
+              "utterances": 6,
+              "errors": 5,
+              "words": 57,
+              "wer": 0.08771929824561403
+            }
+          },
+          "short": {
+            "raw": {
+              "utterances": 24,
+              "errors": 8,
+              "words": 98,
+              "wer": 0.08163265306122448
+            },
+            "semantic": {
+              "utterances": 24,
+              "errors": 8,
+              "words": 105,
+              "wer": 0.0761904761904762
+            }
+          },
+          "technical": {
+            "raw": {
+              "utterances": 21,
+              "errors": 12,
+              "words": 251,
+              "wer": 0.04780876494023904
+            },
+            "semantic": {
+              "utterances": 21,
+              "errors": 8,
+              "words": 256,
+              "wer": 0.03125
+            }
+          }
+        }
+      },
+      "utmos22": {
+        "mean": 4.3861008615493775,
+        "ci": [
+          4.372184220826625,
+          4.3987462292552
+        ]
+      }
+    },
+    "kitten-nano-bruno": {
+      "label": "KittenTTS Nano \u00b7 Bruno",
+      "weight_mb": 56.767095,
+      "semantic_wer": {
+        "wer": 0.009742120343839542,
+        "ci": [
+          0.006622516556291391,
+          0.013268998793727383
+        ],
+        "categories": {
+          "conversational": {
+            "raw": {
+              "utterances": 25,
+              "errors": 0,
+              "words": 296,
+              "wer": 0.0
+            },
+            "semantic": {
+              "utterances": 25,
+              "errors": 0,
+              "words": 309,
+              "wer": 0.0
+            }
+          },
+          "descriptive": {
+            "raw": {
+              "utterances": 16,
+              "errors": 1,
+              "words": 217,
+              "wer": 0.004608294930875576
+            },
+            "semantic": {
+              "utterances": 16,
+              "errors": 0,
+              "words": 226,
+              "wer": 0.0
+            }
+          },
+          "emotional": {
+            "raw": {
+              "utterances": 24,
+              "errors": 0,
+              "words": 314,
+              "wer": 0.0
+            },
+            "semantic": {
+              "utterances": 24,
+              "errors": 0,
+              "words": 329,
+              "wer": 0.0
+            }
+          },
+          "homographs": {
+            "raw": {
+              "utterances": 6,
+              "errors": 1,
+              "words": 70,
+              "wer": 0.014285714285714285
+            },
+            "semantic": {
+              "utterances": 6,
+              "errors": 1,
+              "words": 70,
+              "wer": 0.014285714285714285
+            }
+          },
+          "long": {
+            "raw": {
+              "utterances": 15,
+              "errors": 2,
+              "words": 412,
+              "wer": 0.0048543689320388345
+            },
+            "semantic": {
+              "utterances": 15,
+              "errors": 2,
+              "words": 432,
+              "wer": 0.004629629629629629
+            }
+          },
+          "long_range": {
+            "raw": {
+              "utterances": 6,
+              "errors": 0,
+              "words": 121,
+              "wer": 0.0
+            },
+            "semantic": {
+              "utterances": 6,
+              "errors": 0,
+              "words": 121,
+              "wer": 0.0
+            }
+          },
+          "names_places": {
+            "raw": {
+              "utterances": 6,
+              "errors": 2,
+              "words": 57,
+              "wer": 0.03508771929824561
+            },
+            "semantic": {
+              "utterances": 6,
+              "errors": 2,
+              "words": 57,
+              "wer": 0.03508771929824561
+            }
+          },
+          "narrative": {
+            "raw": {
+              "utterances": 24,
+              "errors": 3,
+              "words": 342,
+              "wer": 0.008771929824561403
+            },
+            "semantic": {
+              "utterances": 24,
+              "errors": 2,
+              "words": 352,
+              "wer": 0.005681818181818182
+            }
+          },
+          "numbers": {
+            "raw": {
+              "utterances": 6,
+              "errors": 32,
+              "words": 81,
+              "wer": 0.3950617283950617
+            },
+            "semantic": {
+              "utterances": 6,
+              "errors": 5,
+              "words": 64,
+              "wer": 0.078125
+            }
+          },
+          "phonetic_balance": {
+            "raw": {
+              "utterances": 300,
+              "errors": 39,
+              "words": 2605,
+              "wer": 0.014971209213051824
+            },
+            "semantic": {
+              "utterances": 300,
+              "errors": 30,
+              "words": 2627,
+              "wer": 0.011419870574800152
+            }
+          },
+          "punctuation": {
+            "raw": {
+              "utterances": 6,
+              "errors": 0,
+              "words": 65,
+              "wer": 0.0
+            },
+            "semantic": {
+              "utterances": 6,
+              "errors": 0,
+              "words": 65,
+              "wer": 0.0
+            }
+          },
+          "question": {
+            "raw": {
+              "utterances": 15,
+              "errors": 0,
+              "words": 163,
+              "wer": 0.0
+            },
+            "semantic": {
+              "utterances": 15,
+              "errors": 0,
+              "words": 165,
+              "wer": 0.0
+            }
+          },
+          "rare_words": {
+            "raw": {
+              "utterances": 6,
+              "errors": 2,
+              "words": 57,
+              "wer": 0.03508771929824561
+            },
+            "semantic": {
+              "utterances": 6,
+              "errors": 2,
+              "words": 57,
+              "wer": 0.03508771929824561
+            }
+          },
+          "short": {
+            "raw": {
+              "utterances": 24,
+              "errors": 2,
+              "words": 98,
+              "wer": 0.02040816326530612
+            },
+            "semantic": {
+              "utterances": 24,
+              "errors": 2,
+              "words": 105,
+              "wer": 0.01904761904761905
+            }
+          },
+          "technical": {
+            "raw": {
+              "utterances": 21,
+              "errors": 9,
+              "words": 251,
+              "wer": 0.035856573705179286
+            },
+            "semantic": {
+              "utterances": 21,
+              "errors": 5,
+              "words": 256,
+              "wer": 0.01953125
+            }
+          }
+        }
+      },
+      "utmos22": {
+        "mean": 4.21684304523468,
+        "ci": [
+          4.193502563333512,
+          4.239324071252346
+        ]
+      }
+    },
+    "kitten-nano-hugo": {
+      "label": "KittenTTS Nano \u00b7 Hugo",
+      "weight_mb": 56.767095,
+      "semantic_wer": {
+        "wer": 0.011461318051575931,
+        "ci": [
+          0.007995319812792511,
+          0.01523625843780135
+        ],
+        "categories": {
+          "conversational": {
+            "raw": {
+              "utterances": 25,
+              "errors": 1,
+              "words": 296,
+              "wer": 0.0033783783783783786
+            },
+            "semantic": {
+              "utterances": 25,
+              "errors": 1,
+              "words": 309,
+              "wer": 0.003236245954692557
+            }
+          },
+          "descriptive": {
+            "raw": {
+              "utterances": 16,
+              "errors": 1,
+              "words": 217,
+              "wer": 0.004608294930875576
+            },
+            "semantic": {
+              "utterances": 16,
+              "errors": 0,
+              "words": 226,
+              "wer": 0.0
+            }
+          },
+          "emotional": {
+            "raw": {
+              "utterances": 24,
+              "errors": 0,
+              "words": 314,
+              "wer": 0.0
+            },
+            "semantic": {
+              "utterances": 24,
+              "errors": 0,
+              "words": 329,
+              "wer": 0.0
+            }
+          },
+          "homographs": {
+            "raw": {
+              "utterances": 6,
+              "errors": 1,
+              "words": 70,
+              "wer": 0.014285714285714285
+            },
+            "semantic": {
+              "utterances": 6,
+              "errors": 1,
+              "words": 70,
+              "wer": 0.014285714285714285
+            }
+          },
+          "long": {
+            "raw": {
+              "utterances": 15,
+              "errors": 3,
+              "words": 412,
+              "wer": 0.007281553398058253
+            },
+            "semantic": {
+              "utterances": 15,
+              "errors": 3,
+              "words": 432,
+              "wer": 0.006944444444444444
+            }
+          },
+          "long_range": {
+            "raw": {
+              "utterances": 6,
+              "errors": 0,
+              "words": 121,
+              "wer": 0.0
+            },
+            "semantic": {
+              "utterances": 6,
+              "errors": 0,
+              "words": 121,
+              "wer": 0.0
+            }
+          },
+          "names_places": {
+            "raw": {
+              "utterances": 6,
+              "errors": 2,
+              "words": 57,
+              "wer": 0.03508771929824561
+            },
+            "semantic": {
+              "utterances": 6,
+              "errors": 2,
+              "words": 57,
+              "wer": 0.03508771929824561
+            }
+          },
+          "narrative": {
+            "raw": {
+              "utterances": 24,
+              "errors": 6,
+              "words": 342,
+              "wer": 0.017543859649122806
+            },
+            "semantic": {
+              "utterances": 24,
+              "errors": 5,
+              "words": 352,
+              "wer": 0.014204545454545454
+            }
+          },
+          "numbers": {
+            "raw": {
+              "utterances": 6,
+              "errors": 32,
+              "words": 81,
+              "wer": 0.3950617283950617
+            },
+            "semantic": {
+              "utterances": 6,
+              "errors": 5,
+              "words": 64,
+              "wer": 0.078125
+            }
+          },
+          "phonetic_balance": {
+            "raw": {
+              "utterances": 300,
+              "errors": 39,
+              "words": 2605,
+              "wer": 0.014971209213051824
+            },
+            "semantic": {
+              "utterances": 300,
+              "errors": 30,
+              "words": 2627,
+              "wer": 0.011419870574800152
+            }
+          },
+          "punctuation": {
+            "raw": {
+              "utterances": 6,
+              "errors": 0,
+              "words": 65,
+              "wer": 0.0
+            },
+            "semantic": {
+              "utterances": 6,
+              "errors": 0,
+              "words": 65,
+              "wer": 0.0
+            }
+          },
+          "question": {
+            "raw": {
+              "utterances": 15,
+              "errors": 0,
+              "words": 163,
+              "wer": 0.0
+            },
+            "semantic": {
+              "utterances": 15,
+              "errors": 0,
+              "words": 165,
+              "wer": 0.0
+            }
+          },
+          "rare_words": {
+            "raw": {
+              "utterances": 6,
+              "errors": 3,
+              "words": 57,
+              "wer": 0.05263157894736842
+            },
+            "semantic": {
+              "utterances": 6,
+              "errors": 3,
+              "words": 57,
+              "wer": 0.05263157894736842
+            }
+          },
+          "short": {
+            "raw": {
+              "utterances": 24,
+              "errors": 4,
+              "words": 98,
+              "wer": 0.04081632653061224
+            },
+            "semantic": {
+              "utterances": 24,
+              "errors": 4,
+              "words": 105,
+              "wer": 0.0380952380952381
+            }
+          },
+          "technical": {
+            "raw": {
+              "utterances": 21,
+              "errors": 12,
+              "words": 251,
+              "wer": 0.04780876494023904
+            },
+            "semantic": {
+              "utterances": 21,
+              "errors": 6,
+              "words": 256,
+              "wer": 0.0234375
+            }
+          }
+        }
+      },
+      "utmos22": {
+        "mean": 4.191078673839569,
+        "ci": [
+          4.168552933418751,
+          4.212353882300854
+        ]
+      }
+    },
+    "piper-ryan-low": {
+      "label": "Piper \u00b7 Ryan Low",
+      "weight_mb": 63.104526,
+      "semantic_wer": {
+        "wer": 0.023304680038204392,
+        "ci": [
+          0.018028169014084508,
+          0.02901655306718598
+        ],
+        "categories": {
+          "conversational": {
+            "raw": {
+              "utterances": 25,
+              "errors": 8,
+              "words": 296,
+              "wer": 0.02702702702702703
+            },
+            "semantic": {
+              "utterances": 25,
+              "errors": 5,
+              "words": 309,
+              "wer": 0.016181229773462782
+            }
+          },
+          "descriptive": {
+            "raw": {
+              "utterances": 16,
+              "errors": 3,
+              "words": 217,
+              "wer": 0.013824884792626729
+            },
+            "semantic": {
+              "utterances": 16,
+              "errors": 1,
+              "words": 226,
+              "wer": 0.004424778761061947
+            }
+          },
+          "emotional": {
+            "raw": {
+              "utterances": 24,
+              "errors": 1,
+              "words": 314,
+              "wer": 0.0031847133757961785
+            },
+            "semantic": {
+              "utterances": 24,
+              "errors": 1,
+              "words": 329,
+              "wer": 0.00303951367781155
+            }
+          },
+          "homographs": {
+            "raw": {
+              "utterances": 6,
+              "errors": 1,
+              "words": 70,
+              "wer": 0.014285714285714285
+            },
+            "semantic": {
+              "utterances": 6,
+              "errors": 1,
+              "words": 70,
+              "wer": 0.014285714285714285
+            }
+          },
+          "long": {
+            "raw": {
+              "utterances": 15,
+              "errors": 3,
+              "words": 412,
+              "wer": 0.007281553398058253
+            },
+            "semantic": {
+              "utterances": 15,
+              "errors": 3,
+              "words": 432,
+              "wer": 0.006944444444444444
+            }
+          },
+          "long_range": {
+            "raw": {
+              "utterances": 6,
+              "errors": 1,
+              "words": 121,
+              "wer": 0.008264462809917356
+            },
+            "semantic": {
+              "utterances": 6,
+              "errors": 1,
+              "words": 121,
+              "wer": 0.008264462809917356
+            }
+          },
+          "names_places": {
+            "raw": {
+              "utterances": 6,
+              "errors": 2,
+              "words": 57,
+              "wer": 0.03508771929824561
+            },
+            "semantic": {
+              "utterances": 6,
+              "errors": 2,
+              "words": 57,
+              "wer": 0.03508771929824561
+            }
+          },
+          "narrative": {
+            "raw": {
+              "utterances": 24,
+              "errors": 1,
+              "words": 342,
+              "wer": 0.0029239766081871343
+            },
+            "semantic": {
+              "utterances": 24,
+              "errors": 0,
+              "words": 352,
+              "wer": 0.0
+            }
+          },
+          "numbers": {
+            "raw": {
+              "utterances": 6,
+              "errors": 32,
+              "words": 81,
+              "wer": 0.3950617283950617
+            },
+            "semantic": {
+              "utterances": 6,
+              "errors": 6,
+              "words": 64,
+              "wer": 0.09375
+            }
+          },
+          "phonetic_balance": {
+            "raw": {
+              "utterances": 300,
+              "errors": 94,
+              "words": 2605,
+              "wer": 0.03608445297504798
+            },
+            "semantic": {
+              "utterances": 300,
+              "errors": 83,
+              "words": 2627,
+              "wer": 0.031594975256947086
+            }
+          },
+          "punctuation": {
+            "raw": {
+              "utterances": 6,
+              "errors": 1,
+              "words": 65,
+              "wer": 0.015384615384615385
+            },
+            "semantic": {
+              "utterances": 6,
+              "errors": 1,
+              "words": 65,
+              "wer": 0.015384615384615385
+            }
+          },
+          "question": {
+            "raw": {
+              "utterances": 15,
+              "errors": 0,
+              "words": 163,
+              "wer": 0.0
+            },
+            "semantic": {
+              "utterances": 15,
+              "errors": 0,
+              "words": 165,
+              "wer": 0.0
+            }
+          },
+          "rare_words": {
+            "raw": {
+              "utterances": 6,
+              "errors": 4,
+              "words": 57,
+              "wer": 0.07017543859649122
+            },
+            "semantic": {
+              "utterances": 6,
+              "errors": 4,
+              "words": 57,
+              "wer": 0.07017543859649122
+            }
+          },
+          "short": {
+            "raw": {
+              "utterances": 24,
+              "errors": 7,
+              "words": 98,
+              "wer": 0.07142857142857142
+            },
+            "semantic": {
+              "utterances": 24,
+              "errors": 8,
+              "words": 105,
+              "wer": 0.0761904761904762
+            }
+          },
+          "technical": {
+            "raw": {
+              "utterances": 21,
+              "errors": 10,
+              "words": 251,
+              "wer": 0.0398406374501992
+            },
+            "semantic": {
+              "utterances": 21,
+              "errors": 6,
+              "words": 256,
+              "wer": 0.0234375
+            }
+          }
+        }
+      },
+      "utmos22": {
+        "mean": 4.289378658294678,
+        "ci": [
+          4.271461564397812,
+          4.306235534155369
+        ]
+      }
+    },
+    "piper-danny-low": {
+      "label": "Piper \u00b7 Danny Low",
+      "weight_mb": 63.104526,
+      "semantic_wer": {
+        "wer": 0.018147086914995225,
+        "ci": [
+          0.013549618320610687,
+          0.022975077881619937
+        ],
+        "categories": {
+          "conversational": {
+            "raw": {
+              "utterances": 25,
+              "errors": 2,
+              "words": 296,
+              "wer": 0.006756756756756757
+            },
+            "semantic": {
+              "utterances": 25,
+              "errors": 2,
+              "words": 309,
+              "wer": 0.006472491909385114
+            }
+          },
+          "descriptive": {
+            "raw": {
+              "utterances": 16,
+              "errors": 2,
+              "words": 217,
+              "wer": 0.009216589861751152
+            },
+            "semantic": {
+              "utterances": 16,
+              "errors": 1,
+              "words": 226,
+              "wer": 0.004424778761061947
+            }
+          },
+          "emotional": {
+            "raw": {
+              "utterances": 24,
+              "errors": 1,
+              "words": 314,
+              "wer": 0.0031847133757961785
+            },
+            "semantic": {
+              "utterances": 24,
+              "errors": 1,
+              "words": 329,
+              "wer": 0.00303951367781155
+            }
+          },
+          "homographs": {
+            "raw": {
+              "utterances": 6,
+              "errors": 1,
+              "words": 70,
+              "wer": 0.014285714285714285
+            },
+            "semantic": {
+              "utterances": 6,
+              "errors": 1,
+              "words": 70,
+              "wer": 0.014285714285714285
+            }
+          },
+          "long": {
+            "raw": {
+              "utterances": 15,
+              "errors": 7,
+              "words": 412,
+              "wer": 0.01699029126213592
+            },
+            "semantic": {
+              "utterances": 15,
+              "errors": 7,
+              "words": 432,
+              "wer": 0.016203703703703703
+            }
+          },
+          "long_range": {
+            "raw": {
+              "utterances": 6,
+              "errors": 0,
+              "words": 121,
+              "wer": 0.0
+            },
+            "semantic": {
+              "utterances": 6,
+              "errors": 0,
+              "words": 121,
+              "wer": 0.0
+            }
+          },
+          "names_places": {
+            "raw": {
+              "utterances": 6,
+              "errors": 3,
+              "words": 57,
+              "wer": 0.05263157894736842
+            },
+            "semantic": {
+              "utterances": 6,
+              "errors": 3,
+              "words": 57,
+              "wer": 0.05263157894736842
+            }
+          },
+          "narrative": {
+            "raw": {
+              "utterances": 24,
+              "errors": 1,
+              "words": 342,
+              "wer": 0.0029239766081871343
+            },
+            "semantic": {
+              "utterances": 24,
+              "errors": 0,
+              "words": 352,
+              "wer": 0.0
+            }
+          },
+          "numbers": {
+            "raw": {
+              "utterances": 6,
+              "errors": 33,
+              "words": 81,
+              "wer": 0.4074074074074074
+            },
+            "semantic": {
+              "utterances": 6,
+              "errors": 7,
+              "words": 64,
+              "wer": 0.109375
+            }
+          },
+          "phonetic_balance": {
+            "raw": {
+              "utterances": 300,
+              "errors": 73,
+              "words": 2605,
+              "wer": 0.02802303262955854
+            },
+            "semantic": {
+              "utterances": 300,
+              "errors": 61,
+              "words": 2627,
+              "wer": 0.02322040350209364
+            }
+          },
+          "punctuation": {
+            "raw": {
+              "utterances": 6,
+              "errors": 0,
+              "words": 65,
+              "wer": 0.0
+            },
+            "semantic": {
+              "utterances": 6,
+              "errors": 0,
+              "words": 65,
+              "wer": 0.0
+            }
+          },
+          "question": {
+            "raw": {
+              "utterances": 15,
+              "errors": 2,
+              "words": 163,
+              "wer": 0.012269938650306749
+            },
+            "semantic": {
+              "utterances": 15,
+              "errors": 2,
+              "words": 165,
+              "wer": 0.012121212121212121
+            }
+          },
+          "rare_words": {
+            "raw": {
+              "utterances": 6,
+              "errors": 2,
+              "words": 57,
+              "wer": 0.03508771929824561
+            },
+            "semantic": {
+              "utterances": 6,
+              "errors": 2,
+              "words": 57,
+              "wer": 0.03508771929824561
+            }
+          },
+          "short": {
+            "raw": {
+              "utterances": 24,
+              "errors": 3,
+              "words": 98,
+              "wer": 0.030612244897959183
+            },
+            "semantic": {
+              "utterances": 24,
+              "errors": 3,
+              "words": 105,
+              "wer": 0.02857142857142857
+            }
+          },
+          "technical": {
+            "raw": {
+              "utterances": 21,
+              "errors": 9,
+              "words": 251,
+              "wer": 0.035856573705179286
+            },
+            "semantic": {
+              "utterances": 21,
+              "errors": 5,
+              "words": 256,
+              "wer": 0.01953125
+            }
+          }
+        }
+      },
+      "utmos22": {
+        "mean": 4.194989757061005,
+        "ci": [
+          4.179823832964897,
+          4.20924334000349
+        ]
+      }
+    },
+    "supertonic3-james-3step": {
+      "label": "Supertonic 3 \u00b7 James \u00b7 3-step",
+      "weight_mb": 398.075273,
+      "semantic_wer": {
+        "wer": 6.928175740210124,
+        "ci": [
+          5.861435406698565,
+          8.043254987161761
+        ],
+        "categories": {
+          "conversational": {
+            "raw": {
+              "utterances": 25,
+              "errors": 1295,
+              "words": 296,
+              "wer": 4.375
+            },
+            "semantic": {
+              "utterances": 25,
+              "errors": 1449,
+              "words": 309,
+              "wer": 4.689320388349515
+            }
+          },
+          "descriptive": {
+            "raw": {
+              "utterances": 16,
+              "errors": 902,
+              "words": 217,
+              "wer": 4.15668202764977
+            },
+            "semantic": {
+              "utterances": 16,
+              "errors": 998,
+              "words": 226,
+              "wer": 4.415929203539823
+            }
+          },
+          "emotional": {
+            "raw": {
+              "utterances": 24,
+              "errors": 2189,
+              "words": 314,
+              "wer": 6.971337579617835
+            },
+            "semantic": {
+              "utterances": 24,
+              "errors": 2306,
+              "words": 329,
+              "wer": 7.009118541033435
+            }
+          },
+          "homographs": {
+            "raw": {
+              "utterances": 6,
+              "errors": 70,
+              "words": 70,
+              "wer": 1.0
+            },
+            "semantic": {
+              "utterances": 6,
+              "errors": 73,
+              "words": 70,
+              "wer": 1.042857142857143
+            }
+          },
+          "long": {
+            "raw": {
+              "utterances": 15,
+              "errors": 1113,
+              "words": 412,
+              "wer": 2.7014563106796117
+            },
+            "semantic": {
+              "utterances": 15,
+              "errors": 1190,
+              "words": 432,
+              "wer": 2.7546296296296298
+            }
+          },
+          "long_range": {
+            "raw": {
+              "utterances": 6,
+              "errors": 153,
+              "words": 121,
+              "wer": 1.2644628099173554
+            },
+            "semantic": {
+              "utterances": 6,
+              "errors": 159,
+              "words": 121,
+              "wer": 1.3140495867768596
+            }
+          },
+          "names_places": {
+            "raw": {
+              "utterances": 6,
+              "errors": 666,
+              "words": 57,
+              "wer": 11.68421052631579
+            },
+            "semantic": {
+              "utterances": 6,
+              "errors": 828,
+              "words": 57,
+              "wer": 14.526315789473685
+            }
+          },
+          "narrative": {
+            "raw": {
+              "utterances": 24,
+              "errors": 2415,
+              "words": 342,
+              "wer": 7.06140350877193
+            },
+            "semantic": {
+              "utterances": 24,
+              "errors": 2562,
+              "words": 352,
+              "wer": 7.278409090909091
+            }
+          },
+          "numbers": {
+            "raw": {
+              "utterances": 6,
+              "errors": 94,
+              "words": 81,
+              "wer": 1.1604938271604939
+            },
+            "semantic": {
+              "utterances": 6,
+              "errors": 91,
+              "words": 64,
+              "wer": 1.421875
+            }
+          },
+          "phonetic_balance": {
+            "raw": {
+              "utterances": 300,
+              "errors": 19668,
+              "words": 2605,
+              "wer": 7.550095969289827
+            },
+            "semantic": {
+              "utterances": 300,
+              "errors": 21028,
+              "words": 2627,
+              "wer": 8.00456794822992
+            }
+          },
+          "punctuation": {
+            "raw": {
+              "utterances": 6,
+              "errors": 803,
+              "words": 65,
+              "wer": 12.353846153846154
+            },
+            "semantic": {
+              "utterances": 6,
+              "errors": 807,
+              "words": 65,
+              "wer": 12.415384615384616
+            }
+          },
+          "question": {
+            "raw": {
+              "utterances": 15,
+              "errors": 1412,
+              "words": 163,
+              "wer": 8.662576687116564
+            },
+            "semantic": {
+              "utterances": 15,
+              "errors": 1529,
+              "words": 165,
+              "wer": 9.266666666666667
+            }
+          },
+          "rare_words": {
+            "raw": {
+              "utterances": 6,
+              "errors": 819,
+              "words": 57,
+              "wer": 14.368421052631579
+            },
+            "semantic": {
+              "utterances": 6,
+              "errors": 820,
+              "words": 57,
+              "wer": 14.385964912280702
+            }
+          },
+          "short": {
+            "raw": {
+              "utterances": 24,
+              "errors": 436,
+              "words": 98,
+              "wer": 4.448979591836735
+            },
+            "semantic": {
+              "utterances": 24,
+              "errors": 447,
+              "words": 105,
+              "wer": 4.257142857142857
+            }
+          },
+          "technical": {
+            "raw": {
+              "utterances": 21,
+              "errors": 1976,
+              "words": 251,
+              "wer": 7.872509960159363
+            },
+            "semantic": {
+              "utterances": 21,
+              "errors": 1982,
+              "words": 256,
+              "wer": 7.7421875
+            }
+          }
+        }
+      },
+      "utmos22": {
+        "mean": 2.4712263617515564,
+        "ci": [
+          2.412739716243744,
+          2.5290928330957887
+        ]
+      }
+    },
+    "supertonic3-james-8step": {
+      "label": "Supertonic 3 \u00b7 James \u00b7 8-step",
+      "weight_mb": 398.075273,
+      "semantic_wer": {
+        "wer": 6.225214899713467,
+        "ci": [
+          5.2127497621313035,
+          7.2831739961759085
+        ],
+        "categories": {
+          "conversational": {
+            "raw": {
+              "utterances": 25,
+              "errors": 1746,
+              "words": 296,
+              "wer": 5.898648648648648
+            },
+            "semantic": {
+              "utterances": 25,
+              "errors": 1812,
+              "words": 309,
+              "wer": 5.864077669902913
+            }
+          },
+          "descriptive": {
+            "raw": {
+              "utterances": 16,
+              "errors": 1230,
+              "words": 217,
+              "wer": 5.668202764976958
+            },
+            "semantic": {
+              "utterances": 16,
+              "errors": 1234,
+              "words": 226,
+              "wer": 5.460176991150442
+            }
+          },
+          "emotional": {
+            "raw": {
+              "utterances": 24,
+              "errors": 1592,
+              "words": 314,
+              "wer": 5.070063694267516
+            },
+            "semantic": {
+              "utterances": 24,
+              "errors": 1670,
+              "words": 329,
+              "wer": 5.075987841945289
+            }
+          },
+          "homographs": {
+            "raw": {
+              "utterances": 6,
+              "errors": 326,
+              "words": 70,
+              "wer": 4.6571428571428575
+            },
+            "semantic": {
+              "utterances": 6,
+              "errors": 413,
+              "words": 70,
+              "wer": 5.9
+            }
+          },
+          "long": {
+            "raw": {
+              "utterances": 15,
+              "errors": 1459,
+              "words": 412,
+              "wer": 3.54126213592233
+            },
+            "semantic": {
+              "utterances": 15,
+              "errors": 1468,
+              "words": 432,
+              "wer": 3.3981481481481484
+            }
+          },
+          "long_range": {
+            "raw": {
+              "utterances": 6,
+              "errors": 113,
+              "words": 121,
+              "wer": 0.9338842975206612
+            },
+            "semantic": {
+              "utterances": 6,
+              "errors": 113,
+              "words": 121,
+              "wer": 0.9338842975206612
+            }
+          },
+          "names_places": {
+            "raw": {
+              "utterances": 6,
+              "errors": 381,
+              "words": 57,
+              "wer": 6.684210526315789
+            },
+            "semantic": {
+              "utterances": 6,
+              "errors": 476,
+              "words": 57,
+              "wer": 8.350877192982455
+            }
+          },
+          "narrative": {
+            "raw": {
+              "utterances": 24,
+              "errors": 1338,
+              "words": 342,
+              "wer": 3.912280701754386
+            },
+            "semantic": {
+              "utterances": 24,
+              "errors": 1344,
+              "words": 352,
+              "wer": 3.8181818181818183
+            }
+          },
+          "numbers": {
+            "raw": {
+              "utterances": 6,
+              "errors": 90,
+              "words": 81,
+              "wer": 1.1111111111111112
+            },
+            "semantic": {
+              "utterances": 6,
+              "errors": 87,
+              "words": 64,
+              "wer": 1.359375
+            }
+          },
+          "phonetic_balance": {
+            "raw": {
+              "utterances": 300,
+              "errors": 18274,
+              "words": 2605,
+              "wer": 7.014971209213051
+            },
+            "semantic": {
+              "utterances": 300,
+              "errors": 19044,
+              "words": 2627,
+              "wer": 7.2493338408831365
+            }
+          },
+          "punctuation": {
+            "raw": {
+              "utterances": 6,
+              "errors": 361,
+              "words": 65,
+              "wer": 5.553846153846154
+            },
+            "semantic": {
+              "utterances": 6,
+              "errors": 438,
+              "words": 65,
+              "wer": 6.7384615384615385
+            }
+          },
+          "question": {
+            "raw": {
+              "utterances": 15,
+              "errors": 1153,
+              "words": 163,
+              "wer": 7.07361963190184
+            },
+            "semantic": {
+              "utterances": 15,
+              "errors": 1267,
+              "words": 165,
+              "wer": 7.678787878787879
+            }
+          },
+          "rare_words": {
+            "raw": {
+              "utterances": 6,
+              "errors": 438,
+              "words": 57,
+              "wer": 7.684210526315789
+            },
+            "semantic": {
+              "utterances": 6,
+              "errors": 444,
+              "words": 57,
+              "wer": 7.7894736842105265
+            }
+          },
+          "short": {
+            "raw": {
+              "utterances": 24,
+              "errors": 1005,
+              "words": 98,
+              "wer": 10.255102040816327
+            },
+            "semantic": {
+              "utterances": 24,
+              "errors": 1057,
+              "words": 105,
+              "wer": 10.066666666666666
+            }
+          },
+          "technical": {
+            "raw": {
+              "utterances": 21,
+              "errors": 1585,
+              "words": 251,
+              "wer": 6.314741035856573
+            },
+            "semantic": {
+              "utterances": 21,
+              "errors": 1722,
+              "words": 256,
+              "wer": 6.7265625
+            }
+          }
+        }
+      },
+      "utmos22": {
+        "mean": 4.29470673418045,
+        "ci": [
+          4.281224336981774,
+          4.307890736854076
+        ]
+      }
+    }
+  },
+  "asr_robustness": {
+    "inflect-micro-v2": {
+      "whisper-large-v3": {
+        "wer": 0.019293218720152817,
+        "ci": [
+          0.014622733476311172,
+          0.024179280518969924
+        ]
+      },
+      "wav2vec2-large-lv60k-960h": {
+        "wer": 0.048137535816618914,
+        "ci": [
+          0.03997704667176741,
+          0.05712124077926991
+        ]
+      }
+    },
+    "inflect-nano-v2": {
+      "whisper-large-v3": {
+        "wer": 0.024832855778414518,
+        "ci": [
+          0.019525267993874426,
+          0.030727866333781446
+        ]
+      },
+      "wav2vec2-large-lv60k-960h": {
+        "wer": 0.05673352435530086,
+        "ci": [
+          0.04819277108433735,
+          0.06602129719264278
+        ]
+      }
+    },
+    "kitten-nano-bruno": {
+      "whisper-large-v3": {
+        "wer": 0.009742120343839542,
+        "ci": [
+          0.006622516556291391,
+          0.013268998793727383
+        ]
+      },
+      "wav2vec2-large-lv60k-960h": {
+        "wer": 0.03553008595988539,
+        "ci": [
+          0.028724626579854463,
+          0.04309006211180124
+        ]
+      }
+    },
+    "kitten-nano-hugo": {
+      "whisper-large-v3": {
+        "wer": 0.011461318051575931,
+        "ci": [
+          0.007995319812792511,
+          0.01523625843780135
+        ]
+      },
+      "wav2vec2-large-lv60k-960h": {
+        "wer": 0.03629417382999045,
+        "ci": [
+          0.029451395572666024,
+          0.043798449612403104
+        ]
+      }
+    },
+    "piper-ryan-low": {
+      "whisper-large-v3": {
+        "wer": 0.023304680038204392,
+        "ci": [
+          0.018028169014084508,
+          0.02901655306718598
+        ]
+      },
+      "wav2vec2-large-lv60k-960h": {
+        "wer": 0.0670487106017192,
+        "ci": [
+          0.05838601710673113,
+          0.07638619620007756
+        ]
+      }
+    },
+    "piper-danny-low": {
+      "whisper-large-v3": {
+        "wer": 0.018147086914995225,
+        "ci": [
+          0.013549618320610687,
+          0.022975077881619937
+        ]
+      },
+      "wav2vec2-large-lv60k-960h": {
+        "wer": 0.053104106972301814,
+        "ci": [
+          0.04440632742519535,
+          0.06227176628867961
+        ]
+      }
+    },
+    "supertonic3-james-3step": {
+      "whisper-large-v3": {
+        "wer": 6.928175740210124,
+        "ci": [
+          5.861435406698565,
+          8.043254987161761
+        ]
+      },
+      "wav2vec2-large-lv60k-960h": {
+        "wer": 0.1346704871060172,
+        "ci": [
+          0.11719324026451139,
+          0.15343099460292983
+        ]
+      }
+    },
+    "supertonic3-james-8step": {
+      "whisper-large-v3": {
+        "wer": 6.225214899713467,
+        "ci": [
+          5.2127497621313035,
+          7.2831739961759085
+        ]
+      },
+      "wav2vec2-large-lv60k-960h": {
+        "wer": 0.037631327602674305,
+        "ci": [
+          0.030763314747164008,
+          0.044854881266490766
+        ]
+      }
+    }
+  },
+  "family_averages": {
+    "kitten": {
+      "semantic_wer": 0.010601719197707736,
+      "utmos22": 4.2039608595371245
+    },
+    "piper": {
+      "semantic_wer": 0.02072588347659981,
+      "utmos22": 4.242184207677841
+    }
+  },
+  "notes": [
+    "Family averages are equal-weight macro averages over the two named voices.",
+    "Supertonic 3-step and 8-step remain separate.",
+    "UTMOS22 and WER are not combined into one score."
+  ]
+}

evaluation/final/raw/combined_manifest_validation.json

@@ -0,0 +1,33 @@
+{
+  "format": "inflect_tts_matched_manifest_validation_v1",
+  "systems": {
+    "inflect-micro-v2": 500,
+    "inflect-nano-v2": 500,
+    "kitten-nano-bruno": 500,
+    "kitten-nano-hugo": 500,
+    "piper-danny-low": 500,
+    "piper-ryan-low": 500,
+    "supertonic3-james-3step": 500,
+    "supertonic3-james-8step": 500
+  },
+  "total_rows": 4000,
+  "unique_prompts": 500,
+  "categories": {
+    "conversational": 25,
+    "descriptive": 16,
+    "emotional": 24,
+    "homographs": 6,
+    "long": 15,
+    "long_range": 6,
+    "names_places": 6,
+    "narrative": 24,
+    "numbers": 6,
+    "phonetic_balance": 300,
+    "punctuation": 6,
+    "question": 15,
+    "rare_words": 6,
+    "short": 24,
+    "technical": 21
+  },
+  "valid": true
+}

evaluation/final/raw/prompt_report.json

@@ -0,0 +1,37 @@
+{
+  "format": "inflect_v2_final_benchmark_prompts_v1",
+  "count": 500,
+  "sha256": "5b7aa33852e6c738eb0e1dbf9fcfcc90772b97ad219167e44aaf3917d063b056",
+  "base_prompt_count": 200,
+  "cmu_arctic_prompt_count": 300,
+  "categories": {
+    "conversational": 25,
+    "descriptive": 16,
+    "emotional": 24,
+    "homographs": 6,
+    "long": 15,
+    "long_range": 6,
+    "names_places": 6,
+    "narrative": 24,
+    "numbers": 6,
+    "phonetic_balance": 300,
+    "punctuation": 6,
+    "question": 15,
+    "rare_words": 6,
+    "short": 24,
+    "technical": 21
+  },
+  "sources": {
+    "cmu_arctic": 300,
+    "ood_stress": 46,
+    "voxcpm_unrelated": 154
+  },
+  "training_exclusion_count": 87362,
+  "rejected_duplicate": 0,
+  "rejected_exact_training_match": 0,
+  "word_count": {
+    "minimum": 1,
+    "maximum": 33,
+    "mean": 10.272
+  }
+}

evaluation/final/raw/prompts.jsonl

@@ -0,0 +1,500 @@
+{"id": "release500_0001", "category": "conversational", "text": "It wasn't until later that I realized what had actually happened.", "source": "voxcpm_unrelated"}
+{"id": "release500_0002", "category": "descriptive", "text": "The light at that time of afternoon is perfect for about twenty minutes.", "source": "voxcpm_unrelated"}
+{"id": "release500_0003", "category": "emotional", "text": "That was the scariest thing I've ever done, and also maybe the best.", "source": "voxcpm_unrelated"}
+{"id": "release500_0004", "category": "homographs", "text": "After I record the record, please present the present to the bass player.", "source": "ood_stress"}
+{"id": "release500_0005", "category": "long", "text": "If I'm being completely honest, I had no idea what I was doing for most of it, and I think that might be the most normal thing about the whole experience.", "source": "voxcpm_unrelated"}
+{"id": "release500_0006", "category": "long_range", "text": "The committee postponed its decision after discovering that three pages of the report had been printed in the wrong order.", "source": "ood_stress"}
+{"id": "release500_0007", "category": "names_places", "text": "Gwendolyn photographed the eucalyptus trees outside Ljubljana.", "source": "ood_stress"}
+{"id": "release500_0008", "category": "narrative", "text": "He had this theory, and the more time passes, the more I think he was right.", "source": "voxcpm_unrelated"}
+{"id": "release500_0009", "category": "numbers", "text": "The package weighs twelve point six kilograms and arrived on July twenty-first.", "source": "ood_stress"}
+{"id": "release500_0010", "category": "punctuation", "text": "First, close the window; second, turn off the lamp; finally, lock the door.", "source": "ood_stress"}
+{"id": "release500_0011", "category": "question", "text": "When did you first realize something was wrong?", "source": "voxcpm_unrelated"}
+{"id": "release500_0012", "category": "rare_words", "text": "The archaeologist catalogued a Byzantine reliquary and several anachronistic fragments.", "source": "ood_stress"}
+{"id": "release500_0013", "category": "short", "text": "I have no idea.", "source": "voxcpm_unrelated"}
+{"id": "release500_0014", "category": "technical", "text": "The system runs on three core components that all have to stay in sync.", "source": "voxcpm_unrelated"}
+{"id": "release500_0015", "category": "conversational", "text": "We improvised the entire second half and somehow nobody noticed.", "source": "voxcpm_unrelated"}
+{"id": "release500_0016", "category": "descriptive", "text": "There's a smell in old buildings that's impossible to describe but immediately familiar.", "source": "voxcpm_unrelated"}
+{"id": "release500_0017", "category": "emotional", "text": "I specifically asked for one thing. One thing. And it still didn't happen.", "source": "voxcpm_unrelated"}
+{"id": "release500_0018", "category": "homographs", "text": "They refuse to place the refuse beside the produce aisle.", "source": "ood_stress"}
+{"id": "release500_0019", "category": "long", "text": "There were days last year when I genuinely didn't know how I was going to get through it, and somehow I did, and I still don't fully understand how.", "source": "voxcpm_unrelated"}
+{"id": "release500_0020", "category": "long_range", "text": "Before announcing the winner, the judge thanked the volunteers who had worked through the storm to repair the damaged stage.", "source": "ood_stress"}
+{"id": "release500_0021", "category": "names_places", "text": "Professor Nguyen mailed the fluorescent poster to Reykjavik on Thursday.", "source": "ood_stress"}
+{"id": "release500_0022", "category": "narrative", "text": "The plan was simple. The execution was anything but.", "source": "voxcpm_unrelated"}
+{"id": "release500_0023", "category": "numbers", "text": "Her score improved from eighty-two percent to ninety-seven percent in two weeks.", "source": "ood_stress"}
+{"id": "release500_0024", "category": "punctuation", "text": "Why would anyone pack spoons, batteries, and a violin for one short trip?", "source": "ood_stress"}
+{"id": "release500_0025", "category": "question", "text": "How long have you been sitting on this?", "source": "voxcpm_unrelated"}
+{"id": "release500_0026", "category": "rare_words", "text": "A mischievous chameleon rested beside the chrysanthemum and the bougainvillea.", "source": "ood_stress"}
+{"id": "release500_0027", "category": "short", "text": "We don't talk about that.", "source": "voxcpm_unrelated"}
+{"id": "release500_0028", "category": "technical", "text": "Hash the UTF eight payload with S H A two fifty-six before opening the checkpoint.", "source": "ood_stress"}
+{"id": "release500_0029", "category": "conversational", "text": "I thought I had it all figured out, and then this happened.", "source": "voxcpm_unrelated"}
+{"id": "release500_0030", "category": "descriptive", "text": "The kind of quiet you only get at three in the morning in a city.", "source": "voxcpm_unrelated"}
+{"id": "release500_0031", "category": "emotional", "text": "The joy of it was almost overwhelming, like too much good all at once.", "source": "voxcpm_unrelated"}
+{"id": "release500_0032", "category": "homographs", "text": "Please close the door while I stand close to the microphone.", "source": "ood_stress"}
+{"id": "release500_0033", "category": "long", "text": "I think the most underrated skill in the world is knowing when to stop explaining yourself and just let people draw their own conclusions.", "source": "voxcpm_unrelated"}
+{"id": "release500_0034", "category": "long_range", "text": "When the final bus disappeared around the corner, Nadia remembered that her umbrella, notebook, and lunch were still inside the quiet office.", "source": "ood_stress"}
+{"id": "release500_0035", "category": "names_places", "text": "Aurelia and Joaquin crossed the Schuylkill River before noon.", "source": "ood_stress"}
+{"id": "release500_0036", "category": "narrative", "text": "The village had a name, but nobody used it. Everyone just called it home.", "source": "voxcpm_unrelated"}
+{"id": "release500_0037", "category": "numbers", "text": "Increase the gain by three decibels, wait five seconds, then reduce it by one.", "source": "ood_stress"}
+{"id": "release500_0038", "category": "punctuation", "text": "The result was unexpected: clear, stable, and surprisingly natural.", "source": "ood_stress"}
+{"id": "release500_0039", "category": "question", "text": "Who told you that was the right way to do it?", "source": "voxcpm_unrelated"}
+{"id": "release500_0040", "category": "rare_words", "text": "The meticulous cartographer examined an iridescent archipelago through binoculars.", "source": "ood_stress"}
+{"id": "release500_0041", "category": "short", "text": "I mean. Yeah. Kind of.", "source": "voxcpm_unrelated"}
+{"id": "release500_0042", "category": "technical", "text": "The logs are your best friend when something behaves unexpectedly.", "source": "voxcpm_unrelated"}
+{"id": "release500_0043", "category": "conversational", "text": "He kept talking and I kept nodding and neither of us was listening.", "source": "voxcpm_unrelated"}
+{"id": "release500_0044", "category": "descriptive", "text": "It's one of those places where everyone seems to know each other already.", "source": "voxcpm_unrelated"}
+{"id": "release500_0045", "category": "emotional", "text": "He said he was proud of me and nobody had ever said that to me before.", "source": "voxcpm_unrelated"}
+{"id": "release500_0046", "category": "homographs", "text": "The minute detail took a minute to explain clearly.", "source": "ood_stress"}
+{"id": "release500_0047", "category": "long", "text": "The strange thing about really wanting something is that getting it never quite feels the way you imagined it would, and not getting it never quite feels as bad.", "source": "voxcpm_unrelated"}
+{"id": "release500_0048", "category": "long_range", "text": "Even though the recipe looked simple at first, preparing the sauce required patience, careful timing, and a much larger pan.", "source": "ood_stress"}
+{"id": "release500_0049", "category": "names_places", "text": "Xiomara met Siobhan near the old library in Worcestershire.", "source": "ood_stress"}
+{"id": "release500_0050", "category": "narrative", "text": "She walked into the room and everyone went quiet, not because she was loud, but because she wasn't.", "source": "voxcpm_unrelated"}
+{"id": "release500_0051", "category": "numbers", "text": "At exactly seven forty-five, Morgan placed eighteen dollars and fifty cents beside the notebook.", "source": "ood_stress"}
+{"id": "release500_0052", "category": "punctuation", "text": "Does punctuation work? Yes: commas, semicolons, and periods should create sensible boundaries.", "source": "ood_stress"}
+{"id": "release500_0053", "category": "question", "text": "Have you ever just stopped and thought about how strange all of this is?", "source": "voxcpm_unrelated"}
+{"id": "release500_0054", "category": "rare_words", "text": "Her idiosyncratic explanation sounded plausible but remained fundamentally ambiguous.", "source": "ood_stress"}
+{"id": "release500_0055", "category": "short", "text": "That tracks.", "source": "voxcpm_unrelated"}
+{"id": "release500_0056", "category": "technical", "text": "The key thing to remember is that order matters here more than you'd think.", "source": "voxcpm_unrelated"}
+{"id": "release500_0057", "category": "conversational", "text": "I would not say that again in this room if I were you.", "source": "voxcpm_unrelated"}
+{"id": "release500_0058", "category": "descriptive", "text": "The room was filled with the quiet that means something is about to change.", "source": "voxcpm_unrelated"}
+{"id": "release500_0059", "category": "emotional", "text": "I didn't expect to feel that way about it, but I did.", "source": "voxcpm_unrelated"}
+{"id": "release500_0060", "category": "homographs", "text": "I object to the strange object that was left near the entrance.", "source": "ood_stress"}
+{"id": "release500_0061", "category": "long", "text": "I've learned more from the things that went wrong than from the things that worked, which is a frustrating way to have to learn things but apparently the only way that stuck.", "source": "voxcpm_unrelated"}
+{"id": "release500_0062", "category": "long_range", "text": "Because every nearby hotel was full, the exhausted hikers followed the narrow road until they found a farmhouse with one empty room.", "source": "ood_stress"}
+{"id": "release500_0063", "category": "names_places", "text": "The itinerary sends Beatrice from Albuquerque to Des Moines and then to Boise.", "source": "ood_stress"}
+{"id": "release500_0064", "category": "narrative", "text": "We had been driving for six hours when we finally saw the sign for the town.", "source": "voxcpm_unrelated"}
+{"id": "release500_0065", "category": "numbers", "text": "Call extension zero four nine after eight thirty in the morning.", "source": "ood_stress"}
+{"id": "release500_0066", "category": "punctuation", "text": "Stop - listen carefully - then answer the question without guessing.", "source": "ood_stress"}
+{"id": "release500_0067", "category": "question", "text": "Does it matter at this point, honestly?", "source": "voxcpm_unrelated"}
+{"id": "release500_0068", "category": "rare_words", "text": "An entrepreneurial meteorologist described the unprecedented atmospheric phenomenon.", "source": "ood_stress"}
+{"id": "release500_0069", "category": "short", "text": "That's not what I expected.", "source": "voxcpm_unrelated"}
+{"id": "release500_0070", "category": "technical", "text": "There's a known issue with that version that causes failures under load.", "source": "voxcpm_unrelated"}
+{"id": "release500_0071", "category": "conversational", "text": "Don't look now but I think that's him over there.", "source": "voxcpm_unrelated"}
+{"id": "release500_0072", "category": "descriptive", "text": "The city at night looks completely different from how it feels during the day.", "source": "voxcpm_unrelated"}
+{"id": "release500_0073", "category": "emotional", "text": "It's the kind of happy that makes you nervous because you know it can't last.", "source": "voxcpm_unrelated"}
+{"id": "release500_0074", "category": "homographs", "text": "The dove dove beneath the branch while the wind began to wind the loose cable.", "source": "ood_stress"}
+{"id": "release500_0075", "category": "long", "text": "I've thought a lot about what I would do differently if I could go back, and the honest answer is probably not as much as I'd like to think.", "source": "voxcpm_unrelated"}
+{"id": "release500_0076", "category": "long_range", "text": "Although the weather changed without warning, the musicians finished packing before anyone opened the enormous glass door.", "source": "ood_stress"}
+{"id": "release500_0077", "category": "names_places", "text": "Saskatchewan looked unusually bright beneath the pale February sunrise.", "source": "ood_stress"}
+{"id": "release500_0078", "category": "narrative", "text": "She handled it with a grace I genuinely did not expect.", "source": "voxcpm_unrelated"}
+{"id": "release500_0079", "category": "numbers", "text": "Apartment four hundred seven is across from room twenty-nine on the third floor.", "source": "ood_stress"}
+{"id": "release500_0080", "category": "punctuation", "text": "\"Not yet,\" Rowan whispered. \"Give me another minute... please.\"", "source": "ood_stress"}
+{"id": "release500_0081", "category": "question", "text": "What are we actually trying to accomplish here?", "source": "voxcpm_unrelated"}
+{"id": "release500_0082", "category": "rare_words", "text": "The physician recommended a noninvasive procedure for the recurring neurological symptoms.", "source": "ood_stress"}
+{"id": "release500_0083", "category": "short", "text": "Are you serious right now?", "source": "voxcpm_unrelated"}
+{"id": "release500_0084", "category": "technical", "text": "The performance improvement is real, but it comes with tradeoffs.", "source": "voxcpm_unrelated"}
+{"id": "release500_0085", "category": "conversational", "text": "I don't know. It's just been one of those weeks, you know?", "source": "voxcpm_unrelated"}
+{"id": "release500_0086", "category": "descriptive", "text": "The moment you stop expecting perfection, things get a lot more interesting.", "source": "voxcpm_unrelated"}
+{"id": "release500_0087", "category": "emotional", "text": "It's the kind of thing that stays with you even years later.", "source": "voxcpm_unrelated"}
+{"id": "release500_0088", "category": "long", "text": "She told me once that the most important skill she'd developed was learning to disagree with someone without making them feel they were wrong.", "source": "voxcpm_unrelated"}
+{"id": "release500_0089", "category": "narrative", "text": "He stood at the edge of the cliff and wondered, not for the first time, how he'd gotten here.", "source": "voxcpm_unrelated"}
+{"id": "release500_0090", "category": "question", "text": "Why does asking for help feel so hard when you actually need it?", "source": "voxcpm_unrelated"}
+{"id": "release500_0091", "category": "short", "text": "That's fair.", "source": "voxcpm_unrelated"}
+{"id": "release500_0092", "category": "technical", "text": "If you run into that error, the fix is usually just restarting the service.", "source": "voxcpm_unrelated"}
+{"id": "release500_0093", "category": "conversational", "text": "It was a disaster in the best possible way.", "source": "voxcpm_unrelated"}
+{"id": "release500_0094", "category": "descriptive", "text": "It had the look of a place that used to mean something to someone.", "source": "voxcpm_unrelated"}
+{"id": "release500_0095", "category": "emotional", "text": "There's this feeling you get when something finally works after weeks of failure.", "source": "voxcpm_unrelated"}
+{"id": "release500_0096", "category": "long", "text": "He had a theory that most arguments aren't actually about what they seem to be about, and the longer I live the more I think he was onto something.", "source": "voxcpm_unrelated"}
+{"id": "release500_0097", "category": "narrative", "text": "The thing nobody tells you about starting over is how ordinary most of it feels.", "source": "voxcpm_unrelated"}
+{"id": "release500_0098", "category": "question", "text": "What exactly are we waiting for at this point?", "source": "voxcpm_unrelated"}
+{"id": "release500_0099", "category": "short", "text": "I stand by what I said.", "source": "voxcpm_unrelated"}
+{"id": "release500_0100", "category": "technical", "text": "Double-check that value before you push anything to production.", "source": "voxcpm_unrelated"}
+{"id": "release500_0101", "category": "conversational", "text": "I understand your point; I just do not agree with the conclusion.", "source": "ood_stress"}
+{"id": "release500_0102", "category": "descriptive", "text": "The sky that day was a strange shade of orange I'd never seen before.", "source": "voxcpm_unrelated"}
+{"id": "release500_0103", "category": "emotional", "text": "It hurt more than I expected, and I thought I was prepared.", "source": "voxcpm_unrelated"}
+{"id": "release500_0104", "category": "long", "text": "The hardest part wasn't making the decision, it was sitting with the uncertainty of not knowing whether it was the right one for months afterward.", "source": "voxcpm_unrelated"}
+{"id": "release500_0105", "category": "narrative", "text": "There was this one day last summer when everything just clicked into place.", "source": "voxcpm_unrelated"}
+{"id": "release500_0106", "category": "question", "text": "Have you ever thought about why we keep doing things the same way when they stop working?", "source": "voxcpm_unrelated"}
+{"id": "release500_0107", "category": "short", "text": "I can't believe you just said that.", "source": "voxcpm_unrelated"}
+{"id": "release500_0108", "category": "technical", "text": "You'll want to isolate that variable before drawing any conclusions.", "source": "voxcpm_unrelated"}
+{"id": "release500_0109", "category": "conversational", "text": "The meeting that could have been an email lasted two hours.", "source": "voxcpm_unrelated"}
+{"id": "release500_0110", "category": "descriptive", "text": "There's a specific kind of tired that sleep doesn't fix.", "source": "voxcpm_unrelated"}
+{"id": "release500_0111", "category": "emotional", "text": "Something about that moment broke something open in me that I hadn't realized was closed.", "source": "voxcpm_unrelated"}
+{"id": "release500_0112", "category": "long", "text": "The thing about making something good is that you don't usually know it's good while you're making it. You just know you're not done yet.", "source": "voxcpm_unrelated"}
+{"id": "release500_0113", "category": "narrative", "text": "She opened the door slowly, as if she expected to find something she wasn't ready for.", "source": "voxcpm_unrelated"}
+{"id": "release500_0114", "category": "question", "text": "What would you do differently if you could go back?", "source": "voxcpm_unrelated"}
+{"id": "release500_0115", "category": "short", "text": "Okay. Okay okay okay.", "source": "voxcpm_unrelated"}
+{"id": "release500_0116", "category": "technical", "text": "The latency goes up significantly at scale, which is expected.", "source": "voxcpm_unrelated"}
+{"id": "release500_0117", "category": "conversational", "text": "We ended up staying until two in the morning talking about nothing.", "source": "voxcpm_unrelated"}
+{"id": "release500_0118", "category": "descriptive", "text": "The rain started slowly, and then all at once, the way it usually does.", "source": "voxcpm_unrelated"}
+{"id": "release500_0119", "category": "emotional", "text": "I honestly did not think I was going to make it through that year.", "source": "voxcpm_unrelated"}
+{"id": "release500_0120", "category": "long", "text": "There's an assumption that people who seem confident all the time actually feel confident, and in my experience that's almost never true.", "source": "voxcpm_unrelated"}
+{"id": "release500_0121", "category": "narrative", "text": "The moment I opened the door I knew something was different, even if I couldn't say what.", "source": "voxcpm_unrelated"}
+{"id": "release500_0122", "category": "question", "text": "How do you explain something that doesn't make sense even to you?", "source": "voxcpm_unrelated"}
+{"id": "release500_0123", "category": "short", "text": "Hold on a second.", "source": "voxcpm_unrelated"}
+{"id": "release500_0124", "category": "technical", "text": "A deterministic split prevents duplicate normalized text from leaking into evaluation.", "source": "ood_stress"}
+{"id": "release500_0125", "category": "conversational", "text": "Honestly, that was much better than I expected, but the ending still felt rushed.", "source": "ood_stress"}
+{"id": "release500_0126", "category": "descriptive", "text": "She had a habit of tilting her head slightly when thinking hard about something.", "source": "voxcpm_unrelated"}
+{"id": "release500_0127", "category": "emotional", "text": "I cannot stress enough how much I did not want to be right about this.", "source": "voxcpm_unrelated"}
+{"id": "release500_0128", "category": "long", "text": "I used to think the goal was to get to a point where nothing was hard anymore, and now I think that point doesn't exist and I'm not sure I'd want it to.", "source": "voxcpm_unrelated"}
+{"id": "release500_0129", "category": "narrative", "text": "So this is the part of the story where everything goes completely sideways.", "source": "voxcpm_unrelated"}
+{"id": "release500_0130", "category": "question", "text": "Is there a version of this where it actually works out okay?", "source": "voxcpm_unrelated"}
+{"id": "release500_0131", "category": "short", "text": "Oh no. Oh no no no.", "source": "voxcpm_unrelated"}
+{"id": "release500_0132", "category": "technical", "text": "Always test on a copy before modifying the original.", "source": "voxcpm_unrelated"}
+{"id": "release500_0133", "category": "conversational", "text": "I wasn't even supposed to be there. That's the wild part.", "source": "voxcpm_unrelated"}
+{"id": "release500_0134", "category": "descriptive", "text": "It's a small town. Not the kind you leave. The kind you leave and come back to.", "source": "voxcpm_unrelated"}
+{"id": "release500_0135", "category": "emotional", "text": "She cried. I cried. We all just sort of stood there crying.", "source": "voxcpm_unrelated"}
+{"id": "release500_0136", "category": "long", "text": "There's a version of being busy that's actually just a very elaborate way of avoiding the one thing you know you should be doing.", "source": "voxcpm_unrelated"}
+{"id": "release500_0137", "category": "narrative", "text": "The letter arrived on a Tuesday, which felt appropriate somehow.", "source": "voxcpm_unrelated"}
+{"id": "release500_0138", "category": "question", "text": "What exactly did she say when you told her?", "source": "voxcpm_unrelated"}
+{"id": "release500_0139", "category": "short", "text": "No way. Absolutely not.", "source": "voxcpm_unrelated"}
+{"id": "release500_0140", "category": "technical", "text": "The first thing you want to do is make sure everything is backed up.", "source": "voxcpm_unrelated"}
+{"id": "release500_0141", "category": "conversational", "text": "I have the most insane idea and you need to just hear me out.", "source": "voxcpm_unrelated"}
+{"id": "release500_0142", "category": "descriptive", "text": "There's a coffee shop on the corner that's been there longer than anyone can remember.", "source": "voxcpm_unrelated"}
+{"id": "release500_0143", "category": "emotional", "text": "I kept it together until I got to the car, and then I completely fell apart.", "source": "voxcpm_unrelated"}
+{"id": "release500_0144", "category": "long", "text": "The older I get, the more I think that most of what we call wisdom is just pattern recognition built from having been wrong enough times to start noticing.", "source": "voxcpm_unrelated"}
+{"id": "release500_0145", "category": "narrative", "text": "I remember the exact moment I realized I had made a huge mistake.", "source": "voxcpm_unrelated"}
+{"id": "release500_0146", "category": "question", "text": "Do you think it would have gone differently if we'd left earlier?", "source": "voxcpm_unrelated"}
+{"id": "release500_0147", "category": "short", "text": "You have to be kidding me.", "source": "voxcpm_unrelated"}
+{"id": "release500_0148", "category": "technical", "text": "If the checksum fails, restart the worker process without deleting the cached tensors.", "source": "ood_stress"}
+{"id": "release500_0149", "category": "conversational", "text": "I need you to understand how close that was to not working.", "source": "voxcpm_unrelated"}
+{"id": "release500_0150", "category": "descriptive", "text": "It was the sort of morning where the whole world looks rinsed clean.", "source": "voxcpm_unrelated"}
+{"id": "release500_0151", "category": "emotional", "text": "She started laughing and I started laughing and we couldn't stop for a full minute.", "source": "voxcpm_unrelated"}
+{"id": "release500_0152", "category": "long", "text": "We spent three years building something we were genuinely proud of, and then the market shifted and none of it mattered the way we thought it would.", "source": "voxcpm_unrelated"}
+{"id": "release500_0153", "category": "narrative", "text": "And somehow, despite all of that, it actually turned out okay.", "source": "voxcpm_unrelated"}
+{"id": "release500_0154", "category": "question", "text": "Is that something you actually want, or something you think you should want?", "source": "voxcpm_unrelated"}
+{"id": "release500_0155", "category": "short", "text": "This is fine.", "source": "voxcpm_unrelated"}
+{"id": "release500_0156", "category": "technical", "text": "The tricky part isn't the setup, it's making sure all dependencies line up.", "source": "voxcpm_unrelated"}
+{"id": "release500_0157", "category": "conversational", "text": "He called it a minor setback. I called it a disaster.", "source": "voxcpm_unrelated"}
+{"id": "release500_0158", "category": "descriptive", "text": "The whole place smelled like pine and old wood and cold air.", "source": "voxcpm_unrelated"}
+{"id": "release500_0159", "category": "emotional", "text": "I've never been so relieved in my entire life.", "source": "voxcpm_unrelated"}
+{"id": "release500_0160", "category": "narrative", "text": "I wrote it all down that night so I wouldn't forget, and I still haven't looked at it.", "source": "voxcpm_unrelated"}
+{"id": "release500_0161", "category": "short", "text": "That's kind of wild actually.", "source": "voxcpm_unrelated"}
+{"id": "release500_0162", "category": "technical", "text": "Version pinning will save you a lot of pain later down the line.", "source": "voxcpm_unrelated"}
+{"id": "release500_0163", "category": "conversational", "text": "At some point you just have to commit and see what happens.", "source": "voxcpm_unrelated"}
+{"id": "release500_0164", "category": "emotional", "text": "Nobody told me it was going to be this hard, and honestly, I'm grateful.", "source": "voxcpm_unrelated"}
+{"id": "release500_0165", "category": "narrative", "text": "Chapter seven. In which everything that could go wrong did, and a few things that couldn't.", "source": "voxcpm_unrelated"}
+{"id": "release500_0166", "category": "short", "text": "Wait, what?", "source": "voxcpm_unrelated"}
+{"id": "release500_0167", "category": "technical", "text": "The graphics processor remained idle because the data loader exhausted every central processing core.", "source": "ood_stress"}
+{"id": "release500_0168", "category": "conversational", "text": "Could you speak a little more slowly? I am trying to write every detail down.", "source": "ood_stress"}
+{"id": "release500_0169", "category": "emotional", "text": "I was so excited I could barely form a complete sentence.", "source": "voxcpm_unrelated"}
+{"id": "release500_0170", "category": "narrative", "text": "He looked at me like I had said something in a language he didn't speak.", "source": "voxcpm_unrelated"}
+{"id": "release500_0171", "category": "short", "text": "That's actually hilarious.", "source": "voxcpm_unrelated"}
+{"id": "release500_0172", "category": "technical", "text": "The encoder maps phonemes, stress, and phrase boundaries into a shared hidden representation.", "source": "ood_stress"}
+{"id": "release500_0173", "category": "conversational", "text": "She showed up three hours late and acted like nothing had happened.", "source": "voxcpm_unrelated"}
+{"id": "release500_0174", "category": "emotional", "text": "Oh my god. This is the best thing I've ever tasted.", "source": "voxcpm_unrelated"}
+{"id": "release500_0175", "category": "narrative", "text": "The note was short, which was somehow more frightening than a long one would have been.", "source": "voxcpm_unrelated"}
+{"id": "release500_0176", "category": "short", "text": "Noted.", "source": "voxcpm_unrelated"}
+{"id": "release500_0177", "category": "technical", "text": "It's a simple process once you understand the underlying structure.", "source": "voxcpm_unrelated"}
+{"id": "release500_0178", "category": "conversational", "text": "You have to hear this story because it's almost too good to be true.", "source": "voxcpm_unrelated"}
+{"id": "release500_0179", "category": "emotional", "text": "I have never felt more seen in my entire life than in that moment.", "source": "voxcpm_unrelated"}
+{"id": "release500_0180", "category": "narrative", "text": "She knew. She had always known. She just waited for the right moment.", "source": "voxcpm_unrelated"}
+{"id": "release500_0181", "category": "short", "text": "Yeah, no. Hard pass.", "source": "voxcpm_unrelated"}
+{"id": "release500_0182", "category": "technical", "text": "Please verify the sample rate, hop length, and mel filter configuration before inference.", "source": "ood_stress"}
+{"id": "release500_0183", "category": "conversational", "text": "That's the worst idea I've ever heard and I'm completely in.", "source": "voxcpm_unrelated"}
+{"id": "release500_0184", "category": "emotional", "text": "I remember thinking: this is it. This is the thing I've been waiting for.", "source": "voxcpm_unrelated"}
+{"id": "release500_0185", "category": "narrative", "text": "We never talked about it again, which I think was the right call.", "source": "voxcpm_unrelated"}
+{"id": "release500_0186", "category": "short", "text": "In hindsight, obvious.", "source": "voxcpm_unrelated"}
+{"id": "release500_0187", "category": "technical", "text": "Once it's configured correctly, it basically runs itself.", "source": "voxcpm_unrelated"}
+{"id": "release500_0188", "category": "conversational", "text": "You got engaged? When? How? Tell me everything right now.", "source": "voxcpm_unrelated"}
+{"id": "release500_0189", "category": "emotional", "text": "It's hard to explain how much that moment meant to me.", "source": "voxcpm_unrelated"}
+{"id": "release500_0190", "category": "narrative", "text": "He told the story three different times that night and somehow it got better each time.", "source": "voxcpm_unrelated"}
+{"id": "release500_0191", "category": "short", "text": "Right. Moving on.", "source": "voxcpm_unrelated"}
+{"id": "release500_0192", "category": "conversational", "text": "No, I did not move your keys; check beside the small ceramic bowl.", "source": "ood_stress"}
+{"id": "release500_0193", "category": "emotional", "text": "I was devastated. I'm not going to pretend otherwise.", "source": "voxcpm_unrelated"}
+{"id": "release500_0194", "category": "narrative", "text": "That was the last summer before everything changed, though we didn't know it yet.", "source": "voxcpm_unrelated"}
+{"id": "release500_0195", "category": "short", "text": "Bold of you to assume.", "source": "voxcpm_unrelated"}
+{"id": "release500_0196", "category": "conversational", "text": "It's one of those decisions that makes total sense in the moment.", "source": "voxcpm_unrelated"}
+{"id": "release500_0197", "category": "emotional", "text": "I was furious. Not the loud kind. The quiet kind that lasts for days.", "source": "voxcpm_unrelated"}
+{"id": "release500_0198", "category": "narrative", "text": "That's the part of the story I usually leave out.", "source": "voxcpm_unrelated"}
+{"id": "release500_0199", "category": "short", "text": "I've said too much.", "source": "voxcpm_unrelated"}
+{"id": "release500_0200", "category": "conversational", "text": "I've been faking that I understood this the entire time.", "source": "voxcpm_unrelated"}
+{"id": "release500_0201", "category": "phonetic_balance", "text": "Peace be unto you and grace before the Lord.", "source": "cmu_arctic"}
+{"id": "release500_0202", "category": "phonetic_balance", "text": "From now on we're pals.", "source": "cmu_arctic"}
+{"id": "release500_0203", "category": "phonetic_balance", "text": "Here we allow our solicitors to look after our legal work.", "source": "cmu_arctic"}
+{"id": "release500_0204", "category": "phonetic_balance", "text": "Her words sent a strange chill through Philip.", "source": "cmu_arctic"}
+{"id": "release500_0205", "category": "phonetic_balance", "text": "It was introduced by Representative Dick of Ohio.", "source": "cmu_arctic"}
+{"id": "release500_0206", "category": "phonetic_balance", "text": "It's the aurora borealis.", "source": "cmu_arctic"}
+{"id": "release500_0207", "category": "phonetic_balance", "text": "The boy grew and prospered.", "source": "cmu_arctic"}
+{"id": "release500_0208", "category": "phonetic_balance", "text": "His voice was passionately rebellious.", "source": "cmu_arctic"}
+{"id": "release500_0209", "category": "phonetic_balance", "text": "That's where they cut off the Scottish Chiefs and killed all hands.", "source": "cmu_arctic"}
+{"id": "release500_0210", "category": "phonetic_balance", "text": "And Tom King patiently endured.", "source": "cmu_arctic"}
+{"id": "release500_0211", "category": "phonetic_balance", "text": "From that moment his friendship for Belize turns to hatred and jealousy.", "source": "cmu_arctic"}
+{"id": "release500_0212", "category": "phonetic_balance", "text": "Then you don't believe in altruism.", "source": "cmu_arctic"}
+{"id": "release500_0213", "category": "phonetic_balance", "text": "What Pascal glimpsed with the vision of a seer, I have lived.", "source": "cmu_arctic"}
+{"id": "release500_0214", "category": "phonetic_balance", "text": "You were making them talk shop, Ruth charged him.", "source": "cmu_arctic"}
+{"id": "release500_0215", "category": "phonetic_balance", "text": "Philip snatched at the letter which Gregson held out to him.", "source": "cmu_arctic"}
+{"id": "release500_0216", "category": "phonetic_balance", "text": "For a time the exciting thrill of his adventure was gone.", "source": "cmu_arctic"}
+{"id": "release500_0217", "category": "phonetic_balance", "text": "Obviously, it was a disease that could be contracted by contact.", "source": "cmu_arctic"}
+{"id": "release500_0218", "category": "phonetic_balance", "text": "Blind with rage, he darted in.", "source": "cmu_arctic"}
+{"id": "release500_0219", "category": "phonetic_balance", "text": "You live on an income which your father earned.", "source": "cmu_arctic"}
+{"id": "release500_0220", "category": "phonetic_balance", "text": "Something about it seemed to fascinate him, to challenge his presence.", "source": "cmu_arctic"}
+{"id": "release500_0221", "category": "phonetic_balance", "text": "Her beautiful hair was done up in shining coils.", "source": "cmu_arctic"}
+{"id": "release500_0222", "category": "phonetic_balance", "text": "It does, was her audacious answer.", "source": "cmu_arctic"}
+{"id": "release500_0223", "category": "phonetic_balance", "text": "He caught himself with a jerk.", "source": "cmu_arctic"}
+{"id": "release500_0224", "category": "phonetic_balance", "text": "He did not believe in the burning of daylight for such a luxury.", "source": "cmu_arctic"}
+{"id": "release500_0225", "category": "phonetic_balance", "text": "He had comparatively no advantages at first.", "source": "cmu_arctic"}
+{"id": "release500_0226", "category": "phonetic_balance", "text": "Such men believe, when they come together.", "source": "cmu_arctic"}
+{"id": "release500_0227", "category": "phonetic_balance", "text": "The ship should be in within a week or ten days.", "source": "cmu_arctic"}
+{"id": "release500_0228", "category": "phonetic_balance", "text": "Such a dog the wise driver kills, or turns loose.", "source": "cmu_arctic"}
+{"id": "release500_0229", "category": "phonetic_balance", "text": "You have heard always how he was the lover of the Princess Naomi.", "source": "cmu_arctic"}
+{"id": "release500_0230", "category": "phonetic_balance", "text": "I want to know how all this is possible.", "source": "cmu_arctic"}
+{"id": "release500_0231", "category": "phonetic_balance", "text": "It was my idea to a tee.", "source": "cmu_arctic"}
+{"id": "release500_0232", "category": "phonetic_balance", "text": "They likewise are disinclined to being eaten.", "source": "cmu_arctic"}
+{"id": "release500_0233", "category": "phonetic_balance", "text": "This state of mind comes of an undue prominence of the ego.", "source": "cmu_arctic"}
+{"id": "release500_0234", "category": "phonetic_balance", "text": "Then it is as I said, Womble announced with finality.", "source": "cmu_arctic"}
+{"id": "release500_0235", "category": "phonetic_balance", "text": "I can see that knife now.", "source": "cmu_arctic"}
+{"id": "release500_0236", "category": "phonetic_balance", "text": "If I meet her again I shall apologize, said Eileen.", "source": "cmu_arctic"}
+{"id": "release500_0237", "category": "phonetic_balance", "text": "A wildly exciting time was his during the week preceding Thursday the eighteenth.", "source": "cmu_arctic"}
+{"id": "release500_0238", "category": "phonetic_balance", "text": "In what bucolic school of fence he had been taught was beyond imagining.", "source": "cmu_arctic"}
+{"id": "release500_0239", "category": "phonetic_balance", "text": "So she said, the irate skipper dashed on.", "source": "cmu_arctic"}
+{"id": "release500_0240", "category": "phonetic_balance", "text": "It is not an attempt to smash the market.", "source": "cmu_arctic"}
+{"id": "release500_0241", "category": "phonetic_balance", "text": "He destroyed everything that had belonged to the woman.", "source": "cmu_arctic"}
+{"id": "release500_0242", "category": "phonetic_balance", "text": "Did Thorpe go to see any one in Churchill.", "source": "cmu_arctic"}
+{"id": "release500_0243", "category": "phonetic_balance", "text": "Many other similar disconcerting omissions will be noticed in the Manuscript.", "source": "cmu_arctic"}
+{"id": "release500_0244", "category": "phonetic_balance", "text": "The ringing of the big bell aroused him.", "source": "cmu_arctic"}
+{"id": "release500_0245", "category": "phonetic_balance", "text": "A sinewy hand, dripping with water, was clutching the rail.", "source": "cmu_arctic"}
+{"id": "release500_0246", "category": "phonetic_balance", "text": "Enters now the psychology of the situation.", "source": "cmu_arctic"}
+{"id": "release500_0247", "category": "phonetic_balance", "text": "Wash your hands of me.", "source": "cmu_arctic"}
+{"id": "release500_0248", "category": "phonetic_balance", "text": "He confessed that the sketch had startled him.", "source": "cmu_arctic"}
+{"id": "release500_0249", "category": "phonetic_balance", "text": "Her face was against his breast.", "source": "cmu_arctic"}
+{"id": "release500_0250", "category": "phonetic_balance", "text": "He was a pariah; a wanderer without a friend or a home.", "source": "cmu_arctic"}
+{"id": "release500_0251", "category": "phonetic_balance", "text": "A cry of joy burst from Philip's lips.", "source": "cmu_arctic"}
+{"id": "release500_0252", "category": "phonetic_balance", "text": "And the big Persian knew of his existence before he did of hers.", "source": "cmu_arctic"}
+{"id": "release500_0253", "category": "phonetic_balance", "text": "The men stared into each other's face.", "source": "cmu_arctic"}
+{"id": "release500_0254", "category": "phonetic_balance", "text": "It is the fire, partly, she said.", "source": "cmu_arctic"}
+{"id": "release500_0255", "category": "phonetic_balance", "text": "It seemed nearer to him since he had seen and talked with Gregson.", "source": "cmu_arctic"}
+{"id": "release500_0256", "category": "phonetic_balance", "text": "Among my minor afflictions, I may mention a new and mysterious one.", "source": "cmu_arctic"}
+{"id": "release500_0257", "category": "phonetic_balance", "text": "Between him and all domestic animals there must be no hostilities.", "source": "cmu_arctic"}
+{"id": "release500_0258", "category": "phonetic_balance", "text": "With these arguments he convinced himself that he should go on alone.", "source": "cmu_arctic"}
+{"id": "release500_0259", "category": "phonetic_balance", "text": "We are consumed in our own flesh-pots.", "source": "cmu_arctic"}
+{"id": "release500_0260", "category": "phonetic_balance", "text": "Mercedes screamed, cried, laughed, and manifested the chaotic abandonment of hysteria.", "source": "cmu_arctic"}
+{"id": "release500_0261", "category": "phonetic_balance", "text": "Philip made no effort to follow.", "source": "cmu_arctic"}
+{"id": "release500_0262", "category": "phonetic_balance", "text": "She said with chattering teeth.", "source": "cmu_arctic"}
+{"id": "release500_0263", "category": "phonetic_balance", "text": "Halfway around the track one donkey got into an argument with its rider.", "source": "cmu_arctic"}
+{"id": "release500_0264", "category": "phonetic_balance", "text": "Earth and gravel seemed to fill the pan.", "source": "cmu_arctic"}
+{"id": "release500_0265", "category": "phonetic_balance", "text": "Her achievements with cocoanuts were a revelation.", "source": "cmu_arctic"}
+{"id": "release500_0266", "category": "phonetic_balance", "text": "For a full minute he crouched and listened.", "source": "cmu_arctic"}
+{"id": "release500_0267", "category": "phonetic_balance", "text": "It was edged with ice.", "source": "cmu_arctic"}
+{"id": "release500_0268", "category": "phonetic_balance", "text": "The Portuguese boy passed the Hawaiian.", "source": "cmu_arctic"}
+{"id": "release500_0269", "category": "phonetic_balance", "text": "But he did not broach it, preferring to mature it carefully.", "source": "cmu_arctic"}
+{"id": "release500_0270", "category": "phonetic_balance", "text": "Come on, Del Mar challenged.", "source": "cmu_arctic"}
+{"id": "release500_0271", "category": "phonetic_balance", "text": "For a full half minute Jeanne looked at him without speaking.", "source": "cmu_arctic"}
+{"id": "release500_0272", "category": "phonetic_balance", "text": "He bore no grudges and had few enemies.", "source": "cmu_arctic"}
+{"id": "release500_0273", "category": "phonetic_balance", "text": "I'll go over tomorrow afternoon.", "source": "cmu_arctic"}
+{"id": "release500_0274", "category": "phonetic_balance", "text": "Well, there are better men in Hawaii, that's all.", "source": "cmu_arctic"}
+{"id": "release500_0275", "category": "phonetic_balance", "text": "He was an athlete and a giant.", "source": "cmu_arctic"}
+{"id": "release500_0276", "category": "phonetic_balance", "text": "McVeigh when he returns from a trip to Honolulu.", "source": "cmu_arctic"}
+{"id": "release500_0277", "category": "phonetic_balance", "text": "You're a devil for fighting, and will surely win.", "source": "cmu_arctic"}
+{"id": "release500_0278", "category": "phonetic_balance", "text": "All an appearance can know is mirage.", "source": "cmu_arctic"}
+{"id": "release500_0279", "category": "phonetic_balance", "text": "You fired me out of your house, in short.", "source": "cmu_arctic"}
+{"id": "release500_0280", "category": "phonetic_balance", "text": "He made sure that the magazine was loaded, and resumed his paddling.", "source": "cmu_arctic"}
+{"id": "release500_0281", "category": "phonetic_balance", "text": "Change chairs, Daylight commanded.", "source": "cmu_arctic"}
+{"id": "release500_0282", "category": "phonetic_balance", "text": "By that answer my professional medical prestige stood or fell.", "source": "cmu_arctic"}
+{"id": "release500_0283", "category": "phonetic_balance", "text": "The moon had already begun its westward decline.", "source": "cmu_arctic"}
+{"id": "release500_0284", "category": "phonetic_balance", "text": "At sea, Monday, March 16, 1908.", "source": "cmu_arctic"}
+{"id": "release500_0285", "category": "phonetic_balance", "text": "And wherever I ranged, the way lay along alcohol-drenched roads.", "source": "cmu_arctic"}
+{"id": "release500_0286", "category": "phonetic_balance", "text": "The date was nearly eighteen years old.", "source": "cmu_arctic"}
+{"id": "release500_0287", "category": "phonetic_balance", "text": "Very early in my life, I separated from my mother.", "source": "cmu_arctic"}
+{"id": "release500_0288", "category": "phonetic_balance", "text": "There was pride and strength, the ring of triumph in his voice.", "source": "cmu_arctic"}
+{"id": "release500_0289", "category": "phonetic_balance", "text": "From my earliest recollection my sleep was a period of terror.", "source": "cmu_arctic"}
+{"id": "release500_0290", "category": "phonetic_balance", "text": "We'll have to watch our chances.", "source": "cmu_arctic"}
+{"id": "release500_0291", "category": "phonetic_balance", "text": "Close beside him gleamed the white fangs of the wolf-dog.", "source": "cmu_arctic"}
+{"id": "release500_0292", "category": "phonetic_balance", "text": "Would you be satisfied with that one hundredth part of me.", "source": "cmu_arctic"}
+{"id": "release500_0293", "category": "phonetic_balance", "text": "Two gigantic owls were tearing at the carcass.", "source": "cmu_arctic"}
+{"id": "release500_0294", "category": "phonetic_balance", "text": "The lush vegetation of that sheltered spot make a natural shield.", "source": "cmu_arctic"}
+{"id": "release500_0295", "category": "phonetic_balance", "text": "Below him the shadow was broken into a pool of rippling starlight.", "source": "cmu_arctic"}
+{"id": "release500_0296", "category": "phonetic_balance", "text": "Lots of men take women buggy riding.", "source": "cmu_arctic"}
+{"id": "release500_0297", "category": "phonetic_balance", "text": "But it contributed to the smash.", "source": "cmu_arctic"}
+{"id": "release500_0298", "category": "phonetic_balance", "text": "No man ate of the seal meat or the oil.", "source": "cmu_arctic"}
+{"id": "release500_0299", "category": "phonetic_balance", "text": "You're going in for grab sharing.", "source": "cmu_arctic"}
+{"id": "release500_0300", "category": "phonetic_balance", "text": "He it was that lived to found the family of the Patino.", "source": "cmu_arctic"}
+{"id": "release500_0301", "category": "phonetic_balance", "text": "For such countries nothing remained but reorganization.", "source": "cmu_arctic"}
+{"id": "release500_0302", "category": "phonetic_balance", "text": "Stand off butcher and baker and all the rest.", "source": "cmu_arctic"}
+{"id": "release500_0303", "category": "phonetic_balance", "text": "All eyes, however, were staring at him in certitude of expectancy.", "source": "cmu_arctic"}
+{"id": "release500_0304", "category": "phonetic_balance", "text": "Two days ago Jeanne learned where her father's men were hiding.", "source": "cmu_arctic"}
+{"id": "release500_0305", "category": "phonetic_balance", "text": "His previous wives had never lived long enough to bear him children.", "source": "cmu_arctic"}
+{"id": "release500_0306", "category": "phonetic_balance", "text": "But this little defect did not worry him.", "source": "cmu_arctic"}
+{"id": "release500_0307", "category": "phonetic_balance", "text": "Eli Harding asked, as Shunk started to follow.", "source": "cmu_arctic"}
+{"id": "release500_0308", "category": "phonetic_balance", "text": "And this was their sole conversation throughout the meal.", "source": "cmu_arctic"}
+{"id": "release500_0309", "category": "phonetic_balance", "text": "Then, again, Tudor had such an irritating way about him.", "source": "cmu_arctic"}
+{"id": "release500_0310", "category": "phonetic_balance", "text": "In it there was something that was almost tragedy.", "source": "cmu_arctic"}
+{"id": "release500_0311", "category": "phonetic_balance", "text": "Thirty pounds, said the captain with finality.", "source": "cmu_arctic"}
+{"id": "release500_0312", "category": "phonetic_balance", "text": "It was over when he made his way through the ring of spectators.", "source": "cmu_arctic"}
+{"id": "release500_0313", "category": "phonetic_balance", "text": "She had died from cold and starvation.", "source": "cmu_arctic"}
+{"id": "release500_0314", "category": "phonetic_balance", "text": "We fished sharks on Niihau together.", "source": "cmu_arctic"}
+{"id": "release500_0315", "category": "phonetic_balance", "text": "His slim hands gripped the edges of the table.", "source": "cmu_arctic"}
+{"id": "release500_0316", "category": "phonetic_balance", "text": "We had been chased by them ourselves, more than once.", "source": "cmu_arctic"}
+{"id": "release500_0317", "category": "phonetic_balance", "text": "Or have they already devised one.", "source": "cmu_arctic"}
+{"id": "release500_0318", "category": "phonetic_balance", "text": "I cannot follow you, she said.", "source": "cmu_arctic"}
+{"id": "release500_0319", "category": "phonetic_balance", "text": "He went down in midstream, searching the shadows of both shores.", "source": "cmu_arctic"}
+{"id": "release500_0320", "category": "phonetic_balance", "text": "I was sick once -- typhoid.", "source": "cmu_arctic"}
+{"id": "release500_0321", "category": "phonetic_balance", "text": "Why not like any railroad station or ferry depot.", "source": "cmu_arctic"}
+{"id": "release500_0322", "category": "phonetic_balance", "text": "Red-Eye swung back and forth on the branch farther down.", "source": "cmu_arctic"}
+{"id": "release500_0323", "category": "phonetic_balance", "text": "Within himself he called it no longer his own.", "source": "cmu_arctic"}
+{"id": "release500_0324", "category": "phonetic_balance", "text": "It lasted as a deterrent for two days.", "source": "cmu_arctic"}
+{"id": "release500_0325", "category": "phonetic_balance", "text": "He loved to play Chinese lottery.", "source": "cmu_arctic"}
+{"id": "release500_0326", "category": "phonetic_balance", "text": "Lord, but I'm glad to see you again, Phil.", "source": "cmu_arctic"}
+{"id": "release500_0327", "category": "phonetic_balance", "text": "There is not an iota of truth in it, certainly not.", "source": "cmu_arctic"}
+{"id": "release500_0328", "category": "phonetic_balance", "text": "She added, with genuine sympathy in her face and voice.", "source": "cmu_arctic"}
+{"id": "release500_0329", "category": "phonetic_balance", "text": "We have plenty of capital ourselves, and yet we want more.", "source": "cmu_arctic"}
+{"id": "release500_0330", "category": "phonetic_balance", "text": "And now put yourself in my place for a moment.", "source": "cmu_arctic"}
+{"id": "release500_0331", "category": "phonetic_balance", "text": "Fast, but endure.", "source": "cmu_arctic"}
+{"id": "release500_0332", "category": "phonetic_balance", "text": "You were looking squeamish this afternoon, he began.", "source": "cmu_arctic"}
+{"id": "release500_0333", "category": "phonetic_balance", "text": "It is the nearest refuge.", "source": "cmu_arctic"}
+{"id": "release500_0334", "category": "phonetic_balance", "text": "I want to die in it.", "source": "cmu_arctic"}
+{"id": "release500_0335", "category": "phonetic_balance", "text": "He stopped, and Philip nodded at the horrified question in his eyes.", "source": "cmu_arctic"}
+{"id": "release500_0336", "category": "phonetic_balance", "text": "She turned, fearing that Jacques might see what was in her face.", "source": "cmu_arctic"}
+{"id": "release500_0337", "category": "phonetic_balance", "text": "It was a curious coincidence.", "source": "cmu_arctic"}
+{"id": "release500_0338", "category": "phonetic_balance", "text": "Daylight made no answer, and the door closed behind him.", "source": "cmu_arctic"}
+{"id": "release500_0339", "category": "phonetic_balance", "text": "And he did hurt my arm.", "source": "cmu_arctic"}
+{"id": "release500_0340", "category": "phonetic_balance", "text": "Dunham, can your boy go along with Jesse.", "source": "cmu_arctic"}
+{"id": "release500_0341", "category": "phonetic_balance", "text": "The creative joy, I murmured.", "source": "cmu_arctic"}
+{"id": "release500_0342", "category": "phonetic_balance", "text": "He pulled, and the log crashed down to break his back.", "source": "cmu_arctic"}
+{"id": "release500_0343", "category": "phonetic_balance", "text": "By golly, the boy wins.", "source": "cmu_arctic"}
+{"id": "release500_0344", "category": "phonetic_balance", "text": "The boy threw back his head with pride.", "source": "cmu_arctic"}
+{"id": "release500_0345", "category": "phonetic_balance", "text": "The last one I knew was an overseer.", "source": "cmu_arctic"}
+{"id": "release500_0346", "category": "phonetic_balance", "text": "Two years ago I gave up civilization for this.", "source": "cmu_arctic"}
+{"id": "release500_0347", "category": "phonetic_balance", "text": "The river bared its bosom, and snorting steamboats challenged the wilderness.", "source": "cmu_arctic"}
+{"id": "release500_0348", "category": "phonetic_balance", "text": "Mab, she said.", "source": "cmu_arctic"}
+{"id": "release500_0349", "category": "phonetic_balance", "text": "The regret in his voice was provocative of a second burst of laughter.", "source": "cmu_arctic"}
+{"id": "release500_0350", "category": "phonetic_balance", "text": "And each year something happened, and I did not go.", "source": "cmu_arctic"}
+{"id": "release500_0351", "category": "phonetic_balance", "text": "Gad, your letter came just in time.", "source": "cmu_arctic"}
+{"id": "release500_0352", "category": "phonetic_balance", "text": "But if Pierre did not return, until tomorrow.", "source": "cmu_arctic"}
+{"id": "release500_0353", "category": "phonetic_balance", "text": "Billinger may arrive in time.", "source": "cmu_arctic"}
+{"id": "release500_0354", "category": "phonetic_balance", "text": "In such a tumbling of values was no time to sell.", "source": "cmu_arctic"}
+{"id": "release500_0355", "category": "phonetic_balance", "text": "There's not an iota of truth in it.", "source": "cmu_arctic"}
+{"id": "release500_0356", "category": "phonetic_balance", "text": "It is dog eat dog, and you ate them up.", "source": "cmu_arctic"}
+{"id": "release500_0357", "category": "phonetic_balance", "text": "You can take a vacation on pay.", "source": "cmu_arctic"}
+{"id": "release500_0358", "category": "phonetic_balance", "text": "I have seen myself that one man contemplated by Pascal's philosophic eye.", "source": "cmu_arctic"}
+{"id": "release500_0359", "category": "phonetic_balance", "text": "Ah, I had forgotten, he exclaimed.", "source": "cmu_arctic"}
+{"id": "release500_0360", "category": "phonetic_balance", "text": "Providence had delivered him through the maelstrom.", "source": "cmu_arctic"}
+{"id": "release500_0361", "category": "phonetic_balance", "text": "She was his now, forever.", "source": "cmu_arctic"}
+{"id": "release500_0362", "category": "phonetic_balance", "text": "It was unobtrusive, yet it was there.", "source": "cmu_arctic"}
+{"id": "release500_0363", "category": "phonetic_balance", "text": "Men like Joe Goose dated existence from drunk to drunk.", "source": "cmu_arctic"}
+{"id": "release500_0364", "category": "phonetic_balance", "text": "I was completely lost in my work.", "source": "cmu_arctic"}
+{"id": "release500_0365", "category": "phonetic_balance", "text": "The very thing, Ernest agreed.", "source": "cmu_arctic"}
+{"id": "release500_0366", "category": "phonetic_balance", "text": "He was the leader, and Tudor was his lieutenant.", "source": "cmu_arctic"}
+{"id": "release500_0367", "category": "phonetic_balance", "text": "The Fire-Men wore animal skins around their waists and across their shoulders.", "source": "cmu_arctic"}
+{"id": "release500_0368", "category": "phonetic_balance", "text": "We could throw stones with our feet.", "source": "cmu_arctic"}
+{"id": "release500_0369", "category": "phonetic_balance", "text": "He turned sharply, and faced Gregson across the table.", "source": "cmu_arctic"}
+{"id": "release500_0370", "category": "phonetic_balance", "text": "They are to attack your camp tomorrow night.", "source": "cmu_arctic"}
+{"id": "release500_0371", "category": "phonetic_balance", "text": "And watch out for wet feet, was his parting advice.", "source": "cmu_arctic"}
+{"id": "release500_0372", "category": "phonetic_balance", "text": "Two weeks passed, and in that time Thorpe left camp three times.", "source": "cmu_arctic"}
+{"id": "release500_0373", "category": "phonetic_balance", "text": "But ever his gaze returned to that Crouched Venus on the piano.", "source": "cmu_arctic"}
+{"id": "release500_0374", "category": "phonetic_balance", "text": "But she had become an automaton.", "source": "cmu_arctic"}
+{"id": "release500_0375", "category": "phonetic_balance", "text": "I do not blame you for anything; remember that.", "source": "cmu_arctic"}
+{"id": "release500_0376", "category": "phonetic_balance", "text": "The next thing to watch out for is bed sores.", "source": "cmu_arctic"}
+{"id": "release500_0377", "category": "phonetic_balance", "text": "He will follow us soon.", "source": "cmu_arctic"}
+{"id": "release500_0378", "category": "phonetic_balance", "text": "His beady black eyes saw bargains where other men saw bankruptcy.", "source": "cmu_arctic"}
+{"id": "release500_0379", "category": "phonetic_balance", "text": "They robbed me a few years later.", "source": "cmu_arctic"}
+{"id": "release500_0380", "category": "phonetic_balance", "text": "Gregson held a lighted match until it burnt his fingertips.", "source": "cmu_arctic"}
+{"id": "release500_0381", "category": "phonetic_balance", "text": "A burst of laughter was his reward.", "source": "cmu_arctic"}
+{"id": "release500_0382", "category": "phonetic_balance", "text": "He cried, and swung the club wildly.", "source": "cmu_arctic"}
+{"id": "release500_0383", "category": "phonetic_balance", "text": "Sandel would never become a world champion.", "source": "cmu_arctic"}
+{"id": "release500_0384", "category": "phonetic_balance", "text": "And after the bath a shave would not be bad.", "source": "cmu_arctic"}
+{"id": "release500_0385", "category": "phonetic_balance", "text": "They saw each other for the first time in Boston.", "source": "cmu_arctic"}
+{"id": "release500_0386", "category": "phonetic_balance", "text": "I had been born with no organic, chemical predisposition toward alcohol.", "source": "cmu_arctic"}
+{"id": "release500_0387", "category": "phonetic_balance", "text": "They had no fixed values, to be altered by adjectives and adverbs.", "source": "cmu_arctic"}
+{"id": "release500_0388", "category": "phonetic_balance", "text": "Nor was Elam Harnish an exception.", "source": "cmu_arctic"}
+{"id": "release500_0389", "category": "phonetic_balance", "text": "He was a wise hyena.", "source": "cmu_arctic"}
+{"id": "release500_0390", "category": "phonetic_balance", "text": "And now behold the perversity of things.", "source": "cmu_arctic"}
+{"id": "release500_0391", "category": "phonetic_balance", "text": "The Fire People, like ourselves, lived in caves.", "source": "cmu_arctic"}
+{"id": "release500_0392", "category": "phonetic_balance", "text": "To her the bridge was tambo, which is the native for taboo.", "source": "cmu_arctic"}
+{"id": "release500_0393", "category": "phonetic_balance", "text": "The voyage was our idea of a good time.", "source": "cmu_arctic"}
+{"id": "release500_0394", "category": "phonetic_balance", "text": "Of course much grumbling went on, and little outbursts were continually occurring.", "source": "cmu_arctic"}
+{"id": "release500_0395", "category": "phonetic_balance", "text": "Get down and dig in.", "source": "cmu_arctic"}
+{"id": "release500_0396", "category": "phonetic_balance", "text": "It was put together in a casual, helter-skelter sort of way.", "source": "cmu_arctic"}
+{"id": "release500_0397", "category": "phonetic_balance", "text": "He deluged me, overwhelmed me with argument.", "source": "cmu_arctic"}
+{"id": "release500_0398", "category": "phonetic_balance", "text": "The girl faced him, her eyes shining with sudden fear.", "source": "cmu_arctic"}
+{"id": "release500_0399", "category": "phonetic_balance", "text": "It will break our hearts and our backs to hoist anchor by hand.", "source": "cmu_arctic"}
+{"id": "release500_0400", "category": "phonetic_balance", "text": "He made no reply as he waited for Whittemore to continue.", "source": "cmu_arctic"}
+{"id": "release500_0401", "category": "phonetic_balance", "text": "Who the devil gave it to you to be judge and jury.", "source": "cmu_arctic"}
+{"id": "release500_0402", "category": "phonetic_balance", "text": "Daylight found himself charmed and made curious by the little man.", "source": "cmu_arctic"}
+{"id": "release500_0403", "category": "phonetic_balance", "text": "It's a Yankee, Joan cried.", "source": "cmu_arctic"}
+{"id": "release500_0404", "category": "phonetic_balance", "text": "But what they want with your toothbrush is more than I can imagine.", "source": "cmu_arctic"}
+{"id": "release500_0405", "category": "phonetic_balance", "text": "They were babbling and chattering all together.", "source": "cmu_arctic"}
+{"id": "release500_0406", "category": "phonetic_balance", "text": "Men of Selden's stamp don't stop at women and children.", "source": "cmu_arctic"}
+{"id": "release500_0407", "category": "phonetic_balance", "text": "Cameron looked at his hands with their long, sinewy fingers.", "source": "cmu_arctic"}
+{"id": "release500_0408", "category": "phonetic_balance", "text": "Saxon waited, for she knew a fresh idea had struck Billy.", "source": "cmu_arctic"}
+{"id": "release500_0409", "category": "phonetic_balance", "text": "He saw only the effect in a general, sketchy way.", "source": "cmu_arctic"}
+{"id": "release500_0410", "category": "phonetic_balance", "text": "He began to follow the footprints of the dog.", "source": "cmu_arctic"}
+{"id": "release500_0411", "category": "phonetic_balance", "text": "Do you value your hide.", "source": "cmu_arctic"}
+{"id": "release500_0412", "category": "phonetic_balance", "text": "A rising tide of fat had submerged them.", "source": "cmu_arctic"}
+{"id": "release500_0413", "category": "phonetic_balance", "text": "There was nothing on the rock.", "source": "cmu_arctic"}
+{"id": "release500_0414", "category": "phonetic_balance", "text": "Whatever he guessed he locked away in the taboo room of Naomi.", "source": "cmu_arctic"}
+{"id": "release500_0415", "category": "phonetic_balance", "text": "Will we ever forget it.", "source": "cmu_arctic"}
+{"id": "release500_0416", "category": "phonetic_balance", "text": "Jeanne and Pierre both gazed toward the great rock.", "source": "cmu_arctic"}
+{"id": "release500_0417", "category": "phonetic_balance", "text": "Does the old boy often go off at half-cock that way.", "source": "cmu_arctic"}
+{"id": "release500_0418", "category": "phonetic_balance", "text": "The temperature dropped to fifty below zero and remained there the whole trip.", "source": "cmu_arctic"}
+{"id": "release500_0419", "category": "phonetic_balance", "text": "It's worth eight dollars.", "source": "cmu_arctic"}
+{"id": "release500_0420", "category": "phonetic_balance", "text": "But I did not enjoy it long.", "source": "cmu_arctic"}
+{"id": "release500_0421", "category": "phonetic_balance", "text": "Shorty turned to their employers.", "source": "cmu_arctic"}
+{"id": "release500_0422", "category": "phonetic_balance", "text": "It was the third or fourth time that Philip had heard MacDougall swear.", "source": "cmu_arctic"}
+{"id": "release500_0423", "category": "phonetic_balance", "text": "Ernest saw in the affair the most sinister import.", "source": "cmu_arctic"}
+{"id": "release500_0424", "category": "phonetic_balance", "text": "Also, at regular intervals, he would mutter.", "source": "cmu_arctic"}
+{"id": "release500_0425", "category": "phonetic_balance", "text": "He may anticipate the day of his death.", "source": "cmu_arctic"}
+{"id": "release500_0426", "category": "phonetic_balance", "text": "I defy any man to get a Solomon Island sore in California.", "source": "cmu_arctic"}
+{"id": "release500_0427", "category": "phonetic_balance", "text": "Now our figuring was all right.", "source": "cmu_arctic"}
+{"id": "release500_0428", "category": "phonetic_balance", "text": "MacDougall tapped his forehead suspiciously with a stubby forefinger.", "source": "cmu_arctic"}
+{"id": "release500_0429", "category": "phonetic_balance", "text": "O'Brien took off his coat and bared his right arm.", "source": "cmu_arctic"}
+{"id": "release500_0430", "category": "phonetic_balance", "text": "But it won't continue, she said with easy confidence.", "source": "cmu_arctic"}
+{"id": "release500_0431", "category": "phonetic_balance", "text": "I was still weak from my prolonged immersion.", "source": "cmu_arctic"}
+{"id": "release500_0432", "category": "phonetic_balance", "text": "Oolong was two hundred and fifty miles from the nearest land.", "source": "cmu_arctic"}
+{"id": "release500_0433", "category": "phonetic_balance", "text": "I just do appreciate it without being able to express my feelings.", "source": "cmu_arctic"}
+{"id": "release500_0434", "category": "phonetic_balance", "text": "Now just what do you want to know.", "source": "cmu_arctic"}
+{"id": "release500_0435", "category": "phonetic_balance", "text": "But she swung obediently on her heel into the wind.", "source": "cmu_arctic"}
+{"id": "release500_0436", "category": "phonetic_balance", "text": "Ask him, I laughed, then turned to Pasquini.", "source": "cmu_arctic"}
+{"id": "release500_0437", "category": "phonetic_balance", "text": "He did not rush in.", "source": "cmu_arctic"}
+{"id": "release500_0438", "category": "phonetic_balance", "text": "They obeyed him, and went here and there at his commands.", "source": "cmu_arctic"}
+{"id": "release500_0439", "category": "phonetic_balance", "text": "Tom Spink has a harpoon.", "source": "cmu_arctic"}
+{"id": "release500_0440", "category": "phonetic_balance", "text": "It was my reports from the north which chiefly induced people to buy.", "source": "cmu_arctic"}
+{"id": "release500_0441", "category": "phonetic_balance", "text": "Cherokee identified himself with his instinct.", "source": "cmu_arctic"}
+{"id": "release500_0442", "category": "phonetic_balance", "text": "I graduated last of my class.", "source": "cmu_arctic"}
+{"id": "release500_0443", "category": "phonetic_balance", "text": "It was a gigantic inadequacy.", "source": "cmu_arctic"}
+{"id": "release500_0444", "category": "phonetic_balance", "text": "Did I possess too much vitality.", "source": "cmu_arctic"}
+{"id": "release500_0445", "category": "phonetic_balance", "text": "Therefore, hurrah for the game.", "source": "cmu_arctic"}
+{"id": "release500_0446", "category": "phonetic_balance", "text": "He had fulfilled his duty and paid properly.", "source": "cmu_arctic"}
+{"id": "release500_0447", "category": "phonetic_balance", "text": "How can you manage all alone, Mr Young.", "source": "cmu_arctic"}
+{"id": "release500_0448", "category": "phonetic_balance", "text": "Red-Eye never committed a more outrageous deed.", "source": "cmu_arctic"}
+{"id": "release500_0449", "category": "phonetic_balance", "text": "He would keep his faith with Gregson for the promised day or two.", "source": "cmu_arctic"}
+{"id": "release500_0450", "category": "phonetic_balance", "text": "There was one chance, and only one, of saving Jeanne.", "source": "cmu_arctic"}
+{"id": "release500_0451", "category": "phonetic_balance", "text": "I was beneath the water, suffocating and drowning.", "source": "cmu_arctic"}
+{"id": "release500_0452", "category": "phonetic_balance", "text": "Give them their choice between a fine or an official whipping.", "source": "cmu_arctic"}
+{"id": "release500_0453", "category": "phonetic_balance", "text": "They must have been swept away by the chaotic currents.", "source": "cmu_arctic"}
+{"id": "release500_0454", "category": "phonetic_balance", "text": "You yellow giant thing of the frost.", "source": "cmu_arctic"}
+{"id": "release500_0455", "category": "phonetic_balance", "text": "He had peeled off his shirt and was wildly waving it.", "source": "cmu_arctic"}
+{"id": "release500_0456", "category": "phonetic_balance", "text": "To these he gave castor oil.", "source": "cmu_arctic"}
+{"id": "release500_0457", "category": "phonetic_balance", "text": "Tudor surveyed him with withering disgust.", "source": "cmu_arctic"}
+{"id": "release500_0458", "category": "phonetic_balance", "text": "After all, it was simply a mistake in judgment.", "source": "cmu_arctic"}
+{"id": "release500_0459", "category": "phonetic_balance", "text": "That is the strange part of it.", "source": "cmu_arctic"}
+{"id": "release500_0460", "category": "phonetic_balance", "text": "Not a wheel moved in his empire.", "source": "cmu_arctic"}
+{"id": "release500_0461", "category": "phonetic_balance", "text": "Its diameter was not more than two hundred yards.", "source": "cmu_arctic"}
+{"id": "release500_0462", "category": "phonetic_balance", "text": "Nimrod replied, with a slight manifestation of sensitiveness.", "source": "cmu_arctic"}
+{"id": "release500_0463", "category": "phonetic_balance", "text": "I tried to read George Moore last night, and was dreadfully bored.", "source": "cmu_arctic"}
+{"id": "release500_0464", "category": "phonetic_balance", "text": "Yes, it was a man who asked, a stranger.", "source": "cmu_arctic"}
+{"id": "release500_0465", "category": "phonetic_balance", "text": "We were now good friends.", "source": "cmu_arctic"}
+{"id": "release500_0466", "category": "phonetic_balance", "text": "Yet, in accordance with Ernest's test of truth, it worked.", "source": "cmu_arctic"}
+{"id": "release500_0467", "category": "phonetic_balance", "text": "It's the strap hangers that'll keep us from going under.", "source": "cmu_arctic"}
+{"id": "release500_0468", "category": "phonetic_balance", "text": "I never allow what can't be changed to annoy me.", "source": "cmu_arctic"}
+{"id": "release500_0469", "category": "phonetic_balance", "text": "After all superfluous flesh is gone what is left is stringy and resistant.", "source": "cmu_arctic"}
+{"id": "release500_0470", "category": "phonetic_balance", "text": "Then he shouted, Shut up.", "source": "cmu_arctic"}
+{"id": "release500_0471", "category": "phonetic_balance", "text": "He had worshiped her, as Dante might have worshiped Beatrice.", "source": "cmu_arctic"}
+{"id": "release500_0472", "category": "phonetic_balance", "text": "He looked like one who had passed through an uncomfortable hour or two.", "source": "cmu_arctic"}
+{"id": "release500_0473", "category": "phonetic_balance", "text": "The history of our westward-faring race is written in it.", "source": "cmu_arctic"}
+{"id": "release500_0474", "category": "phonetic_balance", "text": "He may desire to escape pain, or to enjoy pleasure.", "source": "cmu_arctic"}
+{"id": "release500_0475", "category": "phonetic_balance", "text": "And the air was growing chilly.", "source": "cmu_arctic"}
+{"id": "release500_0476", "category": "phonetic_balance", "text": "Dig in; you're sure good, was Daylight's answer.", "source": "cmu_arctic"}
+{"id": "release500_0477", "category": "phonetic_balance", "text": "My idea was that he would have more influence over the natives.", "source": "cmu_arctic"}
+{"id": "release500_0478", "category": "phonetic_balance", "text": "Now run along, and tell them to hurry.", "source": "cmu_arctic"}
+{"id": "release500_0479", "category": "phonetic_balance", "text": "I have no idea, replied Philip.", "source": "cmu_arctic"}
+{"id": "release500_0480", "category": "phonetic_balance", "text": "For the rest, he was a mere automaton.", "source": "cmu_arctic"}
+{"id": "release500_0481", "category": "phonetic_balance", "text": "Why, the average review is more nauseating than cod liver oil.", "source": "cmu_arctic"}
+{"id": "release500_0482", "category": "phonetic_balance", "text": "I have been robbed, sir, I amended.", "source": "cmu_arctic"}
+{"id": "release500_0483", "category": "phonetic_balance", "text": "He moved away as quietly as he had come.", "source": "cmu_arctic"}
+{"id": "release500_0484", "category": "phonetic_balance", "text": "A trickle of fresh blood ran over his face.", "source": "cmu_arctic"}
+{"id": "release500_0485", "category": "phonetic_balance", "text": "Suppose you saw me at work through the window.", "source": "cmu_arctic"}
+{"id": "release500_0486", "category": "phonetic_balance", "text": "But who was Eileen's double.", "source": "cmu_arctic"}
+{"id": "release500_0487", "category": "phonetic_balance", "text": "Darkness hid him from Jeanne.", "source": "cmu_arctic"}
+{"id": "release500_0488", "category": "phonetic_balance", "text": "By this time Charley was as enraged as the Greek.", "source": "cmu_arctic"}
+{"id": "release500_0489", "category": "phonetic_balance", "text": "I am writing these lines in Honolulu, Hawaii.", "source": "cmu_arctic"}
+{"id": "release500_0490", "category": "phonetic_balance", "text": "Nobody knows how the natives got them.", "source": "cmu_arctic"}
+{"id": "release500_0491", "category": "phonetic_balance", "text": "And how would we ever find ourselves.", "source": "cmu_arctic"}
+{"id": "release500_0492", "category": "phonetic_balance", "text": "They are coming ashore, whoever they are.", "source": "cmu_arctic"}
+{"id": "release500_0493", "category": "phonetic_balance", "text": "This is my fifth voyage.", "source": "cmu_arctic"}
+{"id": "release500_0494", "category": "phonetic_balance", "text": "And yet if she came he had no words to say.", "source": "cmu_arctic"}
+{"id": "release500_0495", "category": "phonetic_balance", "text": "You must sleep, he urged.", "source": "cmu_arctic"}
+{"id": "release500_0496", "category": "phonetic_balance", "text": "Could the incident have anything to do with Jeanne and Pierre.", "source": "cmu_arctic"}
+{"id": "release500_0497", "category": "phonetic_balance", "text": "Each day she became a more vital part of him.", "source": "cmu_arctic"}
+{"id": "release500_0498", "category": "phonetic_balance", "text": "But why continue the tirade, for tirade it was.", "source": "cmu_arctic"}
+{"id": "release500_0499", "category": "phonetic_balance", "text": "That is what distinguishes all of us from the lower animals.", "source": "cmu_arctic"}
+{"id": "release500_0500", "category": "phonetic_balance", "text": "There was something pathetic in the girl's attitude now.", "source": "cmu_arctic"}

evaluation/final/runtime/inflect-micro-v2_cpu.json

@@ -0,0 +1,435 @@
+{
+  "format": "inflect_tts_runtime_v2",
+  "system": "inflect-micro-v2",
+  "provider": "cpu",
+  "hardware": {
+    "platform": "Linux-5.15.0-164-generic-x86_64-with-glibc2.39",
+    "processor": "AMD EPYC 7K62 48-Core Processor",
+    "logical_cpus_visible": 192,
+    "process_cpu_affinity_count": 192
+  },
+  "runtime_protocol": {
+    "python": "3.12.13",
+    "single_process": true,
+    "concurrent_synthesis_requests": 1,
+    "warmup_utterances": 3,
+    "thread_policy": "runtime default",
+    "environment_threads": {
+      "OMP_NUM_THREADS": null,
+      "MKL_NUM_THREADS": null,
+      "OPENBLAS_NUM_THREADS": null
+    }
+  },
+  "utterances": 50,
+  "load_seconds": 1.3450956749729812,
+  "peak_process_rss_bytes_observed": 1374117888,
+  "total_latency_seconds": 164.47246361640282,
+  "total_audio_seconds": 221.32266666666666,
+  "rtf": 0.7431342938955017,
+  "realtime_multiple": 1.3456517997009816,
+  "latency_mean_seconds": 3.2894492723280564,
+  "latency_median_seconds": 3.204997018503491,
+  "latency_p95_seconds": 4.681012376293073,
+  "rows": [
+    {
+      "id": "release500_0001",
+      "category": "conversational",
+      "characters": 65,
+      "audio_seconds": 3.7653333333333334,
+      "latency_seconds": 3.0963279620045796,
+      "rtf": 0.822325060730678
+    },
+    {
+      "id": "release500_0002",
+      "category": "descriptive",
+      "characters": 72,
+      "audio_seconds": 3.8826666666666667,
+      "latency_seconds": 3.298753931070678,
+      "rtf": 0.8496103874666925
+    },
+    {
+      "id": "release500_0003",
+      "category": "emotional",
+      "characters": 68,
+      "audio_seconds": 3.9146666666666667,
+      "latency_seconds": 3.1102415019413456,
+      "rtf": 0.794509920455044
+    },
+    {
+      "id": "release500_0004",
+      "category": "homographs",
+      "characters": 73,
+      "audio_seconds": 4.330666666666667,
+      "latency_seconds": 3.798860387993045,
+      "rtf": 0.8771999048629261
+    },
+    {
+      "id": "release500_0005",
+      "category": "long",
+      "characters": 154,
+      "audio_seconds": 8.597333333333333,
+      "latency_seconds": 5.6228647420648485,
+      "rtf": 0.6540242798617613
+    },
+    {
+      "id": "release500_0006",
+      "category": "long_range",
+      "characters": 122,
+      "audio_seconds": 6.176,
+      "latency_seconds": 3.7697316620033234,
+      "rtf": 0.6103840126300718
+    },
+    {
+      "id": "release500_0007",
+      "category": "names_places",
+      "characters": 62,
+      "audio_seconds": 3.7973333333333334,
+      "latency_seconds": 2.610186845995486,
+      "rtf": 0.6873736427305528
+    },
+    {
+      "id": "release500_0008",
+      "category": "narrative",
+      "characters": 76,
+      "audio_seconds": 4.352,
+      "latency_seconds": 3.1997373000485823,
+      "rtf": 0.7352337546067513
+    },
+    {
+      "id": "release500_0009",
+      "category": "numbers",
+      "characters": 79,
+      "audio_seconds": 4.789333333333333,
+      "latency_seconds": 3.400350669049658,
+      "rtf": 0.7099841319006802
+    },
+    {
+      "id": "release500_0010",
+      "category": "punctuation",
+      "characters": 75,
+      "audio_seconds": 5.312,
+      "latency_seconds": 3.396303041954525,
+      "rtf": 0.6393642774763789
+    },
+    {
+      "id": "release500_0011",
+      "category": "question",
+      "characters": 47,
+      "audio_seconds": 2.570666666666667,
+      "latency_seconds": 2.200048934086226,
+      "rtf": 0.8558281641932932
+    },
+    {
+      "id": "release500_0012",
+      "category": "rare_words",
+      "characters": 87,
+      "audio_seconds": 5.184,
+      "latency_seconds": 3.8021743500139564,
+      "rtf": 0.7334441261600996
+    },
+    {
+      "id": "release500_0013",
+      "category": "short",
+      "characters": 15,
+      "audio_seconds": 1.2693333333333334,
+      "latency_seconds": 1.7893105780240148,
+      "rtf": 1.4096459385693394
+    },
+    {
+      "id": "release500_0014",
+      "category": "technical",
+      "characters": 71,
+      "audio_seconds": 4.010666666666666,
+      "latency_seconds": 3.300313051091507,
+      "rtf": 0.8228839056910341
+    },
+    {
+      "id": "release500_0015",
+      "category": "conversational",
+      "characters": 64,
+      "audio_seconds": 4.0,
+      "latency_seconds": 3.1033195100026205,
+      "rtf": 0.7758298775006551
+    },
+    {
+      "id": "release500_0016",
+      "category": "descriptive",
+      "characters": 88,
+      "audio_seconds": 4.618666666666667,
+      "latency_seconds": 4.089846272952855,
+      "rtf": 0.8855036676427946
+    },
+    {
+      "id": "release500_0017",
+      "category": "emotional",
+      "characters": 74,
+      "audio_seconds": 4.266666666666667,
+      "latency_seconds": 3.699034327059053,
+      "rtf": 0.8669611704044655
+    },
+    {
+      "id": "release500_0018",
+      "category": "homographs",
+      "characters": 57,
+      "audio_seconds": 3.328,
+      "latency_seconds": 3.409255804028362,
+      "rtf": 1.0244158064989068
+    },
+    {
+      "id": "release500_0019",
+      "category": "long",
+      "characters": 148,
+      "audio_seconds": 8.010666666666667,
+      "latency_seconds": 5.100449635996483,
+      "rtf": 0.636707261484248
+    },
+    {
+      "id": "release500_0020",
+      "category": "long_range",
+      "characters": 124,
+      "audio_seconds": 6.261333333333333,
+      "latency_seconds": 3.7893470430281013,
+      "rtf": 0.6051981009946925
+    },
+    {
+      "id": "release500_0021",
+      "category": "names_places",
+      "characters": 72,
+      "audio_seconds": 3.936,
+      "latency_seconds": 3.700202681007795,
+      "rtf": 0.9400921445649886
+    },
+    {
+      "id": "release500_0022",
+      "category": "narrative",
+      "characters": 52,
+      "audio_seconds": 3.4133333333333336,
+      "latency_seconds": 4.905314784962684,
+      "rtf": 1.4371039409070363
+    },
+    {
+      "id": "release500_0023",
+      "category": "numbers",
+      "characters": 80,
+      "audio_seconds": 4.576,
+      "latency_seconds": 3.2102567369583994,
+      "rtf": 0.7015421190905594
+    },
+    {
+      "id": "release500_0024",
+      "category": "punctuation",
+      "characters": 73,
+      "audio_seconds": 4.469333333333333,
+      "latency_seconds": 3.3047980930423364,
+      "rtf": 0.7394387141353677
+    },
+    {
+      "id": "release500_0025",
+      "category": "question",
+      "characters": 39,
+      "audio_seconds": 2.2186666666666666,
+      "latency_seconds": 2.1851010150276124,
+      "rtf": 0.9848712507636475
+    },
+    {
+      "id": "release500_0026",
+      "category": "rare_words",
+      "characters": 78,
+      "audio_seconds": 4.512,
+      "latency_seconds": 3.0049878619611263,
+      "rtf": 0.6659990828814554
+    },
+    {
+      "id": "release500_0027",
+      "category": "short",
+      "characters": 25,
+      "audio_seconds": 1.568,
+      "latency_seconds": 1.7857773479772732,
+      "rtf": 1.1388886147814241
+    },
+    {
+      "id": "release500_0028",
+      "category": "technical",
+      "characters": 82,
+      "audio_seconds": 5.397333333333333,
+      "latency_seconds": 3.9127721959957853,
+      "rtf": 0.7249454414517883
+    },
+    {
+      "id": "release500_0029",
+      "category": "conversational",
+      "characters": 59,
+      "audio_seconds": 3.050666666666667,
+      "latency_seconds": 3.0953754010843113,
+      "rtf": 1.0146553980827069
+    },
+    {
+      "id": "release500_0030",
+      "category": "descriptive",
+      "characters": 65,
+      "audio_seconds": 3.530666666666667,
+      "latency_seconds": 3.604664637008682,
+      "rtf": 1.0209586396361447
+    },
+    {
+      "id": "release500_0031",
+      "category": "emotional",
+      "characters": 70,
+      "audio_seconds": 4.2026666666666666,
+      "latency_seconds": 3.4063999010249972,
+      "rtf": 0.8105329713733338
+    },
+    {
+      "id": "release500_0032",
+      "category": "homographs",
+      "characters": 60,
+      "audio_seconds": 3.36,
+      "latency_seconds": 3.097165131010115,
+      "rtf": 0.9217753366101533
+    },
+    {
+      "id": "release500_0033",
+      "category": "long",
+      "characters": 138,
+      "audio_seconds": 7.616,
+      "latency_seconds": 4.406864987919107,
+      "rtf": 0.5786324826574458
+    },
+    {
+      "id": "release500_0034",
+      "category": "long_range",
+      "characters": 141,
+      "audio_seconds": 7.8933333333333335,
+      "latency_seconds": 4.392835911014117,
+      "rtf": 0.5565248198075318
+    },
+    {
+      "id": "release500_0035",
+      "category": "names_places",
+      "characters": 61,
+      "audio_seconds": 3.616,
+      "latency_seconds": 2.7880763289285824,
+      "rtf": 0.7710388077789221
+    },
+    {
+      "id": "release500_0036",
+      "category": "narrative",
+      "characters": 73,
+      "audio_seconds": 4.149333333333334,
+      "latency_seconds": 2.9094826449872926,
+      "rtf": 0.7011927968317703
+    },
+    {
+      "id": "release500_0037",
+      "category": "numbers",
+      "characters": 78,
+      "audio_seconds": 4.864,
+      "latency_seconds": 2.7931808329885826,
+      "rtf": 0.5742559278348237
+    },
+    {
+      "id": "release500_0038",
+      "category": "punctuation",
+      "characters": 67,
+      "audio_seconds": 4.522666666666667,
+      "latency_seconds": 2.8904477619798854,
+      "rtf": 0.6391025417113544
+    },
+    {
+      "id": "release500_0039",
+      "category": "question",
+      "characters": 45,
+      "audio_seconds": 2.3573333333333335,
+      "latency_seconds": 2.115686099976301,
+      "rtf": 0.8974912754424353
+    },
+    {
+      "id": "release500_0040",
+      "category": "rare_words",
+      "characters": 82,
+      "audio_seconds": 4.810666666666667,
+      "latency_seconds": 3.091681601945311,
+      "rtf": 0.6426721733533767
+    },
+    {
+      "id": "release500_0041",
+      "category": "short",
+      "characters": 22,
+      "audio_seconds": 1.5573333333333332,
+      "latency_seconds": 1.596736979088746,
+      "rtf": 1.0253019985586982
+    },
+    {
+      "id": "release500_0042",
+      "category": "technical",
+      "characters": 66,
+      "audio_seconds": 3.7226666666666666,
+      "latency_seconds": 2.9045540110673755,
+      "rtf": 0.7802347809099326
+    },
+    {
+      "id": "release500_0043",
+      "category": "conversational",
+      "characters": 67,
+      "audio_seconds": 3.968,
+      "latency_seconds": 2.999315937049687,
+      "rtf": 0.7558759922000219
+    },
+    {
+      "id": "release500_0044",
+      "category": "descriptive",
+      "characters": 73,
+      "audio_seconds": 3.989333333333333,
+      "latency_seconds": 2.6931907170219347,
+      "rtf": 0.6750979404299636
+    },
+    {
+      "id": "release500_0045",
+      "category": "emotional",
+      "characters": 70,
+      "audio_seconds": 4.1386666666666665,
+      "latency_seconds": 3.002258141990751,
+      "rtf": 0.725416754669157
+    },
+    {
+      "id": "release500_0046",
+      "category": "homographs",
+      "characters": 51,
+      "audio_seconds": 2.9546666666666668,
+      "latency_seconds": 2.494517444050871,
+      "rtf": 0.8442635753782279
+    },
+    {
+      "id": "release500_0047",
+      "category": "long",
+      "characters": 161,
+      "audio_seconds": 8.192,
+      "latency_seconds": 4.0075952999759465,
+      "rtf": 0.48920841064159504
+    },
+    {
+      "id": "release500_0048",
+      "category": "long_range",
+      "characters": 124,
+      "audio_seconds": 7.424,
+      "latency_seconds": 4.198830675915815,
+      "rtf": 0.5655752526826259
+    },
+    {
+      "id": "release500_0049",
+      "category": "names_places",
+      "characters": 59,
+      "audio_seconds": 3.296,
+      "latency_seconds": 2.6966539489803836,
+      "rtf": 0.8181595718993883
+    },
+    {
+      "id": "release500_0050",
+      "category": "narrative",
+      "characters": 99,
+      "audio_seconds": 5.578666666666667,
+      "latency_seconds": 3.691280954051763,
+      "rtf": 0.6616779912855694
+    }
+  ]
+}

evaluation/final/runtime/inflect-micro-v2_cuda.json

@@ -0,0 +1,435 @@
+{
+  "format": "inflect_tts_runtime_v2",
+  "system": "inflect-micro-v2",
+  "provider": "cuda:0",
+  "hardware": {
+    "platform": "Linux-5.15.0-164-generic-x86_64-with-glibc2.39",
+    "processor": "AMD EPYC 7K62 48-Core Processor",
+    "logical_cpus_visible": 192,
+    "process_cpu_affinity_count": 192
+  },
+  "runtime_protocol": {
+    "python": "3.12.13",
+    "single_process": true,
+    "concurrent_synthesis_requests": 1,
+    "warmup_utterances": 3,
+    "thread_policy": "runtime default",
+    "environment_threads": {
+      "OMP_NUM_THREADS": null,
+      "MKL_NUM_THREADS": null,
+      "OPENBLAS_NUM_THREADS": null
+    }
+  },
+  "utterances": 50,
+  "load_seconds": 1.4951987860258669,
+  "peak_process_rss_bytes_observed": 2080051200,
+  "total_latency_seconds": 3.850211550248787,
+  "total_audio_seconds": 221.33333333333334,
+  "rtf": 0.01739553411256982,
+  "realtime_multiple": 57.4860187407187,
+  "latency_mean_seconds": 0.07700423100497573,
+  "latency_median_seconds": 0.07859880453906953,
+  "latency_p95_seconds": 0.08273381618200801,
+  "rows": [
+    {
+      "id": "release500_0001",
+      "category": "conversational",
+      "characters": 65,
+      "audio_seconds": 3.7653333333333334,
+      "latency_seconds": 0.04948486597277224,
+      "rtf": 0.013142227152825488
+    },
+    {
+      "id": "release500_0002",
+      "category": "descriptive",
+      "characters": 72,
+      "audio_seconds": 3.8826666666666667,
+      "latency_seconds": 0.05178455193527043,
+      "rtf": 0.013337367428383524
+    },
+    {
+      "id": "release500_0003",
+      "category": "emotional",
+      "characters": 68,
+      "audio_seconds": 3.9146666666666667,
+      "latency_seconds": 0.0483815890038386,
+      "rtf": 0.012359057136539151
+    },
+    {
+      "id": "release500_0004",
+      "category": "homographs",
+      "characters": 73,
+      "audio_seconds": 4.330666666666667,
+      "latency_seconds": 0.07781655306462198,
+      "rtf": 0.017968723768000766
+    },
+    {
+      "id": "release500_0005",
+      "category": "long",
+      "characters": 154,
+      "audio_seconds": 8.597333333333333,
+      "latency_seconds": 0.08299373800400645,
+      "rtf": 0.00965342796262482
+    },
+    {
+      "id": "release500_0006",
+      "category": "long_range",
+      "characters": 122,
+      "audio_seconds": 6.176,
+      "latency_seconds": 0.08454970794264227,
+      "rtf": 0.013690043384495186
+    },
+    {
+      "id": "release500_0007",
+      "category": "names_places",
+      "characters": 62,
+      "audio_seconds": 3.808,
+      "latency_seconds": 0.08324956998694688,
+      "rtf": 0.021861756824303278
+    },
+    {
+      "id": "release500_0008",
+      "category": "narrative",
+      "characters": 76,
+      "audio_seconds": 4.352,
+      "latency_seconds": 0.07742644101381302,
+      "rtf": 0.017791002071188652
+    },
+    {
+      "id": "release500_0009",
+      "category": "numbers",
+      "characters": 79,
+      "audio_seconds": 4.789333333333333,
+      "latency_seconds": 0.07936609396710992,
+      "rtf": 0.016571428306050233
+    },
+    {
+      "id": "release500_0010",
+      "category": "punctuation",
+      "characters": 75,
+      "audio_seconds": 5.312,
+      "latency_seconds": 0.08241613395512104,
+      "rtf": 0.01551508545841887
+    },
+    {
+      "id": "release500_0011",
+      "category": "question",
+      "characters": 47,
+      "audio_seconds": 2.570666666666667,
+      "latency_seconds": 0.0773231100756675,
+      "rtf": 0.030079010662215053
+    },
+    {
+      "id": "release500_0012",
+      "category": "rare_words",
+      "characters": 87,
+      "audio_seconds": 5.184,
+      "latency_seconds": 0.07705403899308294,
+      "rtf": 0.0148638192502089
+    },
+    {
+      "id": "release500_0013",
+      "category": "short",
+      "characters": 15,
+      "audio_seconds": 1.2693333333333334,
+      "latency_seconds": 0.07799724501091987,
+      "rtf": 0.06144740940986334
+    },
+    {
+      "id": "release500_0014",
+      "category": "technical",
+      "characters": 71,
+      "audio_seconds": 4.010666666666666,
+      "latency_seconds": 0.07672238594386727,
+      "rtf": 0.019129584261270097
+    },
+    {
+      "id": "release500_0015",
+      "category": "conversational",
+      "characters": 64,
+      "audio_seconds": 4.0,
+      "latency_seconds": 0.07751119195017964,
+      "rtf": 0.01937779798754491
+    },
+    {
+      "id": "release500_0016",
+      "category": "descriptive",
+      "characters": 88,
+      "audio_seconds": 4.618666666666667,
+      "latency_seconds": 0.08169721905142069,
+      "rtf": 0.017688485649123994
+    },
+    {
+      "id": "release500_0017",
+      "category": "emotional",
+      "characters": 74,
+      "audio_seconds": 4.266666666666667,
+      "latency_seconds": 0.07964741496834904,
+      "rtf": 0.018667362883206806
+    },
+    {
+      "id": "release500_0018",
+      "category": "homographs",
+      "characters": 57,
+      "audio_seconds": 3.328,
+      "latency_seconds": 0.0793499950086698,
+      "rtf": 0.0238431475386628
+    },
+    {
+      "id": "release500_0019",
+      "category": "long",
+      "characters": 148,
+      "audio_seconds": 8.010666666666667,
+      "latency_seconds": 0.07945526507683098,
+      "rtf": 0.00991868322363902
+    },
+    {
+      "id": "release500_0020",
+      "category": "long_range",
+      "characters": 124,
+      "audio_seconds": 6.261333333333333,
+      "latency_seconds": 0.07923486304935068,
+      "rtf": 0.012654631023639909
+    },
+    {
+      "id": "release500_0021",
+      "category": "names_places",
+      "characters": 72,
+      "audio_seconds": 3.936,
+      "latency_seconds": 0.0736988460412249,
+      "rtf": 0.018724300315351855
+    },
+    {
+      "id": "release500_0022",
+      "category": "narrative",
+      "characters": 52,
+      "audio_seconds": 3.4133333333333336,
+      "latency_seconds": 0.07931573409587145,
+      "rtf": 0.02323703147339984
+    },
+    {
+      "id": "release500_0023",
+      "category": "numbers",
+      "characters": 80,
+      "audio_seconds": 4.576,
+      "latency_seconds": 0.0796226350357756,
+      "rtf": 0.0174000513627132
+    },
+    {
+      "id": "release500_0024",
+      "category": "punctuation",
+      "characters": 73,
+      "audio_seconds": 4.469333333333333,
+      "latency_seconds": 0.07813397597055882,
+      "rtf": 0.01748224402682551
+    },
+    {
+      "id": "release500_0025",
+      "category": "question",
+      "characters": 39,
+      "audio_seconds": 2.2186666666666666,
+      "latency_seconds": 0.08047464198898524,
+      "rtf": 0.03627162349263157
+    },
+    {
+      "id": "release500_0026",
+      "category": "rare_words",
+      "characters": 78,
+      "audio_seconds": 4.512,
+      "latency_seconds": 0.07918339292518795,
+      "rtf": 0.017549510843348395
+    },
+    {
+      "id": "release500_0027",
+      "category": "short",
+      "characters": 25,
+      "audio_seconds": 1.568,
+      "latency_seconds": 0.08055797289125621,
+      "rtf": 0.05137625822146442
+    },
+    {
+      "id": "release500_0028",
+      "category": "technical",
+      "characters": 82,
+      "audio_seconds": 5.397333333333333,
+      "latency_seconds": 0.07831828703638166,
+      "rtf": 0.014510552193005496
+    },
+    {
+      "id": "release500_0029",
+      "category": "conversational",
+      "characters": 59,
+      "audio_seconds": 3.050666666666667,
+      "latency_seconds": 0.0796109160874039,
+      "rtf": 0.026096235605573826
+    },
+    {
+      "id": "release500_0030",
+      "category": "descriptive",
+      "characters": 65,
+      "audio_seconds": 3.530666666666667,
+      "latency_seconds": 0.07437878102064133,
+      "rtf": 0.021066497645574393
+    },
+    {
+      "id": "release500_0031",
+      "category": "emotional",
+      "characters": 70,
+      "audio_seconds": 4.2026666666666666,
+      "latency_seconds": 0.07443938206415623,
+      "rtf": 0.017712416417549864
+    },
+    {
+      "id": "release500_0032",
+      "category": "homographs",
+      "characters": 60,
+      "audio_seconds": 3.36,
+      "latency_seconds": 0.07828063808847219,
+      "rtf": 0.023297808954902438
+    },
+    {
+      "id": "release500_0033",
+      "category": "long",
+      "characters": 138,
+      "audio_seconds": 7.616,
+      "latency_seconds": 0.07834453810937703,
+      "rtf": 0.010286835361000135
+    },
+    {
+      "id": "release500_0034",
+      "category": "long_range",
+      "characters": 141,
+      "audio_seconds": 7.8933333333333335,
+      "latency_seconds": 0.07765388395637274,
+      "rtf": 0.00983790759582425
+    },
+    {
+      "id": "release500_0035",
+      "category": "names_places",
+      "characters": 61,
+      "audio_seconds": 3.616,
+      "latency_seconds": 0.07891394197940826,
+      "rtf": 0.02182354590138503
+    },
+    {
+      "id": "release500_0036",
+      "category": "narrative",
+      "characters": 73,
+      "audio_seconds": 4.149333333333334,
+      "latency_seconds": 0.0807820939226076,
+      "rtf": 0.019468692301399644
+    },
+    {
+      "id": "release500_0037",
+      "category": "numbers",
+      "characters": 78,
+      "audio_seconds": 4.864,
+      "latency_seconds": 0.07888713106513023,
+      "rtf": 0.01621857135385079
+    },
+    {
+      "id": "release500_0038",
+      "category": "punctuation",
+      "characters": 67,
+      "audio_seconds": 4.522666666666667,
+      "latency_seconds": 0.07885307096876204,
+      "rtf": 0.017435083498399624
+    },
+    {
+      "id": "release500_0039",
+      "category": "question",
+      "characters": 45,
+      "audio_seconds": 2.3573333333333335,
+      "latency_seconds": 0.07602165301796049,
+      "rtf": 0.03224900439110315
+    },
+    {
+      "id": "release500_0040",
+      "category": "rare_words",
+      "characters": 82,
+      "audio_seconds": 4.810666666666667,
+      "latency_seconds": 0.08125020703300834,
+      "rtf": 0.01688959403402335
+    },
+    {
+      "id": "release500_0041",
+      "category": "short",
+      "characters": 22,
+      "audio_seconds": 1.5573333333333332,
+      "latency_seconds": 0.07831234799232334,
+      "rtf": 0.05028618235808434
+    },
+    {
+      "id": "release500_0042",
+      "category": "technical",
+      "characters": 66,
+      "audio_seconds": 3.7226666666666666,
+      "latency_seconds": 0.0798298679292202,
+      "rtf": 0.021444269680127203
+    },
+    {
+      "id": "release500_0043",
+      "category": "conversational",
+      "characters": 67,
+      "audio_seconds": 3.968,
+      "latency_seconds": 0.07586761203128844,
+      "rtf": 0.019119861903046483
+    },
+    {
+      "id": "release500_0044",
+      "category": "descriptive",
+      "characters": 73,
+      "audio_seconds": 3.989333333333333,
+      "latency_seconds": 0.07513942802324891,
+      "rtf": 0.0188350838962021
+    },
+    {
+      "id": "release500_0045",
+      "category": "emotional",
+      "characters": 70,
+      "audio_seconds": 4.1386666666666665,
+      "latency_seconds": 0.0746721139876172,
+      "rtf": 0.01804255331530699
+    },
+    {
+      "id": "release500_0046",
+      "category": "homographs",
+      "characters": 51,
+      "audio_seconds": 2.9546666666666668,
+      "latency_seconds": 0.07889968191739172,
+      "rtf": 0.0267034122012833
+    },
+    {
+      "id": "release500_0047",
+      "category": "long",
+      "characters": 161,
+      "audio_seconds": 8.192,
+      "latency_seconds": 0.08193162304814905,
+      "rtf": 0.010001418829119757
+    },
+    {
+      "id": "release500_0048",
+      "category": "long_range",
+      "characters": 124,
+      "audio_seconds": 7.424,
+      "latency_seconds": 0.08024143101647496,
+      "rtf": 0.010808382410624321
+    },
+    {
+      "id": "release500_0049",
+      "category": "names_places",
+      "characters": 59,
+      "audio_seconds": 3.296,
+      "latency_seconds": 0.07770149398129433,
+      "rtf": 0.02357448239723736
+    },
+    {
+      "id": "release500_0050",
+      "category": "narrative",
+      "characters": 99,
+      "audio_seconds": 5.578666666666667,
+      "latency_seconds": 0.07743225304875523,
+      "rtf": 0.013880064480536906
+    }
+  ]
+}

evaluation/final/runtime/inflect-nano-v2_cpu.json

@@ -0,0 +1,435 @@
+{
+  "format": "inflect_tts_runtime_v2",
+  "system": "inflect-nano-v2",
+  "provider": "cpu",
+  "hardware": {
+    "platform": "Linux-5.15.0-164-generic-x86_64-with-glibc2.39",
+    "processor": "AMD EPYC 7K62 48-Core Processor",
+    "logical_cpus_visible": 192,
+    "process_cpu_affinity_count": 192
+  },
+  "runtime_protocol": {
+    "python": "3.12.13",
+    "single_process": true,
+    "concurrent_synthesis_requests": 1,
+    "warmup_utterances": 3,
+    "thread_policy": "runtime default",
+    "environment_threads": {
+      "OMP_NUM_THREADS": null,
+      "MKL_NUM_THREADS": null,
+      "OPENBLAS_NUM_THREADS": null
+    }
+  },
+  "utterances": 50,
+  "load_seconds": 0.8181002410128713,
+  "peak_process_rss_bytes_observed": 1150877696,
+  "total_latency_seconds": 120.06641951797064,
+  "total_audio_seconds": 222.32533333333333,
+  "rtf": 0.5400483054171543,
+  "realtime_multiple": 1.851686210231807,
+  "latency_mean_seconds": 2.4013283903594127,
+  "latency_median_seconds": 2.198900554445572,
+  "latency_p95_seconds": 3.8496124872122888,
+  "rows": [
+    {
+      "id": "release500_0001",
+      "category": "conversational",
+      "characters": 65,
+      "audio_seconds": 3.8186666666666667,
+      "latency_seconds": 2.0938689078902826,
+      "rtf": 0.5483246092589776
+    },
+    {
+      "id": "release500_0002",
+      "category": "descriptive",
+      "characters": 72,
+      "audio_seconds": 3.9146666666666667,
+      "latency_seconds": 1.9025521680014208,
+      "rtf": 0.486006173706085
+    },
+    {
+      "id": "release500_0003",
+      "category": "emotional",
+      "characters": 68,
+      "audio_seconds": 3.936,
+      "latency_seconds": 1.997848630999215,
+      "rtf": 0.5075834936481746
+    },
+    {
+      "id": "release500_0004",
+      "category": "homographs",
+      "characters": 73,
+      "audio_seconds": 4.277333333333333,
+      "latency_seconds": 2.599528755992651,
+      "rtf": 0.6077451892127458
+    },
+    {
+      "id": "release500_0005",
+      "category": "long",
+      "characters": 154,
+      "audio_seconds": 8.554666666666666,
+      "latency_seconds": 3.9026208410505205,
+      "rtf": 0.45619788509786324
+    },
+    {
+      "id": "release500_0006",
+      "category": "long_range",
+      "characters": 122,
+      "audio_seconds": 6.08,
+      "latency_seconds": 2.8900271879974753,
+      "rtf": 0.4753334190785321
+    },
+    {
+      "id": "release500_0007",
+      "category": "names_places",
+      "characters": 62,
+      "audio_seconds": 3.712,
+      "latency_seconds": 2.115930248051882,
+      "rtf": 0.5700243125139768
+    },
+    {
+      "id": "release500_0008",
+      "category": "narrative",
+      "characters": 76,
+      "audio_seconds": 4.394666666666667,
+      "latency_seconds": 2.391370235942304,
+      "rtf": 0.5441528146106578
+    },
+    {
+      "id": "release500_0009",
+      "category": "numbers",
+      "characters": 79,
+      "audio_seconds": 4.832,
+      "latency_seconds": 2.300934116006829,
+      "rtf": 0.47618669619346626
+    },
+    {
+      "id": "release500_0010",
+      "category": "punctuation",
+      "characters": 75,
+      "audio_seconds": 5.237333333333333,
+      "latency_seconds": 2.598541219951585,
+      "rtf": 0.4961573103268047
+    },
+    {
+      "id": "release500_0011",
+      "category": "question",
+      "characters": 47,
+      "audio_seconds": 2.592,
+      "latency_seconds": 1.602590127964504,
+      "rtf": 0.6182832283813673
+    },
+    {
+      "id": "release500_0012",
+      "category": "rare_words",
+      "characters": 87,
+      "audio_seconds": 5.237333333333333,
+      "latency_seconds": 1.9964147580321878,
+      "rtf": 0.3811891722311968
+    },
+    {
+      "id": "release500_0013",
+      "category": "short",
+      "characters": 15,
+      "audio_seconds": 1.312,
+      "latency_seconds": 1.1853064630413428,
+      "rtf": 0.9034348041473649
+    },
+    {
+      "id": "release500_0014",
+      "category": "technical",
+      "characters": 71,
+      "audio_seconds": 4.042666666666666,
+      "latency_seconds": 2.103942258981988,
+      "rtf": 0.5204342659091329
+    },
+    {
+      "id": "release500_0015",
+      "category": "conversational",
+      "characters": 64,
+      "audio_seconds": 4.010666666666666,
+      "latency_seconds": 2.0950683309929445,
+      "rtf": 0.5223740851877355
+    },
+    {
+      "id": "release500_0016",
+      "category": "descriptive",
+      "characters": 88,
+      "audio_seconds": 4.682666666666667,
+      "latency_seconds": 2.417497629998252,
+      "rtf": 0.5162651544700139
+    },
+    {
+      "id": "release500_0017",
+      "category": "emotional",
+      "characters": 74,
+      "audio_seconds": 4.416,
+      "latency_seconds": 2.184509124024771,
+      "rtf": 0.4946805081577833
+    },
+    {
+      "id": "release500_0018",
+      "category": "homographs",
+      "characters": 57,
+      "audio_seconds": 3.296,
+      "latency_seconds": 2.5033166700741276,
+      "rtf": 0.7595014168914223
+    },
+    {
+      "id": "release500_0019",
+      "category": "long",
+      "characters": 148,
+      "audio_seconds": 8.042666666666667,
+      "latency_seconds": 3.905849251896143,
+      "rtf": 0.4856410707762114
+    },
+    {
+      "id": "release500_0020",
+      "category": "long_range",
+      "characters": 124,
+      "audio_seconds": 6.261333333333333,
+      "latency_seconds": 3.686978467972949,
+      "rtf": 0.5888487757622897
+    },
+    {
+      "id": "release500_0021",
+      "category": "names_places",
+      "characters": 72,
+      "audio_seconds": 3.9146666666666667,
+      "latency_seconds": 2.1086044320836663,
+      "rtf": 0.538642140348348
+    },
+    {
+      "id": "release500_0022",
+      "category": "narrative",
+      "characters": 52,
+      "audio_seconds": 3.36,
+      "latency_seconds": 2.1903822059975937,
+      "rtf": 0.6518994660707125
+    },
+    {
+      "id": "release500_0023",
+      "category": "numbers",
+      "characters": 80,
+      "audio_seconds": 4.373333333333333,
+      "latency_seconds": 2.2107359810033813,
+      "rtf": 0.5055036541928464
+    },
+    {
+      "id": "release500_0024",
+      "category": "punctuation",
+      "characters": 73,
+      "audio_seconds": 4.48,
+      "latency_seconds": 2.198668733937666,
+      "rtf": 0.49077427096822895
+    },
+    {
+      "id": "release500_0025",
+      "category": "question",
+      "characters": 39,
+      "audio_seconds": 2.2506666666666666,
+      "latency_seconds": 1.4954689289443195,
+      "rtf": 0.6644559814622273
+    },
+    {
+      "id": "release500_0026",
+      "category": "rare_words",
+      "characters": 78,
+      "audio_seconds": 4.469333333333333,
+      "latency_seconds": 2.4929266630206257,
+      "rtf": 0.5577849037188154
+    },
+    {
+      "id": "release500_0027",
+      "category": "short",
+      "characters": 25,
+      "audio_seconds": 1.664,
+      "latency_seconds": 1.3080715850228444,
+      "rtf": 0.7861007121531517
+    },
+    {
+      "id": "release500_0028",
+      "category": "technical",
+      "characters": 82,
+      "audio_seconds": 5.408,
+      "latency_seconds": 3.5919066730421036,
+      "rtf": 0.6641839262281996
+    },
+    {
+      "id": "release500_0029",
+      "category": "conversational",
+      "characters": 59,
+      "audio_seconds": 3.2213333333333334,
+      "latency_seconds": 2.0987192390020937,
+      "rtf": 0.6515063862796234
+    },
+    {
+      "id": "release500_0030",
+      "category": "descriptive",
+      "characters": 65,
+      "audio_seconds": 3.584,
+      "latency_seconds": 2.508352129952982,
+      "rtf": 0.6998750362592026
+    },
+    {
+      "id": "release500_0031",
+      "category": "emotional",
+      "characters": 70,
+      "audio_seconds": 4.192,
+      "latency_seconds": 2.20036614802666,
+      "rtf": 0.5248965047773521
+    },
+    {
+      "id": "release500_0032",
+      "category": "homographs",
+      "characters": 60,
+      "audio_seconds": 3.392,
+      "latency_seconds": 2.105842662975192,
+      "rtf": 0.6208262567733467
+    },
+    {
+      "id": "release500_0033",
+      "category": "long",
+      "characters": 138,
+      "audio_seconds": 7.488,
+      "latency_seconds": 3.3983870500233024,
+      "rtf": 0.4538444244155051
+    },
+    {
+      "id": "release500_0034",
+      "category": "long_range",
+      "characters": 141,
+      "audio_seconds": 7.925333333333334,
+      "latency_seconds": 3.9016301400261,
+      "rtf": 0.4922985540073309
+    },
+    {
+      "id": "release500_0035",
+      "category": "names_places",
+      "characters": 61,
+      "audio_seconds": 3.616,
+      "latency_seconds": 2.5880198520608246,
+      "rtf": 0.7157134546628386
+    },
+    {
+      "id": "release500_0036",
+      "category": "narrative",
+      "characters": 73,
+      "audio_seconds": 4.330666666666667,
+      "latency_seconds": 2.1991323749534786,
+      "rtf": 0.5078045816548981
+    },
+    {
+      "id": "release500_0037",
+      "category": "numbers",
+      "characters": 78,
+      "audio_seconds": 4.8533333333333335,
+      "latency_seconds": 2.8947273320518434,
+      "rtf": 0.5964410711645282
+    },
+    {
+      "id": "release500_0038",
+      "category": "punctuation",
+      "characters": 67,
+      "audio_seconds": 4.48,
+      "latency_seconds": 2.0181909929960966,
+      "rtf": 0.45048906093662866
+    },
+    {
+      "id": "release500_0039",
+      "category": "question",
+      "characters": 45,
+      "audio_seconds": 2.4,
+      "latency_seconds": 1.6960625349311158,
+      "rtf": 0.7066927228879649
+    },
+    {
+      "id": "release500_0040",
+      "category": "rare_words",
+      "characters": 82,
+      "audio_seconds": 4.810666666666667,
+      "latency_seconds": 3.0932381650200114,
+      "rtf": 0.6429957382940711
+    },
+    {
+      "id": "release500_0041",
+      "category": "short",
+      "characters": 22,
+      "audio_seconds": 1.664,
+      "latency_seconds": 1.2055845750728622,
+      "rtf": 0.7245099609812874
+    },
+    {
+      "id": "release500_0042",
+      "category": "technical",
+      "characters": 66,
+      "audio_seconds": 3.7226666666666666,
+      "latency_seconds": 2.100191844976507,
+      "rtf": 0.5641632821391047
+    },
+    {
+      "id": "release500_0043",
+      "category": "conversational",
+      "characters": 67,
+      "audio_seconds": 3.989333333333333,
+      "latency_seconds": 2.0950018709991127,
+      "rtf": 0.5251508700699647
+    },
+    {
+      "id": "release500_0044",
+      "category": "descriptive",
+      "characters": 73,
+      "audio_seconds": 4.096,
+      "latency_seconds": 2.099300976959057,
+      "rtf": 0.5125246525778948
+    },
+    {
+      "id": "release500_0045",
+      "category": "emotional",
+      "characters": 70,
+      "audio_seconds": 4.277333333333333,
+      "latency_seconds": 2.092912381980568,
+      "rtf": 0.48930308182214033
+    },
+    {
+      "id": "release500_0046",
+      "category": "homographs",
+      "characters": 51,
+      "audio_seconds": 3.029333333333333,
+      "latency_seconds": 2.311870877048932,
+      "rtf": 0.763161601138512
+    },
+    {
+      "id": "release500_0047",
+      "category": "long",
+      "characters": 161,
+      "audio_seconds": 8.32,
+      "latency_seconds": 3.4095809039426968,
+      "rtf": 0.40980539710849717
+    },
+    {
+      "id": "release500_0048",
+      "category": "long_range",
+      "characters": 124,
+      "audio_seconds": 7.541333333333333,
+      "latency_seconds": 3.786035355995409,
+      "rtf": 0.5020379273331961
+    },
+    {
+      "id": "release500_0049",
+      "category": "names_places",
+      "characters": 59,
+      "audio_seconds": 3.296,
+      "latency_seconds": 1.7006213270360604,
+      "rtf": 0.5159652084454067
+    },
+    {
+      "id": "release500_0050",
+      "category": "narrative",
+      "characters": 99,
+      "audio_seconds": 5.525333333333333,
+      "latency_seconds": 2.4911901840241626,
+      "rtf": 0.45086694932869736
+    }
+  ]
+}

evaluation/final/runtime/inflect-nano-v2_cuda.json

@@ -0,0 +1,435 @@
+{
+  "format": "inflect_tts_runtime_v2",
+  "system": "inflect-nano-v2",
+  "provider": "cuda:0",
+  "hardware": {
+    "platform": "Linux-5.15.0-164-generic-x86_64-with-glibc2.39",
+    "processor": "AMD EPYC 7K62 48-Core Processor",
+    "logical_cpus_visible": 192,
+    "process_cpu_affinity_count": 192
+  },
+  "runtime_protocol": {
+    "python": "3.12.13",
+    "single_process": true,
+    "concurrent_synthesis_requests": 1,
+    "warmup_utterances": 3,
+    "thread_policy": "runtime default",
+    "environment_threads": {
+      "OMP_NUM_THREADS": null,
+      "MKL_NUM_THREADS": null,
+      "OPENBLAS_NUM_THREADS": null
+    }
+  },
+  "utterances": 50,
+  "load_seconds": 1.134770458098501,
+  "peak_process_rss_bytes_observed": 2056933376,
+  "total_latency_seconds": 3.8063662480562925,
+  "total_audio_seconds": 222.336,
+  "rtf": 0.017119882736292332,
+  "realtime_multiple": 58.41161504454153,
+  "latency_mean_seconds": 0.07612732496112586,
+  "latency_median_seconds": 0.08017795148771256,
+  "latency_p95_seconds": 0.08533268054598012,
+  "rows": [
+    {
+      "id": "release500_0001",
+      "category": "conversational",
+      "characters": 65,
+      "audio_seconds": 3.8186666666666667,
+      "latency_seconds": 0.04942051297985017,
+      "rtf": 0.012941824278941211
+    },
+    {
+      "id": "release500_0002",
+      "category": "descriptive",
+      "characters": 72,
+      "audio_seconds": 3.9146666666666667,
+      "latency_seconds": 0.04680548293981701,
+      "rtf": 0.011956441486669876
+    },
+    {
+      "id": "release500_0003",
+      "category": "emotional",
+      "characters": 68,
+      "audio_seconds": 3.936,
+      "latency_seconds": 0.04691432497929782,
+      "rtf": 0.011919289882951682
+    },
+    {
+      "id": "release500_0004",
+      "category": "homographs",
+      "characters": 73,
+      "audio_seconds": 4.277333333333333,
+      "latency_seconds": 0.07740856392774731,
+      "rtf": 0.01809738869881873
+    },
+    {
+      "id": "release500_0005",
+      "category": "long",
+      "characters": 154,
+      "audio_seconds": 8.554666666666666,
+      "latency_seconds": 0.08167363703250885,
+      "rtf": 0.009547261186780181
+    },
+    {
+      "id": "release500_0006",
+      "category": "long_range",
+      "characters": 122,
+      "audio_seconds": 6.08,
+      "latency_seconds": 0.08220798010006547,
+      "rtf": 0.0135210493585634
+    },
+    {
+      "id": "release500_0007",
+      "category": "names_places",
+      "characters": 62,
+      "audio_seconds": 3.712,
+      "latency_seconds": 0.08025681599974632,
+      "rtf": 0.02162090948269028
+    },
+    {
+      "id": "release500_0008",
+      "category": "narrative",
+      "characters": 76,
+      "audio_seconds": 4.394666666666667,
+      "latency_seconds": 0.07967076206114143,
+      "rtf": 0.01812896588163109
+    },
+    {
+      "id": "release500_0009",
+      "category": "numbers",
+      "characters": 79,
+      "audio_seconds": 4.842666666666666,
+      "latency_seconds": 0.08031120605301112,
+      "rtf": 0.016584087153017166
+    },
+    {
+      "id": "release500_0010",
+      "category": "punctuation",
+      "characters": 75,
+      "audio_seconds": 5.237333333333333,
+      "latency_seconds": 0.08229893201496452,
+      "rtf": 0.015713899951940783
+    },
+    {
+      "id": "release500_0011",
+      "category": "question",
+      "characters": 47,
+      "audio_seconds": 2.592,
+      "latency_seconds": 0.08002236403990537,
+      "rtf": 0.03087282563267954
+    },
+    {
+      "id": "release500_0012",
+      "category": "rare_words",
+      "characters": 87,
+      "audio_seconds": 5.237333333333333,
+      "latency_seconds": 0.054644892923533916,
+      "rtf": 0.010433724463505713
+    },
+    {
+      "id": "release500_0013",
+      "category": "short",
+      "characters": 15,
+      "audio_seconds": 1.312,
+      "latency_seconds": 0.07893307704944164,
+      "rtf": 0.06016240628768417
+    },
+    {
+      "id": "release500_0014",
+      "category": "technical",
+      "characters": 71,
+      "audio_seconds": 4.042666666666666,
+      "latency_seconds": 0.07632543705403805,
+      "rtf": 0.018879972886058225
+    },
+    {
+      "id": "release500_0015",
+      "category": "conversational",
+      "characters": 64,
+      "audio_seconds": 4.010666666666666,
+      "latency_seconds": 0.0801429869607091,
+      "rtf": 0.01998246017969808
+    },
+    {
+      "id": "release500_0016",
+      "category": "descriptive",
+      "characters": 88,
+      "audio_seconds": 4.682666666666667,
+      "latency_seconds": 0.08000801503658295,
+      "rtf": 0.017085994099498066
+    },
+    {
+      "id": "release500_0017",
+      "category": "emotional",
+      "characters": 74,
+      "audio_seconds": 4.416,
+      "latency_seconds": 0.08057157904841006,
+      "rtf": 0.018245375690310248
+    },
+    {
+      "id": "release500_0018",
+      "category": "homographs",
+      "characters": 57,
+      "audio_seconds": 3.296,
+      "latency_seconds": 0.08493342192377895,
+      "rtf": 0.025768635292408665
+    },
+    {
+      "id": "release500_0019",
+      "category": "long",
+      "characters": 148,
+      "audio_seconds": 8.042666666666667,
+      "latency_seconds": 0.08139500499237329,
+      "rtf": 0.010120400156545086
+    },
+    {
+      "id": "release500_0020",
+      "category": "long_range",
+      "characters": 124,
+      "audio_seconds": 6.261333333333333,
+      "latency_seconds": 0.08021291601471603,
+      "rtf": 0.012810836245961887
+    },
+    {
+      "id": "release500_0021",
+      "category": "names_places",
+      "characters": 72,
+      "audio_seconds": 3.9146666666666667,
+      "latency_seconds": 0.04882463894318789,
+      "rtf": 0.012472234062462846
+    },
+    {
+      "id": "release500_0022",
+      "category": "narrative",
+      "characters": 52,
+      "audio_seconds": 3.36,
+      "latency_seconds": 0.07994115399196744,
+      "rtf": 0.023792010116656978
+    },
+    {
+      "id": "release500_0023",
+      "category": "numbers",
+      "characters": 80,
+      "audio_seconds": 4.373333333333333,
+      "latency_seconds": 0.07966464199125767,
+      "rtf": 0.018216000455318064
+    },
+    {
+      "id": "release500_0024",
+      "category": "punctuation",
+      "characters": 73,
+      "audio_seconds": 4.48,
+      "latency_seconds": 0.08553015603683889,
+      "rtf": 0.019091552686794393
+    },
+    {
+      "id": "release500_0025",
+      "category": "question",
+      "characters": 39,
+      "audio_seconds": 2.2506666666666666,
+      "latency_seconds": 0.08513779402710497,
+      "rtf": 0.037827811327208964
+    },
+    {
+      "id": "release500_0026",
+      "category": "rare_words",
+      "characters": 78,
+      "audio_seconds": 4.469333333333333,
+      "latency_seconds": 0.08534105506259948,
+      "rtf": 0.019094806472836998
+    },
+    {
+      "id": "release500_0027",
+      "category": "short",
+      "characters": 25,
+      "audio_seconds": 1.664,
+      "latency_seconds": 0.08196098997723311,
+      "rtf": 0.04925540263054875
+    },
+    {
+      "id": "release500_0028",
+      "category": "technical",
+      "characters": 82,
+      "audio_seconds": 5.408,
+      "latency_seconds": 0.07822538097389042,
+      "rtf": 0.0144647523990182
+    },
+    {
+      "id": "release500_0029",
+      "category": "conversational",
+      "characters": 59,
+      "audio_seconds": 3.2213333333333334,
+      "latency_seconds": 0.08341424097307026,
+      "rtf": 0.025894321494123632
+    },
+    {
+      "id": "release500_0030",
+      "category": "descriptive",
+      "characters": 65,
+      "audio_seconds": 3.584,
+      "latency_seconds": 0.07971176307182759,
+      "rtf": 0.022241005321380465
+    },
+    {
+      "id": "release500_0031",
+      "category": "emotional",
+      "characters": 70,
+      "audio_seconds": 4.192,
+      "latency_seconds": 0.0786138839321211,
+      "rtf": 0.018753312006708277
+    },
+    {
+      "id": "release500_0032",
+      "category": "homographs",
+      "characters": 60,
+      "audio_seconds": 3.392,
+      "latency_seconds": 0.08283164701424539,
+      "rtf": 0.024419707256558194
+    },
+    {
+      "id": "release500_0033",
+      "category": "long",
+      "characters": 138,
+      "audio_seconds": 7.488,
+      "latency_seconds": 0.08182703901547939,
+      "rtf": 0.010927756278776627
+    },
+    {
+      "id": "release500_0034",
+      "category": "long_range",
+      "characters": 141,
+      "audio_seconds": 7.925333333333334,
+      "latency_seconds": 0.0841277859872207,
+      "rtf": 0.010615047020594806
+    },
+    {
+      "id": "release500_0035",
+      "category": "names_places",
+      "characters": 61,
+      "audio_seconds": 3.616,
+      "latency_seconds": 0.07797851006034762,
+      "rtf": 0.021564853445892592
+    },
+    {
+      "id": "release500_0036",
+      "category": "narrative",
+      "characters": 73,
+      "audio_seconds": 4.330666666666667,
+      "latency_seconds": 0.08304073801264167,
+      "rtf": 0.019175047262771323
+    },
+    {
+      "id": "release500_0037",
+      "category": "numbers",
+      "characters": 78,
+      "audio_seconds": 4.8533333333333335,
+      "latency_seconds": 0.08161148696672171,
+      "rtf": 0.0168155536332531
+    },
+    {
+      "id": "release500_0038",
+      "category": "punctuation",
+      "characters": 67,
+      "audio_seconds": 4.48,
+      "latency_seconds": 0.05729794304352254,
+      "rtf": 0.012789719429357707
+    },
+    {
+      "id": "release500_0039",
+      "category": "question",
+      "characters": 45,
+      "audio_seconds": 2.4,
+      "latency_seconds": 0.07556979195214808,
+      "rtf": 0.03148741331339504
+    },
+    {
+      "id": "release500_0040",
+      "category": "rare_words",
+      "characters": 82,
+      "audio_seconds": 4.810666666666667,
+      "latency_seconds": 0.08266812597867101,
+      "rtf": 0.01718433882594325
+    },
+    {
+      "id": "release500_0041",
+      "category": "short",
+      "characters": 22,
+      "audio_seconds": 1.664,
+      "latency_seconds": 0.06732171995099634,
+      "rtf": 0.04045776439362761
+    },
+    {
+      "id": "release500_0042",
+      "category": "technical",
+      "characters": 66,
+      "audio_seconds": 3.7226666666666666,
+      "latency_seconds": 0.0855242470279336,
+      "rtf": 0.022973920225985028
+    },
+    {
+      "id": "release500_0043",
+      "category": "conversational",
+      "characters": 67,
+      "audio_seconds": 3.989333333333333,
+      "latency_seconds": 0.08532244502566755,
+      "rtf": 0.021387644976353832
+    },
+    {
+      "id": "release500_0044",
+      "category": "descriptive",
+      "characters": 73,
+      "audio_seconds": 4.096,
+      "latency_seconds": 0.07581165398005396,
+      "rtf": 0.01850870458497411
+    },
+    {
+      "id": "release500_0045",
+      "category": "emotional",
+      "characters": 70,
+      "audio_seconds": 4.277333333333333,
+      "latency_seconds": 0.05196285399142653,
+      "rtf": 0.012148422847122786
+    },
+    {
+      "id": "release500_0046",
+      "category": "homographs",
+      "characters": 51,
+      "audio_seconds": 3.029333333333333,
+      "latency_seconds": 0.08275181602220982,
+      "rtf": 0.027316840676345672
+    },
+    {
+      "id": "release500_0047",
+      "category": "long",
+      "characters": 161,
+      "audio_seconds": 8.32,
+      "latency_seconds": 0.08377629390452057,
+      "rtf": 0.010069266094293337
+    },
+    {
+      "id": "release500_0048",
+      "category": "long_range",
+      "characters": 124,
+      "audio_seconds": 7.541333333333333,
+      "latency_seconds": 0.08156393701210618,
+      "rtf": 0.010815585707050854
+    },
+    {
+      "id": "release500_0049",
+      "category": "names_places",
+      "characters": 59,
+      "audio_seconds": 3.296,
+      "latency_seconds": 0.05478874500840902,
+      "rtf": 0.01662279884963866
+    },
+    {
+      "id": "release500_0050",
+      "category": "narrative",
+      "characters": 99,
+      "audio_seconds": 5.525333333333333,
+      "latency_seconds": 0.08006585598923266,
+      "rtf": 0.014490683395734675
+    }
+  ]
+}

evaluation/final/runtime/kitten-nano-bruno_cpu.json

@@ -0,0 +1,435 @@
+{
+  "format": "inflect_tts_runtime_v2",
+  "system": "kitten-nano-bruno",
+  "provider": "CPUExecutionProvider",
+  "hardware": {
+    "platform": "Linux-5.15.0-164-generic-x86_64-with-glibc2.39",
+    "processor": "AMD EPYC 7K62 48-Core Processor",
+    "logical_cpus_visible": 192,
+    "process_cpu_affinity_count": 192
+  },
+  "runtime_protocol": {
+    "python": "3.12.13",
+    "single_process": true,
+    "concurrent_synthesis_requests": 1,
+    "warmup_utterances": 3,
+    "thread_policy": "runtime default",
+    "environment_threads": {
+      "OMP_NUM_THREADS": null,
+      "MKL_NUM_THREADS": null,
+      "OPENBLAS_NUM_THREADS": null
+    }
+  },
+  "utterances": 50,
+  "load_seconds": 5.438336415099911,
+  "peak_process_rss_bytes_observed": 869437440,
+  "total_latency_seconds": 352.9463603061158,
+  "total_audio_seconds": 289.0083333333333,
+  "rtf": 1.221232468404426,
+  "realtime_multiple": 0.8188449176318802,
+  "latency_mean_seconds": 7.058927206122316,
+  "latency_median_seconds": 6.058434111531824,
+  "latency_p95_seconds": 12.925248358043607,
+  "rows": [
+    {
+      "id": "release500_0001",
+      "category": "conversational",
+      "characters": 65,
+      "audio_seconds": 4.466666666666667,
+      "latency_seconds": 5.300024807918817,
+      "rtf": 1.18657271819078
+    },
+    {
+      "id": "release500_0002",
+      "category": "descriptive",
+      "characters": 72,
+      "audio_seconds": 5.191666666666666,
+      "latency_seconds": 5.906638064072467,
+      "rtf": 1.1377151969320964
+    },
+    {
+      "id": "release500_0003",
+      "category": "emotional",
+      "characters": 68,
+      "audio_seconds": 5.091666666666667,
+      "latency_seconds": 5.607375220977701,
+      "rtf": 1.1012848224506124
+    },
+    {
+      "id": "release500_0004",
+      "category": "homographs",
+      "characters": 73,
+      "audio_seconds": 4.816666666666666,
+      "latency_seconds": 5.402876124018803,
+      "rtf": 1.1217043856094402
+    },
+    {
+      "id": "release500_0005",
+      "category": "long",
+      "characters": 154,
+      "audio_seconds": 10.391666666666667,
+      "latency_seconds": 17.092095594038256,
+      "rtf": 1.6447886698352772
+    },
+    {
+      "id": "release500_0006",
+      "category": "long_range",
+      "characters": 122,
+      "audio_seconds": 8.491666666666667,
+      "latency_seconds": 10.807843701913953,
+      "rtf": 1.2727588265256862
+    },
+    {
+      "id": "release500_0007",
+      "category": "names_places",
+      "characters": 62,
+      "audio_seconds": 4.591666666666667,
+      "latency_seconds": 4.80041568307206,
+      "rtf": 1.0454625807053488
+    },
+    {
+      "id": "release500_0008",
+      "category": "narrative",
+      "characters": 76,
+      "audio_seconds": 4.466666666666667,
+      "latency_seconds": 5.209607672994025,
+      "rtf": 1.1663300760434385
+    },
+    {
+      "id": "release500_0009",
+      "category": "numbers",
+      "characters": 79,
+      "audio_seconds": 6.241666666666666,
+      "latency_seconds": 6.898631828022189,
+      "rtf": 1.1052547655042226
+    },
+    {
+      "id": "release500_0010",
+      "category": "punctuation",
+      "characters": 75,
+      "audio_seconds": 5.516666666666667,
+      "latency_seconds": 5.696966647054069,
+      "rtf": 1.0326827759010397
+    },
+    {
+      "id": "release500_0011",
+      "category": "question",
+      "characters": 47,
+      "audio_seconds": 3.5166666666666666,
+      "latency_seconds": 3.996714084991254,
+      "rtf": 1.1365063748790296
+    },
+    {
+      "id": "release500_0012",
+      "category": "rare_words",
+      "characters": 87,
+      "audio_seconds": 7.716666666666667,
+      "latency_seconds": 8.702201059088111,
+      "rtf": 1.1277150400546148
+    },
+    {
+      "id": "release500_0013",
+      "category": "short",
+      "characters": 15,
+      "audio_seconds": 2.2916666666666665,
+      "latency_seconds": 3.193404796998948,
+      "rtf": 1.3934857295995409
+    },
+    {
+      "id": "release500_0014",
+      "category": "technical",
+      "characters": 71,
+      "audio_seconds": 5.416666666666667,
+      "latency_seconds": 5.81113522592932,
+      "rtf": 1.0728249647869512
+    },
+    {
+      "id": "release500_0015",
+      "category": "conversational",
+      "characters": 64,
+      "audio_seconds": 5.516666666666667,
+      "latency_seconds": 6.312843861989677,
+      "rtf": 1.144322150209609
+    },
+    {
+      "id": "release500_0016",
+      "category": "descriptive",
+      "characters": 88,
+      "audio_seconds": 6.966666666666667,
+      "latency_seconds": 7.810967399040237,
+      "rtf": 1.1211914926852016
+    },
+    {
+      "id": "release500_0017",
+      "category": "emotional",
+      "characters": 74,
+      "audio_seconds": 6.6,
+      "latency_seconds": 9.698659825953655,
+      "rtf": 1.4694939130232811
+    },
+    {
+      "id": "release500_0018",
+      "category": "homographs",
+      "characters": 57,
+      "audio_seconds": 4.541666666666667,
+      "latency_seconds": 5.595242522074841,
+      "rtf": 1.2319800048605154
+    },
+    {
+      "id": "release500_0019",
+      "category": "long",
+      "characters": 148,
+      "audio_seconds": 9.266666666666667,
+      "latency_seconds": 12.596226043067873,
+      "rtf": 1.359304968676389
+    },
+    {
+      "id": "release500_0020",
+      "category": "long_range",
+      "characters": 124,
+      "audio_seconds": 8.566666666666666,
+      "latency_seconds": 10.007063591037877,
+      "rtf": 1.1681397187981957
+    },
+    {
+      "id": "release500_0021",
+      "category": "names_places",
+      "characters": 72,
+      "audio_seconds": 5.616666666666666,
+      "latency_seconds": 6.298295221058652,
+      "rtf": 1.1213581995950124
+    },
+    {
+      "id": "release500_0022",
+      "category": "narrative",
+      "characters": 52,
+      "audio_seconds": 4.958333333333333,
+      "latency_seconds": 6.299905651016161,
+      "rtf": 1.270569206927629
+    },
+    {
+      "id": "release500_0023",
+      "category": "numbers",
+      "characters": 80,
+      "audio_seconds": 6.691666666666666,
+      "latency_seconds": 8.79705324396491,
+      "rtf": 1.3146281311031
+    },
+    {
+      "id": "release500_0024",
+      "category": "punctuation",
+      "characters": 73,
+      "audio_seconds": 5.516666666666667,
+      "latency_seconds": 6.393836776027456,
+      "rtf": 1.1590036452013515
+    },
+    {
+      "id": "release500_0025",
+      "category": "question",
+      "characters": 39,
+      "audio_seconds": 2.7916666666666665,
+      "latency_seconds": 3.5986495160032064,
+      "rtf": 1.2890684833444321
+    },
+    {
+      "id": "release500_0026",
+      "category": "rare_words",
+      "characters": 78,
+      "audio_seconds": 5.916666666666667,
+      "latency_seconds": 6.21023015899118,
+      "rtf": 1.0496163648999177
+    },
+    {
+      "id": "release500_0027",
+      "category": "short",
+      "characters": 25,
+      "audio_seconds": 2.2666666666666666,
+      "latency_seconds": 3.4987704240484163,
+      "rtf": 1.5435751870801837
+    },
+    {
+      "id": "release500_0028",
+      "category": "technical",
+      "characters": 82,
+      "audio_seconds": 7.266666666666667,
+      "latency_seconds": 9.396384562947787,
+      "rtf": 1.293080444442356
+    },
+    {
+      "id": "release500_0029",
+      "category": "conversational",
+      "characters": 59,
+      "audio_seconds": 3.3666666666666667,
+      "latency_seconds": 4.191818989929743,
+      "rtf": 1.245094749484082
+    },
+    {
+      "id": "release500_0030",
+      "category": "descriptive",
+      "characters": 65,
+      "audio_seconds": 4.066666666666666,
+      "latency_seconds": 5.106989407911897,
+      "rtf": 1.255817067519319
+    },
+    {
+      "id": "release500_0031",
+      "category": "emotional",
+      "characters": 70,
+      "audio_seconds": 5.391666666666667,
+      "latency_seconds": 6.501469455077313,
+      "rtf": 1.2058366840947103
+    },
+    {
+      "id": "release500_0032",
+      "category": "homographs",
+      "characters": 60,
+      "audio_seconds": 4.341666666666667,
+      "latency_seconds": 5.193923476035707,
+      "rtf": 1.1962971537894143
+    },
+    {
+      "id": "release500_0033",
+      "category": "long",
+      "characters": 138,
+      "audio_seconds": 8.941666666666666,
+      "latency_seconds": 11.606026376015507,
+      "rtf": 1.2979712629281088
+    },
+    {
+      "id": "release500_0034",
+      "category": "long_range",
+      "characters": 141,
+      "audio_seconds": 10.141666666666667,
+      "latency_seconds": 13.194448433932848,
+      "rtf": 1.3010138143565666
+    },
+    {
+      "id": "release500_0035",
+      "category": "names_places",
+      "characters": 61,
+      "audio_seconds": 4.591666666666667,
+      "latency_seconds": 5.099241267074831,
+      "rtf": 1.1105425627023224
+    },
+    {
+      "id": "release500_0036",
+      "category": "narrative",
+      "characters": 73,
+      "audio_seconds": 6.258333333333334,
+      "latency_seconds": 6.7034384910948575,
+      "rtf": 1.0711219959139584
+    },
+    {
+      "id": "release500_0037",
+      "category": "numbers",
+      "characters": 78,
+      "audio_seconds": 6.166666666666667,
+      "latency_seconds": 6.598778676008806,
+      "rtf": 1.0700722177311577
+    },
+    {
+      "id": "release500_0038",
+      "category": "punctuation",
+      "characters": 67,
+      "audio_seconds": 5.741666666666666,
+      "latency_seconds": 5.798938066000119,
+      "rtf": 1.0099746994484968
+    },
+    {
+      "id": "release500_0039",
+      "category": "question",
+      "characters": 45,
+      "audio_seconds": 2.7916666666666665,
+      "latency_seconds": 3.3004997570533305,
+      "rtf": 1.1822685696907453
+    },
+    {
+      "id": "release500_0040",
+      "category": "rare_words",
+      "characters": 82,
+      "audio_seconds": 6.916666666666667,
+      "latency_seconds": 8.302695441059768,
+      "rtf": 1.2003897023218941
+    },
+    {
+      "id": "release500_0041",
+      "category": "short",
+      "characters": 22,
+      "audio_seconds": 4.0,
+      "latency_seconds": 7.0924176529515535,
+      "rtf": 1.7731044132378884
+    },
+    {
+      "id": "release500_0042",
+      "category": "technical",
+      "characters": 66,
+      "audio_seconds": 4.966666666666667,
+      "latency_seconds": 5.1990977770183235,
+      "rtf": 1.0467982101379174
+    },
+    {
+      "id": "release500_0043",
+      "category": "conversational",
+      "characters": 67,
+      "audio_seconds": 4.591666666666667,
+      "latency_seconds": 5.207206900930032,
+      "rtf": 1.1340559493858509
+    },
+    {
+      "id": "release500_0044",
+      "category": "descriptive",
+      "characters": 73,
+      "audio_seconds": 4.841666666666667,
+      "latency_seconds": 5.80371511192061,
+      "rtf": 1.1987019164035684
+    },
+    {
+      "id": "release500_0045",
+      "category": "emotional",
+      "characters": 70,
+      "audio_seconds": 5.166666666666667,
+      "latency_seconds": 5.406367589952424,
+      "rtf": 1.0463937270875658
+    },
+    {
+      "id": "release500_0046",
+      "category": "homographs",
+      "characters": 51,
+      "audio_seconds": 4.016666666666667,
+      "latency_seconds": 4.795131856924854,
+      "rtf": 1.1938087610601298
+    },
+    {
+      "id": "release500_0047",
+      "category": "long",
+      "characters": 161,
+      "audio_seconds": 10.616666666666667,
+      "latency_seconds": 17.103937669075094,
+      "rtf": 1.6110459342927874
+    },
+    {
+      "id": "release500_0048",
+      "category": "long_range",
+      "characters": 124,
+      "audio_seconds": 9.591666666666667,
+      "latency_seconds": 10.303501077927649,
+      "rtf": 1.0742138395754282
+    },
+    {
+      "id": "release500_0049",
+      "category": "names_places",
+      "characters": 59,
+      "audio_seconds": 4.291666666666667,
+      "latency_seconds": 4.70430923695676,
+      "rtf": 1.0961497251161383
+    },
+    {
+      "id": "release500_0050",
+      "category": "narrative",
+      "characters": 99,
+      "audio_seconds": 7.516666666666667,
+      "latency_seconds": 8.792348286951892,
+      "rtf": 1.1697137410579015
+    }
+  ]
+}

evaluation/final/runtime/kitten-nano-hugo_cpu.json

@@ -0,0 +1,435 @@
+{
+  "format": "inflect_tts_runtime_v2",
+  "system": "kitten-nano-hugo",
+  "provider": "CPUExecutionProvider",
+  "hardware": {
+    "platform": "Linux-5.15.0-164-generic-x86_64-with-glibc2.39",
+    "processor": "AMD EPYC 7K62 48-Core Processor",
+    "logical_cpus_visible": 192,
+    "process_cpu_affinity_count": 192
+  },
+  "runtime_protocol": {
+    "python": "3.12.13",
+    "single_process": true,
+    "concurrent_synthesis_requests": 1,
+    "warmup_utterances": 3,
+    "thread_policy": "runtime default",
+    "environment_threads": {
+      "OMP_NUM_THREADS": null,
+      "MKL_NUM_THREADS": null,
+      "OPENBLAS_NUM_THREADS": null
+    }
+  },
+  "utterances": 50,
+  "load_seconds": 4.554767108056694,
+  "peak_process_rss_bytes_observed": 856117248,
+  "total_latency_seconds": 302.24142166844103,
+  "total_audio_seconds": 249.45833333333334,
+  "rtf": 1.2115908000739242,
+  "realtime_multiple": 0.8253611697439315,
+  "latency_mean_seconds": 6.044828433368821,
+  "latency_median_seconds": 5.249989852018189,
+  "latency_p95_seconds": 11.035654885246185,
+  "rows": [
+    {
+      "id": "release500_0001",
+      "category": "conversational",
+      "characters": 65,
+      "audio_seconds": 4.616666666666666,
+      "latency_seconds": 5.101677575963549,
+      "rtf": 1.1050565146491445
+    },
+    {
+      "id": "release500_0002",
+      "category": "descriptive",
+      "characters": 72,
+      "audio_seconds": 4.466666666666667,
+      "latency_seconds": 5.107988019939512,
+      "rtf": 1.1435794074491445
+    },
+    {
+      "id": "release500_0003",
+      "category": "emotional",
+      "characters": 68,
+      "audio_seconds": 4.466666666666667,
+      "latency_seconds": 4.7059511069674045,
+      "rtf": 1.0535711433509114
+    },
+    {
+      "id": "release500_0004",
+      "category": "homographs",
+      "characters": 73,
+      "audio_seconds": 4.016666666666667,
+      "latency_seconds": 6.012013071915135,
+      "rtf": 1.4967667398958842
+    },
+    {
+      "id": "release500_0005",
+      "category": "long",
+      "characters": 154,
+      "audio_seconds": 9.066666666666666,
+      "latency_seconds": 12.888476280029863,
+      "rtf": 1.4215231191209408
+    },
+    {
+      "id": "release500_0006",
+      "category": "long_range",
+      "characters": 122,
+      "audio_seconds": 7.116666666666666,
+      "latency_seconds": 8.704354395973496,
+      "rtf": 1.2230942945161822
+    },
+    {
+      "id": "release500_0007",
+      "category": "names_places",
+      "characters": 62,
+      "audio_seconds": 4.516666666666667,
+      "latency_seconds": 4.905567271984182,
+      "rtf": 1.0861034550518485
+    },
+    {
+      "id": "release500_0008",
+      "category": "narrative",
+      "characters": 76,
+      "audio_seconds": 4.041666666666667,
+      "latency_seconds": 4.487603273941204,
+      "rtf": 1.110334830665865
+    },
+    {
+      "id": "release500_0009",
+      "category": "numbers",
+      "characters": 79,
+      "audio_seconds": 5.266666666666667,
+      "latency_seconds": 5.601414341945201,
+      "rtf": 1.0635596851794686
+    },
+    {
+      "id": "release500_0010",
+      "category": "punctuation",
+      "characters": 75,
+      "audio_seconds": 4.541666666666667,
+      "latency_seconds": 4.600892088958062,
+      "rtf": 1.0130404599540688
+    },
+    {
+      "id": "release500_0011",
+      "category": "question",
+      "characters": 47,
+      "audio_seconds": 3.1416666666666666,
+      "latency_seconds": 4.301539418986067,
+      "rtf": 1.3691902659902602
+    },
+    {
+      "id": "release500_0012",
+      "category": "rare_words",
+      "characters": 87,
+      "audio_seconds": 5.791666666666667,
+      "latency_seconds": 7.696081395028159,
+      "rtf": 1.328819809213495
+    },
+    {
+      "id": "release500_0013",
+      "category": "short",
+      "characters": 15,
+      "audio_seconds": 2.0416666666666665,
+      "latency_seconds": 2.905160080990754,
+      "rtf": 1.4229355498730225
+    },
+    {
+      "id": "release500_0014",
+      "category": "technical",
+      "characters": 71,
+      "audio_seconds": 4.791666666666667,
+      "latency_seconds": 5.4012861920055,
+      "rtf": 1.1272249444185392
+    },
+    {
+      "id": "release500_0015",
+      "category": "conversational",
+      "characters": 64,
+      "audio_seconds": 4.291666666666667,
+      "latency_seconds": 4.604367427993566,
+      "rtf": 1.072862313318889
+    },
+    {
+      "id": "release500_0016",
+      "category": "descriptive",
+      "characters": 88,
+      "audio_seconds": 5.416666666666667,
+      "latency_seconds": 5.203741574077867,
+      "rtf": 0.9606907521374524
+    },
+    {
+      "id": "release500_0017",
+      "category": "emotional",
+      "characters": 74,
+      "audio_seconds": 6.15,
+      "latency_seconds": 8.798334937077016,
+      "rtf": 1.4306235670043927
+    },
+    {
+      "id": "release500_0018",
+      "category": "homographs",
+      "characters": 57,
+      "audio_seconds": 4.691666666666666,
+      "latency_seconds": 5.29623812995851,
+      "rtf": 1.1288607026554551
+    },
+    {
+      "id": "release500_0019",
+      "category": "long",
+      "characters": 148,
+      "audio_seconds": 7.791666666666667,
+      "latency_seconds": 10.695122058037668,
+      "rtf": 1.3726359860583104
+    },
+    {
+      "id": "release500_0020",
+      "category": "long_range",
+      "characters": 124,
+      "audio_seconds": 6.716666666666667,
+      "latency_seconds": 8.104773966944776,
+      "rtf": 1.206666099296989
+    },
+    {
+      "id": "release500_0021",
+      "category": "names_places",
+      "characters": 72,
+      "audio_seconds": 4.841666666666667,
+      "latency_seconds": 6.794190963031724,
+      "rtf": 1.4032752419342631
+    },
+    {
+      "id": "release500_0022",
+      "category": "narrative",
+      "characters": 52,
+      "audio_seconds": 4.683333333333334,
+      "latency_seconds": 6.408877291949466,
+      "rtf": 1.368443549882448
+    },
+    {
+      "id": "release500_0023",
+      "category": "numbers",
+      "characters": 80,
+      "audio_seconds": 5.266666666666667,
+      "latency_seconds": 5.702878281008452,
+      "rtf": 1.082824990064896
+    },
+    {
+      "id": "release500_0024",
+      "category": "punctuation",
+      "characters": 73,
+      "audio_seconds": 4.691666666666666,
+      "latency_seconds": 5.099433319061063,
+      "rtf": 1.0869129632101735
+    },
+    {
+      "id": "release500_0025",
+      "category": "question",
+      "characters": 39,
+      "audio_seconds": 2.591666666666667,
+      "latency_seconds": 3.608182057971135,
+      "rtf": 1.3922245882846822
+    },
+    {
+      "id": "release500_0026",
+      "category": "rare_words",
+      "characters": 78,
+      "audio_seconds": 5.216666666666667,
+      "latency_seconds": 6.3983448159415275,
+      "rtf": 1.226519773023935
+    },
+    {
+      "id": "release500_0027",
+      "category": "short",
+      "characters": 25,
+      "audio_seconds": 1.9166666666666667,
+      "latency_seconds": 3.296886213007383,
+      "rtf": 1.7201145459168954
+    },
+    {
+      "id": "release500_0028",
+      "category": "technical",
+      "characters": 82,
+      "audio_seconds": 5.566666666666666,
+      "latency_seconds": 6.393748010974377,
+      "rtf": 1.1485774870013852
+    },
+    {
+      "id": "release500_0029",
+      "category": "conversational",
+      "characters": 59,
+      "audio_seconds": 3.316666666666667,
+      "latency_seconds": 4.3996736239641905,
+      "rtf": 1.3265347609942282
+    },
+    {
+      "id": "release500_0030",
+      "category": "descriptive",
+      "characters": 65,
+      "audio_seconds": 4.241666666666666,
+      "latency_seconds": 4.4072254449129105,
+      "rtf": 1.0390315390757354
+    },
+    {
+      "id": "release500_0031",
+      "category": "emotional",
+      "characters": 70,
+      "audio_seconds": 4.291666666666667,
+      "latency_seconds": 5.394681982928887,
+      "rtf": 1.2570132775756628
+    },
+    {
+      "id": "release500_0032",
+      "category": "homographs",
+      "characters": 60,
+      "audio_seconds": 3.8666666666666667,
+      "latency_seconds": 4.90090867492836,
+      "rtf": 1.2674763814469896
+    },
+    {
+      "id": "release500_0033",
+      "category": "long",
+      "characters": 138,
+      "audio_seconds": 8.016666666666667,
+      "latency_seconds": 9.705234821070917,
+      "rtf": 1.2106322022125882
+    },
+    {
+      "id": "release500_0034",
+      "category": "long_range",
+      "characters": 141,
+      "audio_seconds": 9.091666666666667,
+      "latency_seconds": 12.39427445398178,
+      "rtf": 1.3632565852225604
+    },
+    {
+      "id": "release500_0035",
+      "category": "names_places",
+      "characters": 61,
+      "audio_seconds": 4.241666666666666,
+      "latency_seconds": 3.802421161090024,
+      "rtf": 0.8964450674475499
+    },
+    {
+      "id": "release500_0036",
+      "category": "narrative",
+      "characters": 73,
+      "audio_seconds": 5.408333333333333,
+      "latency_seconds": 6.494442332070321,
+      "rtf": 1.2008213865153137
+    },
+    {
+      "id": "release500_0037",
+      "category": "numbers",
+      "characters": 78,
+      "audio_seconds": 5.566666666666666,
+      "latency_seconds": 5.897661359980702,
+      "rtf": 1.0594601245474315
+    },
+    {
+      "id": "release500_0038",
+      "category": "punctuation",
+      "characters": 67,
+      "audio_seconds": 4.666666666666667,
+      "latency_seconds": 4.996172650018707,
+      "rtf": 1.0706084250040087
+    },
+    {
+      "id": "release500_0039",
+      "category": "question",
+      "characters": 45,
+      "audio_seconds": 2.7916666666666665,
+      "latency_seconds": 3.90298613300547,
+      "rtf": 1.3980845849571835
+    },
+    {
+      "id": "release500_0040",
+      "category": "rare_words",
+      "characters": 82,
+      "audio_seconds": 5.491666666666666,
+      "latency_seconds": 7.097285047057085,
+      "rtf": 1.2923736049269352
+    },
+    {
+      "id": "release500_0041",
+      "category": "short",
+      "characters": 22,
+      "audio_seconds": 3.625,
+      "latency_seconds": 5.8032788060372695,
+      "rtf": 1.6009044982171778
+    },
+    {
+      "id": "release500_0042",
+      "category": "technical",
+      "characters": 66,
+      "audio_seconds": 3.941666666666667,
+      "latency_seconds": 4.798160925973207,
+      "rtf": 1.2172924125090587
+    },
+    {
+      "id": "release500_0043",
+      "category": "conversational",
+      "characters": 67,
+      "audio_seconds": 3.9166666666666665,
+      "latency_seconds": 4.595465368940495,
+      "rtf": 1.1733103069635307
+    },
+    {
+      "id": "release500_0044",
+      "category": "descriptive",
+      "characters": 73,
+      "audio_seconds": 4.216666666666667,
+      "latency_seconds": 5.005373787949793,
+      "rtf": 1.1870451671027178
+    },
+    {
+      "id": "release500_0045",
+      "category": "emotional",
+      "characters": 70,
+      "audio_seconds": 4.141666666666667,
+      "latency_seconds": 4.899782169959508,
+      "rtf": 1.1830459967709073
+    },
+    {
+      "id": "release500_0046",
+      "category": "homographs",
+      "characters": 51,
+      "audio_seconds": 3.8916666666666666,
+      "latency_seconds": 4.693924398976378,
+      "rtf": 1.2061475971673776
+    },
+    {
+      "id": "release500_0047",
+      "category": "long",
+      "characters": 161,
+      "audio_seconds": 9.041666666666666,
+      "latency_seconds": 11.314272652962245,
+      "rtf": 1.2513481275165617
+    },
+    {
+      "id": "release500_0048",
+      "category": "long_range",
+      "characters": 124,
+      "audio_seconds": 7.066666666666666,
+      "latency_seconds": 7.201165760983713,
+      "rtf": 1.0190328907052424
+    },
+    {
+      "id": "release500_0049",
+      "category": "names_places",
+      "characters": 59,
+      "audio_seconds": 4.141666666666667,
+      "latency_seconds": 4.406044648960233,
+      "rtf": 1.0638337180588087
+    },
+    {
+      "id": "release500_0050",
+      "category": "narrative",
+      "characters": 99,
+      "audio_seconds": 6.766666666666667,
+      "latency_seconds": 7.305861901026219,
+      "rtf": 1.0796840247822
+    }
+  ]
+}

evaluation/final/runtime/piper-danny-low_cpu.json

@@ -0,0 +1,435 @@
+{
+  "format": "inflect_tts_runtime_v2",
+  "system": "piper-danny-low",
+  "provider": "CPUExecutionProvider",
+  "hardware": {
+    "platform": "Linux-5.15.0-164-generic-x86_64-with-glibc2.39",
+    "processor": "AMD EPYC 7K62 48-Core Processor",
+    "logical_cpus_visible": 192,
+    "process_cpu_affinity_count": 192
+  },
+  "runtime_protocol": {
+    "python": "3.12.13",
+    "single_process": true,
+    "concurrent_synthesis_requests": 1,
+    "warmup_utterances": 3,
+    "thread_policy": "runtime default",
+    "environment_threads": {
+      "OMP_NUM_THREADS": null,
+      "MKL_NUM_THREADS": null,
+      "OPENBLAS_NUM_THREADS": null
+    }
+  },
+  "utterances": 50,
+  "load_seconds": 1.8901959729846567,
+  "peak_process_rss_bytes_observed": 308011008,
+  "total_latency_seconds": 183.71523056318983,
+  "total_audio_seconds": 203.664,
+  "rtf": 0.9020505860789823,
+  "realtime_multiple": 1.108585278289971,
+  "latency_mean_seconds": 3.6743046112637967,
+  "latency_median_seconds": 3.3577140510315076,
+  "latency_p95_seconds": 6.018655841879079,
+  "rows": [
+    {
+      "id": "release500_0001",
+      "category": "conversational",
+      "characters": 65,
+      "audio_seconds": 3.328,
+      "latency_seconds": 2.694794154027477,
+      "rtf": 0.8097338203207564
+    },
+    {
+      "id": "release500_0002",
+      "category": "descriptive",
+      "characters": 72,
+      "audio_seconds": 3.552,
+      "latency_seconds": 2.906894377898425,
+      "rtf": 0.8183824262101421
+    },
+    {
+      "id": "release500_0003",
+      "category": "emotional",
+      "characters": 68,
+      "audio_seconds": 3.536,
+      "latency_seconds": 2.494313850067556,
+      "rtf": 0.7054055005847161
+    },
+    {
+      "id": "release500_0004",
+      "category": "homographs",
+      "characters": 73,
+      "audio_seconds": 3.888,
+      "latency_seconds": 3.1074251970276237,
+      "rtf": 0.7992348757787098
+    },
+    {
+      "id": "release500_0005",
+      "category": "long",
+      "characters": 154,
+      "audio_seconds": 7.552,
+      "latency_seconds": 6.202773506985977,
+      "rtf": 0.8213418309038636
+    },
+    {
+      "id": "release500_0006",
+      "category": "long_range",
+      "characters": 122,
+      "audio_seconds": 5.488,
+      "latency_seconds": 3.503760067978874,
+      "rtf": 0.6384402456229726
+    },
+    {
+      "id": "release500_0007",
+      "category": "names_places",
+      "characters": 62,
+      "audio_seconds": 3.648,
+      "latency_seconds": 2.7943607189226896,
+      "rtf": 0.7659980040906496
+    },
+    {
+      "id": "release500_0008",
+      "category": "narrative",
+      "characters": 76,
+      "audio_seconds": 3.888,
+      "latency_seconds": 3.1027242559939623,
+      "rtf": 0.7980257860066776
+    },
+    {
+      "id": "release500_0009",
+      "category": "numbers",
+      "characters": 79,
+      "audio_seconds": 4.272,
+      "latency_seconds": 3.4954504610504955,
+      "rtf": 0.8182234225305467
+    },
+    {
+      "id": "release500_0010",
+      "category": "punctuation",
+      "characters": 75,
+      "audio_seconds": 4.736,
+      "latency_seconds": 3.405109456041828,
+      "rtf": 0.7189842601439671
+    },
+    {
+      "id": "release500_0011",
+      "category": "question",
+      "characters": 47,
+      "audio_seconds": 2.4,
+      "latency_seconds": 2.0017011848976836,
+      "rtf": 0.8340421603740349
+    },
+    {
+      "id": "release500_0012",
+      "category": "rare_words",
+      "characters": 87,
+      "audio_seconds": 4.72,
+      "latency_seconds": 3.190911464043893,
+      "rtf": 0.6760405644160791
+    },
+    {
+      "id": "release500_0013",
+      "category": "short",
+      "characters": 15,
+      "audio_seconds": 1.184,
+      "latency_seconds": 1.2097389679402113,
+      "rtf": 1.021738993192746
+    },
+    {
+      "id": "release500_0014",
+      "category": "technical",
+      "characters": 71,
+      "audio_seconds": 3.584,
+      "latency_seconds": 3.096049627987668,
+      "rtf": 0.8638531328090591
+    },
+    {
+      "id": "release500_0015",
+      "category": "conversational",
+      "characters": 64,
+      "audio_seconds": 3.792,
+      "latency_seconds": 4.000268870033324,
+      "rtf": 1.0549232252197585
+    },
+    {
+      "id": "release500_0016",
+      "category": "descriptive",
+      "characters": 88,
+      "audio_seconds": 4.4,
+      "latency_seconds": 6.716404743026942,
+      "rtf": 1.526455623415214
+    },
+    {
+      "id": "release500_0017",
+      "category": "emotional",
+      "characters": 74,
+      "audio_seconds": 4.72,
+      "latency_seconds": 4.599504046025686,
+      "rtf": 0.9744711961918827
+    },
+    {
+      "id": "release500_0018",
+      "category": "homographs",
+      "characters": 57,
+      "audio_seconds": 3.248,
+      "latency_seconds": 4.393833796028048,
+      "rtf": 1.3527813411416403
+    },
+    {
+      "id": "release500_0019",
+      "category": "long",
+      "characters": 148,
+      "audio_seconds": 7.056,
+      "latency_seconds": 4.4974080140236765,
+      "rtf": 0.6373877570895233
+    },
+    {
+      "id": "release500_0020",
+      "category": "long_range",
+      "characters": 124,
+      "audio_seconds": 5.536,
+      "latency_seconds": 5.302826741011813,
+      "rtf": 0.9578805529284345
+    },
+    {
+      "id": "release500_0021",
+      "category": "names_places",
+      "characters": 72,
+      "audio_seconds": 3.808,
+      "latency_seconds": 4.696971039054915,
+      "rtf": 1.2334482770627404
+    },
+    {
+      "id": "release500_0022",
+      "category": "narrative",
+      "characters": 52,
+      "audio_seconds": 3.36,
+      "latency_seconds": 3.798879117006436,
+      "rtf": 1.130618784823344
+    },
+    {
+      "id": "release500_0023",
+      "category": "numbers",
+      "characters": 80,
+      "audio_seconds": 4.096,
+      "latency_seconds": 5.200509284040891,
+      "rtf": 1.2696555869240456
+    },
+    {
+      "id": "release500_0024",
+      "category": "punctuation",
+      "characters": 73,
+      "audio_seconds": 4.176,
+      "latency_seconds": 3.902562695904635,
+      "rtf": 0.934521718367968
+    },
+    {
+      "id": "release500_0025",
+      "category": "question",
+      "characters": 39,
+      "audio_seconds": 2.032,
+      "latency_seconds": 2.701494449051097,
+      "rtf": 1.3294756146905005
+    },
+    {
+      "id": "release500_0026",
+      "category": "rare_words",
+      "characters": 78,
+      "audio_seconds": 4.192,
+      "latency_seconds": 4.900282075977884,
+      "rtf": 1.168960418887854
+    },
+    {
+      "id": "release500_0027",
+      "category": "short",
+      "characters": 25,
+      "audio_seconds": 1.424,
+      "latency_seconds": 2.292176002985798,
+      "rtf": 1.609674159400139
+    },
+    {
+      "id": "release500_0028",
+      "category": "technical",
+      "characters": 82,
+      "audio_seconds": 4.688,
+      "latency_seconds": 4.603819226962514,
+      "rtf": 0.9820433504612872
+    },
+    {
+      "id": "release500_0029",
+      "category": "conversational",
+      "characters": 59,
+      "audio_seconds": 2.944,
+      "latency_seconds": 2.2923529039835557,
+      "rtf": 0.7786524809726751
+    },
+    {
+      "id": "release500_0030",
+      "category": "descriptive",
+      "characters": 65,
+      "audio_seconds": 3.552,
+      "latency_seconds": 2.6908769720466807,
+      "rtf": 0.7575667151032321
+    },
+    {
+      "id": "release500_0031",
+      "category": "emotional",
+      "characters": 70,
+      "audio_seconds": 3.776,
+      "latency_seconds": 2.7059419460128993,
+      "rtf": 0.7166159814652806
+    },
+    {
+      "id": "release500_0032",
+      "category": "homographs",
+      "characters": 60,
+      "audio_seconds": 3.12,
+      "latency_seconds": 3.8008046090835705,
+      "rtf": 1.2182066054755034
+    },
+    {
+      "id": "release500_0033",
+      "category": "long",
+      "characters": 138,
+      "audio_seconds": 6.912,
+      "latency_seconds": 4.392665836028755,
+      "rtf": 0.6355129971106416
+    },
+    {
+      "id": "release500_0034",
+      "category": "long_range",
+      "characters": 141,
+      "audio_seconds": 7.888,
+      "latency_seconds": 4.404446133063175,
+      "rtf": 0.5583729884714979
+    },
+    {
+      "id": "release500_0035",
+      "category": "names_places",
+      "characters": 61,
+      "audio_seconds": 3.472,
+      "latency_seconds": 2.8991199899464846,
+      "rtf": 0.8349999971044022
+    },
+    {
+      "id": "release500_0036",
+      "category": "narrative",
+      "characters": 73,
+      "audio_seconds": 4.272,
+      "latency_seconds": 3.597467645071447,
+      "rtf": 0.8421038495017431
+    },
+    {
+      "id": "release500_0037",
+      "category": "numbers",
+      "characters": 78,
+      "audio_seconds": 4.256,
+      "latency_seconds": 3.0042440649122,
+      "rtf": 0.7058844137481672
+    },
+    {
+      "id": "release500_0038",
+      "category": "punctuation",
+      "characters": 67,
+      "audio_seconds": 4.192,
+      "latency_seconds": 3.0972820960450917,
+      "rtf": 0.7388554618428177
+    },
+    {
+      "id": "release500_0039",
+      "category": "question",
+      "characters": 45,
+      "audio_seconds": 1.92,
+      "latency_seconds": 1.7992442069808021,
+      "rtf": 0.9371063578025012
+    },
+    {
+      "id": "release500_0040",
+      "category": "rare_words",
+      "characters": 82,
+      "audio_seconds": 4.352,
+      "latency_seconds": 2.9979103269288316,
+      "rtf": 0.688858071445044
+    },
+    {
+      "id": "release500_0041",
+      "category": "short",
+      "characters": 22,
+      "audio_seconds": 1.904,
+      "latency_seconds": 1.9961127690039575,
+      "rtf": 1.0483785551491374
+    },
+    {
+      "id": "release500_0042",
+      "category": "technical",
+      "characters": 66,
+      "audio_seconds": 3.488,
+      "latency_seconds": 2.598443711991422,
+      "rtf": 0.7449666605479994
+    },
+    {
+      "id": "release500_0043",
+      "category": "conversational",
+      "characters": 67,
+      "audio_seconds": 3.648,
+      "latency_seconds": 2.7085965409642085,
+      "rtf": 0.7424880868871185
+    },
+    {
+      "id": "release500_0044",
+      "category": "descriptive",
+      "characters": 73,
+      "audio_seconds": 3.6,
+      "latency_seconds": 3.120920946006663,
+      "rtf": 0.8669224850018509
+    },
+    {
+      "id": "release500_0045",
+      "category": "emotional",
+      "characters": 70,
+      "audio_seconds": 3.776,
+      "latency_seconds": 3.3103186460211873,
+      "rtf": 0.876673370238662
+    },
+    {
+      "id": "release500_0046",
+      "category": "homographs",
+      "characters": 51,
+      "audio_seconds": 2.608,
+      "latency_seconds": 4.69350021192804,
+      "rtf": 1.7996549892362115
+    },
+    {
+      "id": "release500_0047",
+      "category": "long",
+      "characters": 161,
+      "audio_seconds": 7.248,
+      "latency_seconds": 7.30119068804197,
+      "rtf": 1.0073386710874683
+    },
+    {
+      "id": "release500_0048",
+      "category": "long_range",
+      "characters": 124,
+      "audio_seconds": 6.352,
+      "latency_seconds": 5.597807219950482,
+      "rtf": 0.8812668797151263
+    },
+    {
+      "id": "release500_0049",
+      "category": "names_places",
+      "characters": 59,
+      "audio_seconds": 3.2,
+      "latency_seconds": 4.099412567098625,
+      "rtf": 1.2810664272183203
+    },
+    {
+      "id": "release500_0050",
+      "category": "narrative",
+      "characters": 99,
+      "audio_seconds": 4.88,
+      "latency_seconds": 5.793623140081763,
+      "rtf": 1.1872178565741318
+    }
+  ]
+}

evaluation/final/runtime/piper-ryan-low_cpu.json

@@ -0,0 +1,435 @@
+{
+  "format": "inflect_tts_runtime_v2",
+  "system": "piper-ryan-low",
+  "provider": "CPUExecutionProvider",
+  "hardware": {
+    "platform": "Linux-5.15.0-164-generic-x86_64-with-glibc2.39",
+    "processor": "AMD EPYC 7K62 48-Core Processor",
+    "logical_cpus_visible": 192,
+    "process_cpu_affinity_count": 192
+  },
+  "runtime_protocol": {
+    "python": "3.12.13",
+    "single_process": true,
+    "concurrent_synthesis_requests": 1,
+    "warmup_utterances": 3,
+    "thread_policy": "runtime default",
+    "environment_threads": {
+      "OMP_NUM_THREADS": null,
+      "MKL_NUM_THREADS": null,
+      "OPENBLAS_NUM_THREADS": null
+    }
+  },
+  "utterances": 50,
+  "load_seconds": 1.9642897229641676,
+  "peak_process_rss_bytes_observed": 288743424,
+  "total_latency_seconds": 189.05404080462176,
+  "total_audio_seconds": 184.672,
+  "rtf": 1.0237287775332577,
+  "realtime_multiple": 0.9768212264283185,
+  "latency_mean_seconds": 3.781080816092435,
+  "latency_median_seconds": 3.455015121551696,
+  "latency_p95_seconds": 5.912310973095009,
+  "rows": [
+    {
+      "id": "release500_0001",
+      "category": "conversational",
+      "characters": 65,
+      "audio_seconds": 3.056,
+      "latency_seconds": 5.095453783054836,
+      "rtf": 1.6673605311043311
+    },
+    {
+      "id": "release500_0002",
+      "category": "descriptive",
+      "characters": 72,
+      "audio_seconds": 3.152,
+      "latency_seconds": 4.496822469984181,
+      "rtf": 1.4266568749949813
+    },
+    {
+      "id": "release500_0003",
+      "category": "emotional",
+      "characters": 68,
+      "audio_seconds": 3.36,
+      "latency_seconds": 7.992730661993846,
+      "rtf": 2.3787888874981684
+    },
+    {
+      "id": "release500_0004",
+      "category": "homographs",
+      "characters": 73,
+      "audio_seconds": 3.232,
+      "latency_seconds": 3.70855401805602,
+      "rtf": 1.1474486442005012
+    },
+    {
+      "id": "release500_0005",
+      "category": "long",
+      "characters": 154,
+      "audio_seconds": 7.056,
+      "latency_seconds": 5.092412865022197,
+      "rtf": 0.7217138414147105
+    },
+    {
+      "id": "release500_0006",
+      "category": "long_range",
+      "characters": 122,
+      "audio_seconds": 5.52,
+      "latency_seconds": 6.698942730086856,
+      "rtf": 1.213576581537474
+    },
+    {
+      "id": "release500_0007",
+      "category": "names_places",
+      "characters": 62,
+      "audio_seconds": 3.264,
+      "latency_seconds": 5.8055780990980566,
+      "rtf": 1.7786697607530813
+    },
+    {
+      "id": "release500_0008",
+      "category": "narrative",
+      "characters": 76,
+      "audio_seconds": 3.584,
+      "latency_seconds": 4.996604233048856,
+      "rtf": 1.394141806096221
+    },
+    {
+      "id": "release500_0009",
+      "category": "numbers",
+      "characters": 79,
+      "audio_seconds": 4.416,
+      "latency_seconds": 4.517632080009207,
+      "rtf": 1.0230145108716502
+    },
+    {
+      "id": "release500_0010",
+      "category": "punctuation",
+      "characters": 75,
+      "audio_seconds": 4.048,
+      "latency_seconds": 5.283208554028533,
+      "rtf": 1.30514045307029
+    },
+    {
+      "id": "release500_0011",
+      "category": "question",
+      "characters": 47,
+      "audio_seconds": 1.888,
+      "latency_seconds": 3.2944089110242203,
+      "rtf": 1.7449199740594388
+    },
+    {
+      "id": "release500_0012",
+      "category": "rare_words",
+      "characters": 87,
+      "audio_seconds": 4.528,
+      "latency_seconds": 5.302474886993878,
+      "rtf": 1.17104127362939
+    },
+    {
+      "id": "release500_0013",
+      "category": "short",
+      "characters": 15,
+      "audio_seconds": 1.008,
+      "latency_seconds": 1.2995166359469295,
+      "rtf": 1.2892030118521125
+    },
+    {
+      "id": "release500_0014",
+      "category": "technical",
+      "characters": 71,
+      "audio_seconds": 3.328,
+      "latency_seconds": 2.8999716109829023,
+      "rtf": 0.8713857004155356
+    },
+    {
+      "id": "release500_0015",
+      "category": "conversational",
+      "characters": 64,
+      "audio_seconds": 3.504,
+      "latency_seconds": 3.094316368922591,
+      "rtf": 0.8830811555144381
+    },
+    {
+      "id": "release500_0016",
+      "category": "descriptive",
+      "characters": 88,
+      "audio_seconds": 4.208,
+      "latency_seconds": 3.5044920271029696,
+      "rtf": 0.8328165463647741
+    },
+    {
+      "id": "release500_0017",
+      "category": "emotional",
+      "characters": 74,
+      "audio_seconds": 3.488,
+      "latency_seconds": 3.405538216000423,
+      "rtf": 0.9763584334863598
+    },
+    {
+      "id": "release500_0018",
+      "category": "homographs",
+      "characters": 57,
+      "audio_seconds": 2.64,
+      "latency_seconds": 2.89578573894687,
+      "rtf": 1.096888537479875
+    },
+    {
+      "id": "release500_0019",
+      "category": "long",
+      "characters": 148,
+      "audio_seconds": 7.296,
+      "latency_seconds": 5.393182841013186,
+      "rtf": 0.7391972095686932
+    },
+    {
+      "id": "release500_0020",
+      "category": "long_range",
+      "characters": 124,
+      "audio_seconds": 5.264,
+      "latency_seconds": 4.500914755044505,
+      "rtf": 0.8550369975388497
+    },
+    {
+      "id": "release500_0021",
+      "category": "names_places",
+      "characters": 72,
+      "audio_seconds": 3.184,
+      "latency_seconds": 3.399256609962322,
+      "rtf": 1.0676057192092718
+    },
+    {
+      "id": "release500_0022",
+      "category": "narrative",
+      "characters": 52,
+      "audio_seconds": 2.736,
+      "latency_seconds": 2.103269227896817,
+      "rtf": 0.7687387528862635
+    },
+    {
+      "id": "release500_0023",
+      "category": "numbers",
+      "characters": 80,
+      "audio_seconds": 4.048,
+      "latency_seconds": 3.288317018072121,
+      "rtf": 0.8123312791680141
+    },
+    {
+      "id": "release500_0024",
+      "category": "punctuation",
+      "characters": 73,
+      "audio_seconds": 3.776,
+      "latency_seconds": 3.7026524969842285,
+      "rtf": 0.9805753434809927
+    },
+    {
+      "id": "release500_0025",
+      "category": "question",
+      "characters": 39,
+      "audio_seconds": 1.568,
+      "latency_seconds": 1.4985663370462134,
+      "rtf": 0.9557183271978402
+    },
+    {
+      "id": "release500_0026",
+      "category": "rare_words",
+      "characters": 78,
+      "audio_seconds": 3.792,
+      "latency_seconds": 3.394537629908882,
+      "rtf": 0.8951839741320892
+    },
+    {
+      "id": "release500_0027",
+      "category": "short",
+      "characters": 25,
+      "audio_seconds": 1.008,
+      "latency_seconds": 1.3068380819167942,
+      "rtf": 1.2964663511079306
+    },
+    {
+      "id": "release500_0028",
+      "category": "technical",
+      "characters": 82,
+      "audio_seconds": 4.496,
+      "latency_seconds": 4.099360725958832,
+      "rtf": 0.9117795208983166
+    },
+    {
+      "id": "release500_0029",
+      "category": "conversational",
+      "characters": 59,
+      "audio_seconds": 2.56,
+      "latency_seconds": 2.098615241004154,
+      "rtf": 0.8197715785172477
+    },
+    {
+      "id": "release500_0030",
+      "category": "descriptive",
+      "characters": 65,
+      "audio_seconds": 2.64,
+      "latency_seconds": 2.9805976420175284,
+      "rtf": 1.129014258339973
+    },
+    {
+      "id": "release500_0031",
+      "category": "emotional",
+      "characters": 70,
+      "audio_seconds": 3.488,
+      "latency_seconds": 5.099046717979945,
+      "rtf": 1.4618826599713146
+    },
+    {
+      "id": "release500_0032",
+      "category": "homographs",
+      "characters": 60,
+      "audio_seconds": 2.528,
+      "latency_seconds": 4.004566572024487,
+      "rtf": 1.5840848781742431
+    },
+    {
+      "id": "release500_0033",
+      "category": "long",
+      "characters": 138,
+      "audio_seconds": 6.336,
+      "latency_seconds": 5.999637870001607,
+      "rtf": 0.9469125426138899
+    },
+    {
+      "id": "release500_0034",
+      "category": "long_range",
+      "characters": 141,
+      "audio_seconds": 6.48,
+      "latency_seconds": 5.197615592041984,
+      "rtf": 0.8021011716114173
+    },
+    {
+      "id": "release500_0035",
+      "category": "names_places",
+      "characters": 61,
+      "audio_seconds": 3.168,
+      "latency_seconds": 3.0925699579529464,
+      "rtf": 0.9761900119800967
+    },
+    {
+      "id": "release500_0036",
+      "category": "narrative",
+      "characters": 73,
+      "audio_seconds": 3.728,
+      "latency_seconds": 2.899544436018914,
+      "rtf": 0.7777747950694511
+    },
+    {
+      "id": "release500_0037",
+      "category": "numbers",
+      "characters": 78,
+      "audio_seconds": 4.192,
+      "latency_seconds": 3.704225494991988,
+      "rtf": 0.8836415780038139
+    },
+    {
+      "id": "release500_0038",
+      "category": "punctuation",
+      "characters": 67,
+      "audio_seconds": 3.872,
+      "latency_seconds": 3.8040968949208036,
+      "rtf": 0.982463041043596
+    },
+    {
+      "id": "release500_0039",
+      "category": "question",
+      "characters": 45,
+      "audio_seconds": 1.744,
+      "latency_seconds": 1.9012305500218645,
+      "rtf": 1.090155131893271
+    },
+    {
+      "id": "release500_0040",
+      "category": "rare_words",
+      "characters": 82,
+      "audio_seconds": 4.208,
+      "latency_seconds": 2.9057097979821265,
+      "rtf": 0.6905203892543076
+    },
+    {
+      "id": "release500_0041",
+      "category": "short",
+      "characters": 22,
+      "audio_seconds": 1.344,
+      "latency_seconds": 1.7026629409519956,
+      "rtf": 1.266862307255949
+    },
+    {
+      "id": "release500_0042",
+      "category": "technical",
+      "characters": 66,
+      "audio_seconds": 3.008,
+      "latency_seconds": 2.3924714779714122,
+      "rtf": 0.7953695073043259
+    },
+    {
+      "id": "release500_0043",
+      "category": "conversational",
+      "characters": 67,
+      "audio_seconds": 3.024,
+      "latency_seconds": 2.399873304995708,
+      "rtf": 0.7936088971546654
+    },
+    {
+      "id": "release500_0044",
+      "category": "descriptive",
+      "characters": 73,
+      "audio_seconds": 3.088,
+      "latency_seconds": 2.6074585649184883,
+      "rtf": 0.8443842502974379
+    },
+    {
+      "id": "release500_0045",
+      "category": "emotional",
+      "characters": 70,
+      "audio_seconds": 3.36,
+      "latency_seconds": 3.395750766969286,
+      "rtf": 1.0106401092170494
+    },
+    {
+      "id": "release500_0046",
+      "category": "homographs",
+      "characters": 51,
+      "audio_seconds": 2.4,
+      "latency_seconds": 3.0125494529493153,
+      "rtf": 1.2552289387288815
+    },
+    {
+      "id": "release500_0047",
+      "category": "long",
+      "characters": 161,
+      "audio_seconds": 7.04,
+      "latency_seconds": 4.986470783944242,
+      "rtf": 0.7083055090829888
+    },
+    {
+      "id": "release500_0048",
+      "category": "long_range",
+      "characters": 124,
+      "audio_seconds": 6.416,
+      "latency_seconds": 4.906047191936523,
+      "rtf": 0.7646582281696575
+    },
+    {
+      "id": "release500_0049",
+      "category": "names_places",
+      "characters": 59,
+      "audio_seconds": 2.8,
+      "latency_seconds": 4.588569083949551,
+      "rtf": 1.6387746728391255
+    },
+    {
+      "id": "release500_0050",
+      "category": "narrative",
+      "characters": 99,
+      "audio_seconds": 4.8,
+      "latency_seconds": 3.3033908549696207,
+      "rtf": 0.688206428118671
+    }
+  ]
+}

evaluation/final/runtime/supertonic3-james-3step_cpu.json

@@ -0,0 +1,435 @@
+{
+  "format": "inflect_tts_runtime_v2",
+  "system": "supertonic3-james-3step",
+  "provider": "TensorrtExecutionProvider,CUDAExecutionProvider,CPUExecutionProvider",
+  "hardware": {
+    "platform": "Linux-5.15.0-164-generic-x86_64-with-glibc2.39",
+    "processor": "AMD EPYC 7K62 48-Core Processor",
+    "logical_cpus_visible": 192,
+    "process_cpu_affinity_count": 192
+  },
+  "runtime_protocol": {
+    "python": "3.12.13",
+    "single_process": true,
+    "concurrent_synthesis_requests": 1,
+    "warmup_utterances": 3,
+    "thread_policy": "runtime default",
+    "environment_threads": {
+      "OMP_NUM_THREADS": null,
+      "MKL_NUM_THREADS": null,
+      "OPENBLAS_NUM_THREADS": null
+    }
+  },
+  "utterances": 50,
+  "load_seconds": 2.6790920139756054,
+  "peak_process_rss_bytes_observed": 678948864,
+  "total_latency_seconds": 849.3093430369627,
+  "total_audio_seconds": 264.63782312925173,
+  "rtf": 3.209327121097696,
+  "realtime_multiple": 0.31159179549698474,
+  "latency_mean_seconds": 16.986186860739252,
+  "latency_median_seconds": 14.800659405940678,
+  "latency_p95_seconds": 29.707549027819184,
+  "rows": [
+    {
+      "id": "release500_0001",
+      "category": "conversational",
+      "characters": 65,
+      "audio_seconds": 4.31891156462585,
+      "latency_seconds": 28.998808396980166,
+      "rtf": 6.714378834356232
+    },
+    {
+      "id": "release500_0002",
+      "category": "descriptive",
+      "characters": 72,
+      "audio_seconds": 4.806530612244898,
+      "latency_seconds": 30.19757883902639,
+      "rtf": 6.282614483323256
+    },
+    {
+      "id": "release500_0003",
+      "category": "emotional",
+      "characters": 68,
+      "audio_seconds": 4.527891156462585,
+      "latency_seconds": 15.797762398957275,
+      "rtf": 3.4889889913562486
+    },
+    {
+      "id": "release500_0004",
+      "category": "homographs",
+      "characters": 73,
+      "audio_seconds": 5.015510204081632,
+      "latency_seconds": 16.906808093073778,
+      "rtf": 3.370904933921774
+    },
+    {
+      "id": "release500_0005",
+      "category": "long",
+      "characters": 154,
+      "audio_seconds": 9.47374149659864,
+      "latency_seconds": 33.89909315900877,
+      "rtf": 3.578215974246244
+    },
+    {
+      "id": "release500_0006",
+      "category": "long_range",
+      "characters": 122,
+      "audio_seconds": 7.9412244897959186,
+      "latency_seconds": 19.896839465014637,
+      "rtf": 2.505512782138459
+    },
+    {
+      "id": "release500_0007",
+      "category": "names_places",
+      "characters": 62,
+      "audio_seconds": 4.527891156462585,
+      "latency_seconds": 13.896119163022377,
+      "rtf": 3.0690046829391364
+    },
+    {
+      "id": "release500_0008",
+      "category": "narrative",
+      "characters": 76,
+      "audio_seconds": 5.294149659863946,
+      "latency_seconds": 14.999536308925599,
+      "rtf": 2.833228615095681
+    },
+    {
+      "id": "release500_0009",
+      "category": "numbers",
+      "characters": 79,
+      "audio_seconds": 5.7817687074829935,
+      "latency_seconds": 18.801307283109054,
+      "rtf": 3.2518262549616797
+    },
+    {
+      "id": "release500_0010",
+      "category": "punctuation",
+      "characters": 75,
+      "audio_seconds": 5.224489795918367,
+      "latency_seconds": 18.90059391502291,
+      "rtf": 3.6176918040473542
+    },
+    {
+      "id": "release500_0011",
+      "category": "question",
+      "characters": 47,
+      "audio_seconds": 3.1346938775510202,
+      "latency_seconds": 13.59835728991311,
+      "rtf": 4.338017625037386
+    },
+    {
+      "id": "release500_0012",
+      "category": "rare_words",
+      "characters": 87,
+      "audio_seconds": 6.478367346938776,
+      "latency_seconds": 18.20354309002869,
+      "rtf": 2.8098967093353253
+    },
+    {
+      "id": "release500_0013",
+      "category": "short",
+      "characters": 15,
+      "audio_seconds": 1.5325170068027212,
+      "latency_seconds": 6.989259209949523,
+      "rtf": 4.560640553367276
+    },
+    {
+      "id": "release500_0014",
+      "category": "technical",
+      "characters": 71,
+      "audio_seconds": 4.9458503401360545,
+      "latency_seconds": 13.4002628789749,
+      "rtf": 2.7093951408578762
+    },
+    {
+      "id": "release500_0015",
+      "category": "conversational",
+      "characters": 64,
+      "audio_seconds": 4.597551020408163,
+      "latency_seconds": 14.003370278980583,
+      "rtf": 3.045832491433099
+    },
+    {
+      "id": "release500_0016",
+      "category": "descriptive",
+      "characters": 88,
+      "audio_seconds": 5.851428571428571,
+      "latency_seconds": 20.703603437985294,
+      "rtf": 3.538213478171315
+    },
+    {
+      "id": "release500_0017",
+      "category": "emotional",
+      "characters": 74,
+      "audio_seconds": 5.712108843537415,
+      "latency_seconds": 17.795659940922633,
+      "rtf": 3.115427319116362
+    },
+    {
+      "id": "release500_0018",
+      "category": "homographs",
+      "characters": 57,
+      "audio_seconds": 3.9706122448979593,
+      "latency_seconds": 11.999421935994178,
+      "rtf": 3.0220583617584023
+    },
+    {
+      "id": "release500_0019",
+      "category": "long",
+      "characters": 148,
+      "audio_seconds": 8.916462585034013,
+      "latency_seconds": 21.802207560976967,
+      "rtf": 2.4451633540829576
+    },
+    {
+      "id": "release500_0020",
+      "category": "long_range",
+      "characters": 124,
+      "audio_seconds": 7.801904761904762,
+      "latency_seconds": 25.192749900976196,
+      "rtf": 3.2290511958038337
+    },
+    {
+      "id": "release500_0021",
+      "category": "names_places",
+      "characters": 72,
+      "audio_seconds": 5.154829931972789,
+      "latency_seconds": 13.003286844003014,
+      "rtf": 2.5225442964374514
+    },
+    {
+      "id": "release500_0022",
+      "category": "narrative",
+      "characters": 52,
+      "audio_seconds": 3.9706122448979593,
+      "latency_seconds": 13.419403853011318,
+      "rtf": 3.3796812746584837
+    },
+    {
+      "id": "release500_0023",
+      "category": "numbers",
+      "characters": 80,
+      "audio_seconds": 5.50312925170068,
+      "latency_seconds": 13.576101922080852,
+      "rtf": 2.4669785682183116
+    },
+    {
+      "id": "release500_0024",
+      "category": "punctuation",
+      "characters": 73,
+      "audio_seconds": 5.294149659863946,
+      "latency_seconds": 13.908222962054424,
+      "rtf": 2.627092896050062
+    },
+    {
+      "id": "release500_0025",
+      "category": "question",
+      "characters": 39,
+      "audio_seconds": 2.5774149659863945,
+      "latency_seconds": 10.01117065793369,
+      "rtf": 3.8841904738076765
+    },
+    {
+      "id": "release500_0026",
+      "category": "rare_words",
+      "characters": 78,
+      "audio_seconds": 5.572789115646258,
+      "latency_seconds": 12.706626930972561,
+      "rtf": 2.2801198228185626
+    },
+    {
+      "id": "release500_0027",
+      "category": "short",
+      "characters": 25,
+      "audio_seconds": 1.9504761904761905,
+      "latency_seconds": 7.600322338985279,
+      "rtf": 3.8966496366867887
+    },
+    {
+      "id": "release500_0028",
+      "category": "technical",
+      "characters": 82,
+      "audio_seconds": 5.7817687074829935,
+      "latency_seconds": 17.193625962012447,
+      "rtf": 2.973765785504318
+    },
+    {
+      "id": "release500_0029",
+      "category": "conversational",
+      "characters": 59,
+      "audio_seconds": 4.179591836734694,
+      "latency_seconds": 10.803514466970228,
+      "rtf": 2.5848252386793997
+    },
+    {
+      "id": "release500_0030",
+      "category": "descriptive",
+      "characters": 65,
+      "audio_seconds": 4.179591836734694,
+      "latency_seconds": 11.700191858108155,
+      "rtf": 2.799362309801267
+    },
+    {
+      "id": "release500_0031",
+      "category": "emotional",
+      "characters": 70,
+      "audio_seconds": 4.876190476190477,
+      "latency_seconds": 23.998435548041016,
+      "rtf": 4.921554165125599
+    },
+    {
+      "id": "release500_0032",
+      "category": "homographs",
+      "characters": 60,
+      "audio_seconds": 4.1099319727891155,
+      "latency_seconds": 20.301638623001054,
+      "rtf": 4.939653200445503
+    },
+    {
+      "id": "release500_0033",
+      "category": "long",
+      "characters": 138,
+      "audio_seconds": 8.916462585034013,
+      "latency_seconds": 37.89666118694004,
+      "rtf": 4.250190120300434
+    },
+    {
+      "id": "release500_0034",
+      "category": "long_range",
+      "characters": 141,
+      "audio_seconds": 9.404081632653062,
+      "latency_seconds": 29.10862370301038,
+      "rtf": 3.09531805869685
+    },
+    {
+      "id": "release500_0035",
+      "category": "names_places",
+      "characters": 61,
+      "audio_seconds": 4.31891156462585,
+      "latency_seconds": 14.206219856976531,
+      "rtf": 3.28930556794284
+    },
+    {
+      "id": "release500_0036",
+      "category": "narrative",
+      "characters": 73,
+      "audio_seconds": 5.224489795918367,
+      "latency_seconds": 12.992455078987405,
+      "rtf": 2.486837104962433
+    },
+    {
+      "id": "release500_0037",
+      "category": "numbers",
+      "characters": 78,
+      "audio_seconds": 5.50312925170068,
+      "latency_seconds": 14.38667850708589,
+      "rtf": 2.6142723256299765
+    },
+    {
+      "id": "release500_0038",
+      "category": "punctuation",
+      "characters": 67,
+      "audio_seconds": 5.433469387755102,
+      "latency_seconds": 14.3996915910393,
+      "rtf": 2.6501836236513134
+    },
+    {
+      "id": "release500_0039",
+      "category": "question",
+      "characters": 45,
+      "audio_seconds": 2.9257142857142857,
+      "latency_seconds": 10.49946259194985,
+      "rtf": 3.588683503107859
+    },
+    {
+      "id": "release500_0040",
+      "category": "rare_words",
+      "characters": 82,
+      "audio_seconds": 5.851428571428571,
+      "latency_seconds": 19.90693972702138,
+      "rtf": 3.4020648947546306
+    },
+    {
+      "id": "release500_0041",
+      "category": "short",
+      "characters": 22,
+      "audio_seconds": 2.2987755102040817,
+      "latency_seconds": 8.601308524026535,
+      "rtf": 3.741691385629441
+    },
+    {
+      "id": "release500_0042",
+      "category": "technical",
+      "characters": 66,
+      "audio_seconds": 4.527891156462585,
+      "latency_seconds": 14.808211676892824,
+      "rtf": 3.2704433841695386
+    },
+    {
+      "id": "release500_0043",
+      "category": "conversational",
+      "characters": 67,
+      "audio_seconds": 4.527891156462585,
+      "latency_seconds": 14.793107134988531,
+      "rtf": 3.267107495257383
+    },
+    {
+      "id": "release500_0044",
+      "category": "descriptive",
+      "characters": 73,
+      "audio_seconds": 4.876190476190477,
+      "latency_seconds": 16.60368364606984,
+      "rtf": 3.405052310229166
+    },
+    {
+      "id": "release500_0045",
+      "category": "emotional",
+      "characters": 70,
+      "audio_seconds": 4.876190476190477,
+      "latency_seconds": 13.498906463966705,
+      "rtf": 2.7683304271806715
+    },
+    {
+      "id": "release500_0046",
+      "category": "homographs",
+      "characters": 51,
+      "audio_seconds": 3.622312925170068,
+      "latency_seconds": 11.801922361948527,
+      "rtf": 3.2581178395553514
+    },
+    {
+      "id": "release500_0047",
+      "category": "long",
+      "characters": 161,
+      "audio_seconds": 9.961360544217687,
+      "latency_seconds": 25.49392598704435,
+      "rtf": 2.5592815232295667
+    },
+    {
+      "id": "release500_0048",
+      "category": "long_range",
+      "characters": 124,
+      "audio_seconds": 8.289523809523809,
+      "latency_seconds": 18.00314238795545,
+      "rtf": 2.171794520605839
+    },
+    {
+      "id": "release500_0049",
+      "category": "names_places",
+      "characters": 59,
+      "audio_seconds": 4.667210884353741,
+      "latency_seconds": 12.699009545031004,
+      "rtf": 2.720899025069318
+    },
+    {
+      "id": "release500_0050",
+      "category": "narrative",
+      "characters": 99,
+      "audio_seconds": 6.408707482993197,
+      "latency_seconds": 15.403968552011065,
+      "rtf": 2.4035998823301914
+    }
+  ]
+}

evaluation/final/runtime/supertonic3-james-8step_cpu.json

@@ -0,0 +1,435 @@
+{
+  "format": "inflect_tts_runtime_v2",
+  "system": "supertonic3-james-8step",
+  "provider": "TensorrtExecutionProvider,CUDAExecutionProvider,CPUExecutionProvider",
+  "hardware": {
+    "platform": "Linux-5.15.0-164-generic-x86_64-with-glibc2.39",
+    "processor": "AMD EPYC 7K62 48-Core Processor",
+    "logical_cpus_visible": 192,
+    "process_cpu_affinity_count": 192
+  },
+  "runtime_protocol": {
+    "python": "3.12.13",
+    "single_process": true,
+    "concurrent_synthesis_requests": 1,
+    "warmup_utterances": 3,
+    "thread_policy": "runtime default",
+    "environment_threads": {
+      "OMP_NUM_THREADS": null,
+      "MKL_NUM_THREADS": null,
+      "OPENBLAS_NUM_THREADS": null
+    }
+  },
+  "utterances": 50,
+  "load_seconds": 2.782298281090334,
+  "peak_process_rss_bytes_observed": 677150720,
+  "total_latency_seconds": 1835.7704164680326,
+  "total_audio_seconds": 264.63782312925173,
+  "rtf": 6.936916253166972,
+  "realtime_multiple": 0.14415627398463418,
+  "latency_mean_seconds": 36.715408329360656,
+  "latency_median_seconds": 33.805316411482636,
+  "latency_p95_seconds": 61.84402299919163,
+  "rows": [
+    {
+      "id": "release500_0001",
+      "category": "conversational",
+      "characters": 65,
+      "audio_seconds": 4.31891156462585,
+      "latency_seconds": 36.98947674606461,
+      "rtf": 8.564536733983585
+    },
+    {
+      "id": "release500_0002",
+      "category": "descriptive",
+      "characters": 72,
+      "audio_seconds": 4.806530612244898,
+      "latency_seconds": 50.598904596990906,
+      "rtf": 10.527115851106295
+    },
+    {
+      "id": "release500_0003",
+      "category": "emotional",
+      "characters": 68,
+      "audio_seconds": 4.527891156462585,
+      "latency_seconds": 46.7989379579667,
+      "rtf": 10.335702944442765
+    },
+    {
+      "id": "release500_0004",
+      "category": "homographs",
+      "characters": 73,
+      "audio_seconds": 5.015510204081632,
+      "latency_seconds": 33.804205555003136,
+      "rtf": 6.739933561991999
+    },
+    {
+      "id": "release500_0005",
+      "category": "long",
+      "characters": 154,
+      "audio_seconds": 9.47374149659864,
+      "latency_seconds": 74.30384839104954,
+      "rtf": 7.843136570459187
+    },
+    {
+      "id": "release500_0006",
+      "category": "long_range",
+      "characters": 122,
+      "audio_seconds": 7.9412244897959186,
+      "latency_seconds": 78.99573731306009,
+      "rtf": 9.947551213867044
+    },
+    {
+      "id": "release500_0007",
+      "category": "names_places",
+      "characters": 62,
+      "audio_seconds": 4.527891156462585,
+      "latency_seconds": 31.021213255939074,
+      "rtf": 6.851139345887986
+    },
+    {
+      "id": "release500_0008",
+      "category": "narrative",
+      "characters": 76,
+      "audio_seconds": 5.294149659863946,
+      "latency_seconds": 35.27181877696421,
+      "rtf": 6.662414371162802
+    },
+    {
+      "id": "release500_0009",
+      "category": "numbers",
+      "characters": 79,
+      "audio_seconds": 5.7817687074829935,
+      "latency_seconds": 41.60580760799348,
+      "rtf": 7.196034589579068
+    },
+    {
+      "id": "release500_0010",
+      "category": "punctuation",
+      "characters": 75,
+      "audio_seconds": 5.224489795918367,
+      "latency_seconds": 44.00093829794787,
+      "rtf": 8.422054596091584
+    },
+    {
+      "id": "release500_0011",
+      "category": "question",
+      "characters": 47,
+      "audio_seconds": 3.1346938775510202,
+      "latency_seconds": 22.192042800947092,
+      "rtf": 7.079492820614632
+    },
+    {
+      "id": "release500_0012",
+      "category": "rare_words",
+      "characters": 87,
+      "audio_seconds": 6.478367346938776,
+      "latency_seconds": 47.600230979966,
+      "rtf": 7.347565895975094
+    },
+    {
+      "id": "release500_0013",
+      "category": "short",
+      "characters": 15,
+      "audio_seconds": 1.5325170068027212,
+      "latency_seconds": 19.405141596100293,
+      "rtf": 12.66226835327922
+    },
+    {
+      "id": "release500_0014",
+      "category": "technical",
+      "characters": 71,
+      "audio_seconds": 4.9458503401360545,
+      "latency_seconds": 66.30113477900159,
+      "rtf": 13.405406597316837
+    },
+    {
+      "id": "release500_0015",
+      "category": "conversational",
+      "characters": 64,
+      "audio_seconds": 4.597551020408163,
+      "latency_seconds": 30.99960184202064,
+      "rtf": 6.742633568266208
+    },
+    {
+      "id": "release500_0016",
+      "category": "descriptive",
+      "characters": 88,
+      "audio_seconds": 5.851428571428571,
+      "latency_seconds": 35.19991947291419,
+      "rtf": 6.0156112380468585
+    },
+    {
+      "id": "release500_0017",
+      "category": "emotional",
+      "characters": 74,
+      "audio_seconds": 5.712108843537415,
+      "latency_seconds": 35.30517654889263,
+      "rtf": 6.180760471473915
+    },
+    {
+      "id": "release500_0018",
+      "category": "homographs",
+      "characters": 57,
+      "audio_seconds": 3.9706122448979593,
+      "latency_seconds": 32.692700501997024,
+      "rtf": 8.233667375605746
+    },
+    {
+      "id": "release500_0019",
+      "category": "long",
+      "characters": 148,
+      "audio_seconds": 8.916462585034013,
+      "latency_seconds": 55.90802389208693,
+      "rtf": 6.270202264508651
+    },
+    {
+      "id": "release500_0020",
+      "category": "long_range",
+      "characters": 124,
+      "audio_seconds": 7.801904761904762,
+      "latency_seconds": 42.9971199920401,
+      "rtf": 5.511105467729749
+    },
+    {
+      "id": "release500_0021",
+      "category": "names_places",
+      "characters": 72,
+      "audio_seconds": 5.154829931972789,
+      "latency_seconds": 31.19967953802552,
+      "rtf": 6.052513846191078
+    },
+    {
+      "id": "release500_0022",
+      "category": "narrative",
+      "characters": 52,
+      "audio_seconds": 3.9706122448979593,
+      "latency_seconds": 27.997477561002597,
+      "rtf": 7.05117393343507
+    },
+    {
+      "id": "release500_0023",
+      "category": "numbers",
+      "characters": 80,
+      "audio_seconds": 5.50312925170068,
+      "latency_seconds": 31.699590165982954,
+      "rtf": 5.760284506526274
+    },
+    {
+      "id": "release500_0024",
+      "category": "punctuation",
+      "characters": 73,
+      "audio_seconds": 5.294149659863946,
+      "latency_seconds": 27.895444130990654,
+      "rtf": 5.2691075853922005
+    },
+    {
+      "id": "release500_0025",
+      "category": "question",
+      "characters": 39,
+      "audio_seconds": 2.5774149659863945,
+      "latency_seconds": 22.20310734701343,
+      "rtf": 8.614486856025586
+    },
+    {
+      "id": "release500_0026",
+      "category": "rare_words",
+      "characters": 78,
+      "audio_seconds": 5.572789115646258,
+      "latency_seconds": 29.195063063991256,
+      "rtf": 5.238860193367572
+    },
+    {
+      "id": "release500_0027",
+      "category": "short",
+      "characters": 25,
+      "audio_seconds": 1.9504761904761905,
+      "latency_seconds": 16.800069391028956,
+      "rtf": 8.613316826455275
+    },
+    {
+      "id": "release500_0028",
+      "category": "technical",
+      "characters": 82,
+      "audio_seconds": 5.7817687074829935,
+      "latency_seconds": 33.806427267962135,
+      "rtf": 5.847073616799738
+    },
+    {
+      "id": "release500_0029",
+      "category": "conversational",
+      "characters": 59,
+      "audio_seconds": 4.179591836734694,
+      "latency_seconds": 24.294171245070174,
+      "rtf": 5.81257026859589
+    },
+    {
+      "id": "release500_0030",
+      "category": "descriptive",
+      "characters": 65,
+      "audio_seconds": 4.179591836734694,
+      "latency_seconds": 26.80319137405604,
+      "rtf": 6.412872936175517
+    },
+    {
+      "id": "release500_0031",
+      "category": "emotional",
+      "characters": 70,
+      "audio_seconds": 4.876190476190477,
+      "latency_seconds": 30.29834362003021,
+      "rtf": 6.213527500201507
+    },
+    {
+      "id": "release500_0032",
+      "category": "homographs",
+      "characters": 60,
+      "audio_seconds": 4.1099319727891155,
+      "latency_seconds": 26.09945922100451,
+      "rtf": 6.350338495576772
+    },
+    {
+      "id": "release500_0033",
+      "category": "long",
+      "characters": 138,
+      "audio_seconds": 8.916462585034013,
+      "latency_seconds": 41.60403512697667,
+      "rtf": 4.665979891712624
+    },
+    {
+      "id": "release500_0034",
+      "category": "long_range",
+      "characters": 141,
+      "audio_seconds": 9.404081632653062,
+      "latency_seconds": 56.39644193497952,
+      "rtf": 5.997017480065096
+    },
+    {
+      "id": "release500_0035",
+      "category": "names_places",
+      "characters": 61,
+      "audio_seconds": 4.31891156462585,
+      "latency_seconds": 27.39686602097936,
+      "rtf": 6.343465387292033
+    },
+    {
+      "id": "release500_0036",
+      "category": "narrative",
+      "characters": 73,
+      "audio_seconds": 5.224489795918367,
+      "latency_seconds": 37.99643908103462,
+      "rtf": 7.272755917854284
+    },
+    {
+      "id": "release500_0037",
+      "category": "numbers",
+      "characters": 78,
+      "audio_seconds": 5.50312925170068,
+      "latency_seconds": 34.106267586001195,
+      "rtf": 6.197613398860482
+    },
+    {
+      "id": "release500_0038",
+      "category": "punctuation",
+      "characters": 67,
+      "audio_seconds": 5.433469387755102,
+      "latency_seconds": 35.09321151499171,
+      "rtf": 6.458711554366713
+    },
+    {
+      "id": "release500_0039",
+      "category": "question",
+      "characters": 45,
+      "audio_seconds": 2.9257142857142857,
+      "latency_seconds": 24.804103411966935,
+      "rtf": 8.477965033387136
+    },
+    {
+      "id": "release500_0040",
+      "category": "rare_words",
+      "characters": 82,
+      "audio_seconds": 5.851428571428571,
+      "latency_seconds": 37.69937764597125,
+      "rtf": 6.442764734418915
+    },
+    {
+      "id": "release500_0041",
+      "category": "short",
+      "characters": 22,
+      "audio_seconds": 2.2987755102040817,
+      "latency_seconds": 21.396492527914234,
+      "rtf": 9.307778177093372
+    },
+    {
+      "id": "release500_0042",
+      "category": "technical",
+      "characters": 66,
+      "audio_seconds": 4.527891156462585,
+      "latency_seconds": 30.09792682202533,
+      "rtf": 6.6472284297441755
+    },
+    {
+      "id": "release500_0043",
+      "category": "conversational",
+      "characters": 67,
+      "audio_seconds": 4.527891156462585,
+      "latency_seconds": 33.802263773046434,
+      "rtf": 7.4653437118957715
+    },
+    {
+      "id": "release500_0044",
+      "category": "descriptive",
+      "characters": 73,
+      "audio_seconds": 4.876190476190477,
+      "latency_seconds": 32.29951110703405,
+      "rtf": 6.623923176247216
+    },
+    {
+      "id": "release500_0045",
+      "category": "emotional",
+      "characters": 70,
+      "audio_seconds": 4.876190476190477,
+      "latency_seconds": 29.00711957598105,
+      "rtf": 5.948725694292988
+    },
+    {
+      "id": "release500_0046",
+      "category": "homographs",
+      "characters": 51,
+      "audio_seconds": 3.622312925170068,
+      "latency_seconds": 26.68827601603698,
+      "rtf": 7.367744468069103
+    },
+    {
+      "id": "release500_0047",
+      "category": "long",
+      "characters": 161,
+      "audio_seconds": 9.961360544217687,
+      "latency_seconds": 55.9090520599857,
+      "rtf": 5.612591955868866
+    },
+    {
+      "id": "release500_0048",
+      "category": "long_range",
+      "characters": 124,
+      "audio_seconds": 8.289523809523809,
+      "latency_seconds": 47.289532713009976,
+      "rtf": 5.704734529947205
+    },
+    {
+      "id": "release500_0049",
+      "category": "names_places",
+      "characters": 59,
+      "audio_seconds": 4.667210884353741,
+      "latency_seconds": 35.1004930799827,
+      "rtf": 7.520657186854969
+    },
+    {
+      "id": "release500_0050",
+      "category": "narrative",
+      "characters": 99,
+      "audio_seconds": 6.408707482993197,
+      "latency_seconds": 38.799001639010385,
+      "rtf": 6.054107125652308
+    }
+  ]
+}

evaluation/long_form.json

@@ -1,9 +0,0 @@
-{
-  "text_characters": 738,
-  "durations_seconds": {
-    "inflect-micro-v2-finalist": 44.37266666666667,
-    "inflect-nano-v2-finalist": 43.967333333333336
-  },
-  "asr_report": "release_polish_overnight_20260720/extended_benchmarks/multiseed_robustness/long_form/asr/report.json",
-  "signal_report": "release_polish_overnight_20260720/extended_benchmarks/multiseed_robustness/long_form/signal/report.json"
-}

evaluation/long_form_asr.json

@@ -1,149 +0,0 @@
-{
-  "format": "inflect_tts_multi_asr_wer_v1",
-  "manifest": "release_polish_overnight_20260720/extended_benchmarks/multiseed_robustness/long_form/combined_manifest.jsonl",
-  "asr_models": {
-    "whisper-large-v3": "openai/whisper-large-v3"
-  },
-  "normalization": {
-    "raw": "lowercase_punctuation_stripped",
-    "semantic": "transformers_whisper_EnglishTextNormalizer_then_lexical"
-  },
-  "systems": {
-    "inflect-micro-v2-finalist": {
-      "asr": {
-        "whisper-large-v3": {
-          "raw": {
-            "utterances": 1,
-            "errors": 16,
-            "words": 110,
-            "wer": 0.14545454545454545
-          },
-          "raw_95ci": [
-            0.14545454545454545,
-            0.14545454545454545
-          ],
-          "semantic": {
-            "utterances": 1,
-            "errors": 4,
-            "words": 103,
-            "wer": 0.038834951456310676
-          },
-          "semantic_95ci": [
-            0.038834951456310676,
-            0.038834951456310676
-          ],
-          "categories": {
-            "long_form": {
-              "raw": {
-                "utterances": 1,
-                "errors": 16,
-                "words": 110,
-                "wer": 0.14545454545454545
-              },
-              "semantic": {
-                "utterances": 1,
-                "errors": 4,
-                "words": 103,
-                "wer": 0.038834951456310676
-              }
-            }
-          }
-        }
-      },
-      "cross_asr_mean_semantic_wer": 0.038834951456310676,
-      "cross_asr_worst_semantic_wer": 0.038834951456310676
-    },
-    "inflect-nano-v2-finalist": {
-      "asr": {
-        "whisper-large-v3": {
-          "raw": {
-            "utterances": 1,
-            "errors": 18,
-            "words": 110,
-            "wer": 0.16363636363636364
-          },
-          "raw_95ci": [
-            0.16363636363636364,
-            0.16363636363636364
-          ],
-          "semantic": {
-            "utterances": 1,
-            "errors": 6,
-            "words": 103,
-            "wer": 0.05825242718446602
-          },
-          "semantic_95ci": [
-            0.05825242718446602,
-            0.05825242718446602
-          ],
-          "categories": {
-            "long_form": {
-              "raw": {
-                "utterances": 1,
-                "errors": 18,
-                "words": 110,
-                "wer": 0.16363636363636364
-              },
-              "semantic": {
-                "utterances": 1,
-                "errors": 6,
-                "words": 103,
-                "wer": 0.05825242718446602
-              }
-            }
-          }
-        }
-      },
-      "cross_asr_mean_semantic_wer": 0.05825242718446602,
-      "cross_asr_worst_semantic_wer": 0.05825242718446602
-    }
-  },
-  "rows": [
-    {
-      "id": "release_long_form",
-      "category": "long_form",
-      "text": "At seven forty-five on Tuesday morning, Morgan checked the maintenance report before the first delivery arrived. The document listed three unresolved items: a fluorescent lamp near the loading bay, a pressure sensor marked B seventeen, and a package weighing twelve point six kilograms. Although the weather changed without warning, the technicians finished their inspection, called Saskatchewan headquarters, and sent the revised PDF before noon. Could the replacement parts arrive by Friday? The coordinator replied, yes, but only if invoice eight eight nine five three was approved before five P.M. After one final review, everyone agreed that clear punctuation, stable pacing, and accurate numbers mattered more than speaking quickly.",
-      "model": "inflect-micro-v2-finalist",
-      "audio": "release_polish_overnight_20260720/extended_benchmarks/multiseed_robustness/long_form/audio/inflect-micro-v2-finalist.wav",
-      "asr": "whisper-large-v3",
-      "hypothesis": "At 7.45 on Tuesday morning, Morgan checked the maintenance report before the first delivery arrived. The document listed three unresolved items, a fluorescent lamp near the loading bay, a pressure sensor marked B17, and a package weighing 12.6 kilograms. Although the weather changed without warning, the technicians finished their inspection, called Saskatchewan headquarters, and sent the revised PDF before noon. Could the replacement parts arrive by Friday? The coordinator replied, yes, but only if invoice 88953 was approved before 5pm. After one final review, everyone agreed that clear punctuation, stable pacing, and accurate numbers mattered more than speaking quickly.",
-      "raw": {
-        "normalized_reference": "at seven forty-five on tuesday morning, morgan checked the maintenance report before the first delivery arrived. the document listed three unresolved items: a fluorescent lamp near the loading bay, a pressure sensor marked b seventeen, and a package weighing twelve point six kilograms. although the weather changed without warning, the technicians finished their inspection, called saskatchewan headquarters, and sent the revised pdf before noon. could the replacement parts arrive by friday? the coordinator replied, yes, but only if invoice eight eight nine five three was approved before five p.m. after one final review, everyone agreed that clear punctuation, stable pacing, and accurate numbers mattered more than speaking quickly.",
-        "normalized_hypothesis": "at 7.45 on tuesday morning, morgan checked the maintenance report before the first delivery arrived. the document listed three unresolved items, a fluorescent lamp near the loading bay, a pressure sensor marked b17, and a package weighing 12.6 kilograms. although the weather changed without warning, the technicians finished their inspection, called saskatchewan headquarters, and sent the revised pdf before noon. could the replacement parts arrive by friday? the coordinator replied, yes, but only if invoice 88953 was approved before 5pm. after one final review, everyone agreed that clear punctuation, stable pacing, and accurate numbers mattered more than speaking quickly.",
-        "errors": 16,
-        "words": 110,
-        "wer": 0.14545454545454545
-      },
-      "semantic": {
-        "normalized_reference": "at 745 on tuesday morning morgan checked the maintenance report before the 1st delivery arrived the document listed 3 unresolved items a fluorescent lamp near the loading bay a pressure sensor marked b 17 and a package weighing 12.6 kilograms although the weather changed without warning the technicians finished their inspection called saskatchewan headquarters and sent the revised pdf before noon could the replacement parts arrive by friday the coordinator replied yes but only if invoice 88953 was approved before 5 p m after one final review everyone agreed that clear punctuation stable pacing and accurate numbers mattered more than speaking quickly",
-        "normalized_hypothesis": "at 7.45 on tuesday morning morgan checked the maintenance report before the 1st delivery arrived the document listed 3 unresolved items a fluorescent lamp near the loading bay a pressure sensor marked b 17 and a package weighing 12.6 kilograms although the weather changed without warning the technicians finished their inspection called saskatchewan headquarters and sent the revised pdf before noon could the replacement parts arrive by friday the coordinator replied yes but only if invoice 88953 was approved before 5 pm after one final review everyone agreed that clear punctuation stable pacing and accurate numbers mattered more than speaking quickly",
-        "errors": 4,
-        "words": 103,
-        "wer": 0.038834951456310676
-      }
-    },
-    {
-      "id": "release_long_form",
-      "category": "long_form",
-      "text": "At seven forty-five on Tuesday morning, Morgan checked the maintenance report before the first delivery arrived. The document listed three unresolved items: a fluorescent lamp near the loading bay, a pressure sensor marked B seventeen, and a package weighing twelve point six kilograms. Although the weather changed without warning, the technicians finished their inspection, called Saskatchewan headquarters, and sent the revised PDF before noon. Could the replacement parts arrive by Friday? The coordinator replied, yes, but only if invoice eight eight nine five three was approved before five P.M. After one final review, everyone agreed that clear punctuation, stable pacing, and accurate numbers mattered more than speaking quickly.",
-      "model": "inflect-nano-v2-finalist",
-      "audio": "release_polish_overnight_20260720/extended_benchmarks/multiseed_robustness/long_form/audio/inflect-nano-v2-finalist.wav",
-      "asr": "whisper-large-v3",
-      "hypothesis": "At 7.45 on Tuesday morning, Morgan checked the maintenance report before the first delivery arrived. The document listed three unresolved items, a fluorescent lamp near the loading bay, a pressure sensor marked B17, and a package weighing 12.6 kg. Although the weather changed without warning, the technicians finished their inspection, called Saskatchewan headquarters, and sent the revised PDEFF before noon. Could the replacement parts arrive by Friday? The coordinator replied, yes, but only if invoice 88953 was approved before 5pm. After one final review, everyone agreed that clear punctuation, stable pacing, and accurate numbers mattered more than speaking quickly.",
-      "raw": {
-        "normalized_reference": "at seven forty-five on tuesday morning, morgan checked the maintenance report before the first delivery arrived. the document listed three unresolved items: a fluorescent lamp near the loading bay, a pressure sensor marked b seventeen, and a package weighing twelve point six kilograms. although the weather changed without warning, the technicians finished their inspection, called saskatchewan headquarters, and sent the revised pdf before noon. could the replacement parts arrive by friday? the coordinator replied, yes, but only if invoice eight eight nine five three was approved before five p.m. after one final review, everyone agreed that clear punctuation, stable pacing, and accurate numbers mattered more than speaking quickly.",
-        "normalized_hypothesis": "at 7.45 on tuesday morning, morgan checked the maintenance report before the first delivery arrived. the document listed three unresolved items, a fluorescent lamp near the loading bay, a pressure sensor marked b17, and a package weighing 12.6 kg. although the weather changed without warning, the technicians finished their inspection, called saskatchewan headquarters, and sent the revised pdeff before noon. could the replacement parts arrive by friday? the coordinator replied, yes, but only if invoice 88953 was approved before 5pm. after one final review, everyone agreed that clear punctuation, stable pacing, and accurate numbers mattered more than speaking quickly.",
-        "errors": 18,
-        "words": 110,
-        "wer": 0.16363636363636364
-      },
-      "semantic": {
-        "normalized_reference": "at 745 on tuesday morning morgan checked the maintenance report before the 1st delivery arrived the document listed 3 unresolved items a fluorescent lamp near the loading bay a pressure sensor marked b 17 and a package weighing 12.6 kilograms although the weather changed without warning the technicians finished their inspection called saskatchewan headquarters and sent the revised pdf before noon could the replacement parts arrive by friday the coordinator replied yes but only if invoice 88953 was approved before 5 p m after one final review everyone agreed that clear punctuation stable pacing and accurate numbers mattered more than speaking quickly",
-        "normalized_hypothesis": "at 7.45 on tuesday morning morgan checked the maintenance report before the 1st delivery arrived the document listed 3 unresolved items a fluorescent lamp near the loading bay a pressure sensor marked b 17 and a package weighing 12.6 kg although the weather changed without warning the technicians finished their inspection called saskatchewan headquarters and sent the revised pdeff before noon could the replacement parts arrive by friday the coordinator replied yes but only if invoice 88953 was approved before 5 pm after one final review everyone agreed that clear punctuation stable pacing and accurate numbers mattered more than speaking quickly",
-        "errors": 6,
-        "words": 103,
-        "wer": 0.05825242718446602
-      }
-    }
-  ]
-}

evaluation/long_form_signal.json

@@ -1,485 +0,0 @@
-{
-  "format": "inflect_tts_signal_diagnostics_v1",
-  "manifest": "release_polish_overnight_20260720/extended_benchmarks/multiseed_robustness/long_form/combined_manifest.jsonl",
-  "metrics_are_diagnostic_not_mos": true,
-  "systems": {
-    "inflect-micro-v2-finalist": {
-      "count": {
-        "value": 1
-      },
-      "seconds": {
-        "mean": 44.37266666666667,
-        "median": 44.37266666666667,
-        "p05": 44.37266666666667,
-        "p95": 44.37266666666667
-      },
-      "words": {
-        "mean": 108.0,
-        "median": 108.0,
-        "p05": 108.0,
-        "p95": 108.0
-      },
-      "words_per_second": {
-        "mean": 2.4339307982391563,
-        "median": 2.4339307982391563,
-        "p05": 2.4339307982391563,
-        "p95": 2.4339307982391563
-      },
-      "peak_dbfs": {
-        "mean": -5.35886221619594,
-        "median": -5.35886221619594,
-        "p05": -5.35886221619594,
-        "p95": -5.35886221619594
-      },
-      "clip_fraction": {
-        "mean": 0.0,
-        "median": 0.0,
-        "p05": 0.0,
-        "p95": 0.0
-      },
-      "dc_offset": {
-        "mean": 3.754604676942108e-06,
-        "median": 3.754604676942108e-06,
-        "p05": 3.754604676942108e-06,
-        "p95": 3.754604676942108e-06
-      },
-      "leading_silence_seconds": {
-        "mean": 0.30933333333333335,
-        "median": 0.30933333333333335,
-        "p05": 0.30933333333333335,
-        "p95": 0.30933333333333335
-      },
-      "trailing_silence_seconds": {
-        "mean": 0.021333333333333333,
-        "median": 0.021333333333333333,
-        "p05": 0.021333333333333333,
-        "p95": 0.021333333333333333
-      },
-      "internal_silence_fraction": {
-        "mean": 0.13581730769230768,
-        "median": 0.13581730769230768,
-        "p05": 0.13581730769230768,
-        "p95": 0.13581730769230768
-      },
-      "tail_to_overall_rms_db": {
-        "mean": -48.11232409407665,
-        "median": -48.11232409407665,
-        "p05": -48.11232409407665,
-        "p95": -48.11232409407665
-      },
-      "active_hf_ratio_median": {
-        "mean": 7.739095963188447e-06,
-        "median": 7.739095963188447e-06,
-        "p05": 7.739095963188447e-06,
-        "p95": 7.739095963188447e-06
-      },
-      "active_flatness_median": {
-        "mean": 0.0004935810575261712,
-        "median": 0.0004935810575261712,
-        "p05": 0.0004935810575261712,
-        "p95": 0.0004935810575261712
-      },
-      "active_centroid_hz_median": {
-        "mean": 1304.1968200062613,
-        "median": 1304.1968200062613,
-        "p05": 1304.1968200062613,
-        "p95": 1304.1968200062613
-      },
-      "rms_jump_db_p95": {
-        "mean": 7.320098400115967,
-        "median": 7.320098400115967,
-        "p05": 7.320098400115967,
-        "p95": 7.320098400115967
-      },
-      "voiced_fraction": {
-        "mean": 0.854326923076923,
-        "median": 0.854326923076923,
-        "p05": 0.854326923076923,
-        "p95": 0.854326923076923
-      },
-      "f0_median_hz": {
-        "mean": 107.51896117937795,
-        "median": 107.51896117937795,
-        "p05": 107.51896117937795,
-        "p95": 107.51896117937795
-      },
-      "f0_range_semitones_p05_p95": {
-        "mean": 24.84172183582185,
-        "median": 24.84172183582185,
-        "p05": 24.84172183582185,
-        "p95": 24.84172183582185
-      },
-      "f0_jump_cents_p95": {
-        "mean": 1821.961141844264,
-        "median": 1821.961141844264,
-        "p05": 1821.961141844264,
-        "p95": 1821.961141844264
-      },
-      "f0_large_jump_fraction": {
-        "mean": 0.2225425194580571,
-        "median": 0.2225425194580571,
-        "p05": 0.2225425194580571,
-        "p95": 0.2225425194580571
-      }
-    },
-    "inflect-nano-v2-finalist": {
-      "count": {
-        "value": 1
-      },
-      "seconds": {
-        "mean": 43.967333333333336,
-        "median": 43.967333333333336,
-        "p05": 43.967333333333336,
-        "p95": 43.967333333333336
-      },
-      "words": {
-        "mean": 108.0,
-        "median": 108.0,
-        "p05": 108.0,
-        "p95": 108.0
-      },
-      "words_per_second": {
-        "mean": 2.456369122530363,
-        "median": 2.456369122530363,
-        "p05": 2.456369122530363,
-        "p95": 2.456369122530363
-      },
-      "peak_dbfs": {
-        "mean": -3.501703011153014,
-        "median": -3.501703011153014,
-        "p05": -3.501703011153014,
-        "p95": -3.501703011153014
-      },
-      "clip_fraction": {
-        "mean": 0.0,
-        "median": 0.0,
-        "p05": 0.0,
-        "p95": 0.0
-      },
-      "dc_offset": {
-        "mean": 5.1231389079475775e-05,
-        "median": 5.1231389079475775e-05,
-        "p05": 5.1231389079475775e-05,
-        "p95": 5.1231389079475775e-05
-      },
-      "leading_silence_seconds": {
-        "mean": 0.33066666666666666,
-        "median": 0.33066666666666666,
-        "p05": 0.33066666666666666,
-        "p95": 0.33066666666666666
-      },
-      "trailing_silence_seconds": {
-        "mean": 0.064,
-        "median": 0.064,
-        "p05": 0.064,
-        "p95": 0.064
-      },
-      "internal_silence_fraction": {
-        "mean": 0.13221737020863658,
-        "median": 0.13221737020863658,
-        "p05": 0.13221737020863658,
-        "p95": 0.13221737020863658
-      },
-      "tail_to_overall_rms_db": {
-        "mean": -59.80073796381536,
-        "median": -59.80073796381536,
-        "p05": -59.80073796381536,
-        "p95": -59.80073796381536
-      },
-      "active_hf_ratio_median": {
-        "mean": 7.782135980960447e-06,
-        "median": 7.782135980960447e-06,
-        "p05": 7.782135980960447e-06,
-        "p95": 7.782135980960447e-06
-      },
-      "active_flatness_median": {
-        "mean": 0.0004650004848372191,
-        "median": 0.0004650004848372191,
-        "p05": 0.0004650004848372191,
-        "p95": 0.0004650004848372191
-      },
-      "active_centroid_hz_median": {
-        "mean": 1315.4845530140253,
-        "median": 1315.4845530140253,
-        "p05": 1315.4845530140253,
-        "p95": 1315.4845530140253
-      },
-      "rms_jump_db_p95": {
-        "mean": 7.494379043579102,
-        "median": 7.494379043579102,
-        "p05": 7.494379043579102,
-        "p95": 7.494379043579102
-      },
-      "voiced_fraction": {
-        "mean": 0.8561377971858322,
-        "median": 0.8561377971858322,
-        "p05": 0.8561377971858322,
-        "p95": 0.8561377971858322
-      },
-      "f0_median_hz": {
-        "mean": 107.39862455247871,
-        "median": 107.39862455247871,
-        "p05": 107.39862455247871,
-        "p95": 107.39862455247871
-      },
-      "f0_range_semitones_p05_p95": {
-        "mean": 24.13550808891641,
-        "median": 24.13550808891641,
-        "p05": 24.13550808891641,
-        "p95": 24.13550808891641
-      },
-      "f0_jump_cents_p95": {
-        "mean": 1733.9331321194263,
-        "median": 1733.9331321194263,
-        "p05": 1733.9331321194263,
-        "p95": 1733.9331321194263
-      },
-      "f0_large_jump_fraction": {
-        "mean": 0.23409817020040663,
-        "median": 0.23409817020040663,
-        "p05": 0.23409817020040663,
-        "p95": 0.23409817020040663
-      }
-    }
-  },
-  "systems_by_category": {
-    "inflect-micro-v2-finalist::long_form": {
-      "count": {
-        "value": 1
-      },
-      "seconds": {
-        "mean": 44.37266666666667,
-        "median": 44.37266666666667,
-        "p05": 44.37266666666667,
-        "p95": 44.37266666666667
-      },
-      "words": {
-        "mean": 108.0,
-        "median": 108.0,
-        "p05": 108.0,
-        "p95": 108.0
-      },
-      "words_per_second": {
-        "mean": 2.4339307982391563,
-        "median": 2.4339307982391563,
-        "p05": 2.4339307982391563,
-        "p95": 2.4339307982391563
-      },
-      "peak_dbfs": {
-        "mean": -5.35886221619594,
-        "median": -5.35886221619594,
-        "p05": -5.35886221619594,
-        "p95": -5.35886221619594
-      },
-      "clip_fraction": {
-        "mean": 0.0,
-        "median": 0.0,
-        "p05": 0.0,
-        "p95": 0.0
-      },
-      "dc_offset": {
-        "mean": 3.754604676942108e-06,
-        "median": 3.754604676942108e-06,
-        "p05": 3.754604676942108e-06,
-        "p95": 3.754604676942108e-06
-      },
-      "leading_silence_seconds": {
-        "mean": 0.30933333333333335,
-        "median": 0.30933333333333335,
-        "p05": 0.30933333333333335,
-        "p95": 0.30933333333333335
-      },
-      "trailing_silence_seconds": {
-        "mean": 0.021333333333333333,
-        "median": 0.021333333333333333,
-        "p05": 0.021333333333333333,
-        "p95": 0.021333333333333333
-      },
-      "internal_silence_fraction": {
-        "mean": 0.13581730769230768,
-        "median": 0.13581730769230768,
-        "p05": 0.13581730769230768,
-        "p95": 0.13581730769230768
-      },
-      "tail_to_overall_rms_db": {
-        "mean": -48.11232409407665,
-        "median": -48.11232409407665,
-        "p05": -48.11232409407665,
-        "p95": -48.11232409407665
-      },
-      "active_hf_ratio_median": {
-        "mean": 7.739095963188447e-06,
-        "median": 7.739095963188447e-06,
-        "p05": 7.739095963188447e-06,
-        "p95": 7.739095963188447e-06
-      },
-      "active_flatness_median": {
-        "mean": 0.0004935810575261712,
-        "median": 0.0004935810575261712,
-        "p05": 0.0004935810575261712,
-        "p95": 0.0004935810575261712
-      },
-      "active_centroid_hz_median": {
-        "mean": 1304.1968200062613,
-        "median": 1304.1968200062613,
-        "p05": 1304.1968200062613,
-        "p95": 1304.1968200062613
-      },
-      "rms_jump_db_p95": {
-        "mean": 7.320098400115967,
-        "median": 7.320098400115967,
-        "p05": 7.320098400115967,
-        "p95": 7.320098400115967
-      },
-      "voiced_fraction": {
-        "mean": 0.854326923076923,
-        "median": 0.854326923076923,
-        "p05": 0.854326923076923,
-        "p95": 0.854326923076923
-      },
-      "f0_median_hz": {
-        "mean": 107.51896117937795,
-        "median": 107.51896117937795,
-        "p05": 107.51896117937795,
-        "p95": 107.51896117937795
-      },
-      "f0_range_semitones_p05_p95": {
-        "mean": 24.84172183582185,
-        "median": 24.84172183582185,
-        "p05": 24.84172183582185,
-        "p95": 24.84172183582185
-      },
-      "f0_jump_cents_p95": {
-        "mean": 1821.961141844264,
-        "median": 1821.961141844264,
-        "p05": 1821.961141844264,
-        "p95": 1821.961141844264
-      },
-      "f0_large_jump_fraction": {
-        "mean": 0.2225425194580571,
-        "median": 0.2225425194580571,
-        "p05": 0.2225425194580571,
-        "p95": 0.2225425194580571
-      }
-    },
-    "inflect-nano-v2-finalist::long_form": {
-      "count": {
-        "value": 1
-      },
-      "seconds": {
-        "mean": 43.967333333333336,
-        "median": 43.967333333333336,
-        "p05": 43.967333333333336,
-        "p95": 43.967333333333336
-      },
-      "words": {
-        "mean": 108.0,
-        "median": 108.0,
-        "p05": 108.0,
-        "p95": 108.0
-      },
-      "words_per_second": {
-        "mean": 2.456369122530363,
-        "median": 2.456369122530363,
-        "p05": 2.456369122530363,
-        "p95": 2.456369122530363
-      },
-      "peak_dbfs": {
-        "mean": -3.501703011153014,
-        "median": -3.501703011153014,
-        "p05": -3.501703011153014,
-        "p95": -3.501703011153014
-      },
-      "clip_fraction": {
-        "mean": 0.0,
-        "median": 0.0,
-        "p05": 0.0,
-        "p95": 0.0
-      },
-      "dc_offset": {
-        "mean": 5.1231389079475775e-05,
-        "median": 5.1231389079475775e-05,
-        "p05": 5.1231389079475775e-05,
-        "p95": 5.1231389079475775e-05
-      },
-      "leading_silence_seconds": {
-        "mean": 0.33066666666666666,
-        "median": 0.33066666666666666,
-        "p05": 0.33066666666666666,
-        "p95": 0.33066666666666666
-      },
-      "trailing_silence_seconds": {
-        "mean": 0.064,
-        "median": 0.064,
-        "p05": 0.064,
-        "p95": 0.064
-      },
-      "internal_silence_fraction": {
-        "mean": 0.13221737020863658,
-        "median": 0.13221737020863658,
-        "p05": 0.13221737020863658,
-        "p95": 0.13221737020863658
-      },
-      "tail_to_overall_rms_db": {
-        "mean": -59.80073796381536,
-        "median": -59.80073796381536,
-        "p05": -59.80073796381536,
-        "p95": -59.80073796381536
-      },
-      "active_hf_ratio_median": {
-        "mean": 7.782135980960447e-06,
-        "median": 7.782135980960447e-06,
-        "p05": 7.782135980960447e-06,
-        "p95": 7.782135980960447e-06
-      },
-      "active_flatness_median": {
-        "mean": 0.0004650004848372191,
-        "median": 0.0004650004848372191,
-        "p05": 0.0004650004848372191,
-        "p95": 0.0004650004848372191
-      },
-      "active_centroid_hz_median": {
-        "mean": 1315.4845530140253,
-        "median": 1315.4845530140253,
-        "p05": 1315.4845530140253,
-        "p95": 1315.4845530140253
-      },
-      "rms_jump_db_p95": {
-        "mean": 7.494379043579102,
-        "median": 7.494379043579102,
-        "p05": 7.494379043579102,
-        "p95": 7.494379043579102
-      },
-      "voiced_fraction": {
-        "mean": 0.8561377971858322,
-        "median": 0.8561377971858322,
-        "p05": 0.8561377971858322,
-        "p95": 0.8561377971858322
-      },
-      "f0_median_hz": {
-        "mean": 107.39862455247871,
-        "median": 107.39862455247871,
-        "p05": 107.39862455247871,
-        "p95": 107.39862455247871
-      },
-      "f0_range_semitones_p05_p95": {
-        "mean": 24.13550808891641,
-        "median": 24.13550808891641,
-        "p05": 24.13550808891641,
-        "p95": 24.13550808891641
-      },
-      "f0_jump_cents_p95": {
-        "mean": 1733.9331321194263,
-        "median": 1733.9331321194263,
-        "p05": 1733.9331321194263,
-        "p95": 1733.9331321194263
-      },
-      "f0_large_jump_fraction": {
-        "mean": 0.23409817020040663,
-        "median": 0.23409817020040663,
-        "p05": 0.23409817020040663,
-        "p95": 0.23409817020040663
-      }
-    }
-  }
-}