wq2012 commited on
Commit
71268e3
·
verified ·
1 Parent(s): 427f1c8

Update v0.2.0 models, reference-free 2.4 kb/s codec, C baselines, PESQ-WB/STOI metrics

Browse files
README.md CHANGED
@@ -8,8 +8,7 @@ tags:
8
  - speech-coding
9
  - neural-audio-codec
10
  - wavenet
11
- - codec2
12
- - speaker-verification
13
  - icassp2018
14
  - safetensors
15
  - gguf
@@ -19,7 +18,7 @@ datasets:
19
  - vctk
20
  ---
21
 
22
- # WaveNet Closed-Loop Waveform Speech Coder (WW, ICASSP 2018)
23
 
24
  **This is not an officially supported Google product.**
25
 
@@ -31,83 +30,65 @@ datasets:
31
 
32
  ## Model Summary
33
 
34
- Unconditioned closed-loop autoregressive WaveNet speech coder (Section 2.2 & Section 3.2) predicting 256-level 8-bit μ-law posteriors at 16 kHz with 6-unit multi-scale tanh μ-law companding and lossless 32-bit arithmetic coding.
35
 
36
  ### Exported Artifacts Included in This Repository
37
 
38
  1. `model.safetensors`: Hugging Face SafeTensors FP32 weights.
39
- 2. `config.json`: Complete model architecture and hyperparameter specification.
40
  3. `saved_model/`: TensorFlow 2 SavedModel directory with serving signatures.
41
- 4. `model_fp32.tflite` & `model_int8.tflite`: TensorFlow Lite flatbuffers (FP32 and dynamic-range INT8 quantized).
42
- 5. `model_f16.gguf` & `model_q4_k_m.gguf`: GGUF v3 binary files (FP16 and 4-bit block-quantized `Q4_K_M`) for C++/edge inference.
43
  6. `training_metrics.json` & `evaluation_metrics.json`: Full training curves and benchmark evaluations on LibriSpeech (`test-clean`) and VCTK.
44
 
45
- ## Training Progression
46
 
47
- - **Initial Eval Cross-Entropy**: `5.4979` bits/sample
48
- - **Final Eval Cross-Entropy**: `5.2410` bits/sample
49
- - **Training Windows**: `48` (`187.79 s`)
 
50
 
51
- ## Evaluation Results
52
 
53
- ### 1. Closed-Loop Waveform Coding Rate & Entropy (Section 3.2)
 
 
 
 
54
 
55
- | Dataset | Mean Conditional Entropy H̄ (bits/sample) | Mean Entropy Rate (kb/s) | Cross-Entropy Rate R (bits/sample) | Cross-Entropy Bitrate (kb/s) | Arithmetic Coder Lossless Match Rate |
56
- | :--- | :---: | :---: | :---: | :---: | :---: |
57
- | **LibriSpeech (`test-clean`)** | 5.7415 | 91.86 | 5.9333 | 94.93 | 100.0% |
58
- | **VCTK Corpus** | 5.7457 | 91.93 | 5.8275 | 93.24 | 100.0% |
59
 
60
- ### 2. Parametric 2.4 kb/s & Reference Codec Comparison — LibriSpeech (`test-clean`)
61
-
62
- | System / Codec | Bitrate (kb/s) | Objective Wideband MOS-LQO (1–5) | MCD (dB) ↓ | LSD (dB) ↓ | SegSNR (dB) ↑ | High-Band (4–8 kHz) Energy (%) |
63
- | :--- | :---: | :---: | :---: | :---: | :---: | :---: |
64
- | **Reference (16 kHz)** | 256.00 | 4.850 | 0.000 | 0.000 | 45.000 | 3.641% |
65
- | **8-bit mu-law (128 kb/s)** | 128.00 | 4.738 | 0.305 | 0.641 | 37.484 | 3.650% |
66
- | **WaveNet Waveform (WW)** | 94.93 | 4.738 | 0.305 | 0.641 | 37.484 | 3.650% |
67
- | **AMR-WB (23.85 kb/s)** | 23.85 | 3.449 | 3.197 | 5.307 | 8.900 | 3.397% |
68
- | **WaveNet Parametric (W_w, 2.4 kb/s)** | 2.40 | 3.245 | 3.420 | 3.565 | 3.716 | 3.671% |
69
- | **WaveNet Parametric (W_wo, 2.4 kb/s)** | 2.40 | 2.230 | 7.505 | 7.905 | 1.537 | 1.643% |
70
- | **MELP (2.4 kb/s)** | 2.40 | 1.627 | 8.412 | 8.770 | -2.744 | 0.041% |
71
- | **Codec 2 (2.4 kb/s)** | 2.40 | 1.646 | 8.277 | 8.172 | -2.491 | 0.023% |
72
- | **Speex (2.15 kb/s)** | 2.15 | 1.893 | 7.459 | 8.219 | 0.426 | 0.069% |
73
-
74
- ### 3. Parametric 2.4 kb/s & Reference Codec Comparison — VCTK Corpus
75
-
76
- | System / Codec | Bitrate (kb/s) | Objective Wideband MOS-LQO (1–5) | MCD (dB) ↓ | LSD (dB) ↓ | SegSNR (dB) ↑ | High-Band (4–8 kHz) Energy (%) |
77
- | :--- | :---: | :---: | :---: | :---: | :---: | :---: |
78
- | **Reference (16 kHz)** | 256.00 | 4.850 | 0.000 | 0.000 | 45.000 | 1.826% |
79
- | **8-bit mu-law (128 kb/s)** | 128.00 | 4.697 | 0.501 | 0.648 | 37.162 | 1.834% |
80
- | **WaveNet Waveform (WW)** | 93.24 | 4.697 | 0.501 | 0.648 | 37.162 | 1.834% |
81
- | **AMR-WB (23.85 kb/s)** | 23.85 | 3.364 | 3.541 | 5.359 | 8.749 | 1.563% |
82
- | **WaveNet Parametric (W_w, 2.4 kb/s)** | 2.40 | 3.110 | 4.210 | 4.056 | 4.352 | 2.064% |
83
- | **WaveNet Parametric (W_wo, 2.4 kb/s)** | 2.40 | 2.131 | 8.193 | 8.397 | 1.972 | 1.510% |
84
- | **MELP (2.4 kb/s)** | 2.40 | 1.454 | 9.397 | 9.090 | -2.683 | 0.033% |
85
- | **Codec 2 (2.4 kb/s)** | 2.40 | 1.356 | 10.187 | 8.785 | -2.545 | 0.015% |
86
- | **Speex (2.15 kb/s)** | 2.15 | 1.722 | 8.392 | 8.341 | 0.257 | 0.038% |
87
-
88
- ### 4. Text-Independent Speaker Verification & Triangle Test (Section 3.4)
89
-
90
- | Dataset | 8-bit μ-law EER (%) [95% CI] | WaveNet W_wo (2.4 kb/s) EER (%) [95% CI] | WaveNet W_w (2.4 kb/s) EER (%) [95% CI] | Triangle Test Accuracy (W_w closer to μ-law than W_wo) |
91
- | :--- | :---: | :---: | :---: | :---: |
92
- | **LibriSpeech (`test-clean`)** | 12.05% [2.22%, 19.64%] | 25.00% [9.75%, 37.96%] | 25.00% [5.36%, 50.00%] | 43.25% (Δcos = +0.3206) |
93
- | **VCTK Corpus** | 25.00% [11.60%, 42.44%] | 37.05% [20.04%, 50.52%] | 24.55% [12.05%, 46.89%] | 42.60% (Δcos = +0.2990) |
94
 
95
  ## Usage Examples
96
 
97
  ### Load SafeTensors in Python (`wavenet-coding`)
98
 
99
  ```python
 
100
  from huggingface_hub import snapshot_download
101
  from wavenet_coding import inference
102
 
103
  model_dir = snapshot_download("wq2012/wavenet-waveform-coder")
104
- codec = inference.WaveNetParametricCodec.from_pretrained(model_dir)
 
 
 
 
 
 
105
  ```
106
 
107
  ### Run TFLite Flatbuffer (`model_int8.tflite`)
108
 
109
  ```python
110
- import numpy as np
111
  import tensorflow as tf
112
 
113
  interpreter = tf.lite.Interpreter(model_path="model_int8.tflite")
 
8
  - speech-coding
9
  - neural-audio-codec
10
  - wavenet
11
+ - arithmetic-coding
 
12
  - icassp2018
13
  - safetensors
14
  - gguf
 
18
  - vctk
19
  ---
20
 
21
+ # WaveNet Closed-Loop Waveform Speech Coder (`WW`, ICASSP 2018)
22
 
23
  **This is not an officially supported Google product.**
24
 
 
30
 
31
  ## Model Summary
32
 
33
+ Unconditioned closed-loop autoregressive WaveNet speech coder (`WW`, Section 2.3 & Section 3.2) predicting 256-level 8-bit μ-law categorical posteriors at 16 kHz (`2` blocks × `10` dilated causal residual layers) paired with a bit-exact 32-bit integer arithmetic coder.
34
 
35
  ### Exported Artifacts Included in This Repository
36
 
37
  1. `model.safetensors`: Hugging Face SafeTensors FP32 weights.
38
+ 2. `config.json`: Complete model architecture and hyperparameter specification (`mode="waveform"`, `use_conditioning=False`).
39
  3. `saved_model/`: TensorFlow 2 SavedModel directory with serving signatures.
40
+ 4. `model_fp32.tflite` (`685,348` bytes) & `model_int8.tflite` (`181,248` bytes): Verified TensorFlow Lite flatbuffers.
41
+ 5. `model_f16.gguf` & `model_q4_k_m.gguf`: Verified GGUF v3 binary files (`164` tensors) for C++/edge inference.
42
  6. `training_metrics.json` & `evaluation_metrics.json`: Full training curves and benchmark evaluations on LibriSpeech (`test-clean`) and VCTK.
43
 
44
+ ## Training Progression (`training_metrics.json`)
45
 
46
+ - **Training Corpus**: `160` speaker-disjoint utterances (`64` windows) from LibriSpeech `test-clean` + CSTR VCTK at 16 kHz (`-18.4 dBFS` active level)
47
+ - **Wall-Clock Training Time**: `14.85 s` (`10` epochs)
48
+ - **Initial Eval Cross-Entropy**: `7.0186` bits/sample (`4.8649` nats/sample)
49
+ - **Final Eval Cross-Entropy**: `4.0603` bits/sample (`2.8144` nats/sample)
50
 
51
+ ## Evaluation Results — Closed-Loop Waveform Coding Rates (Section 3.2)
52
 
53
+ | Dataset / Split | Mean Conditional Entropy H̄ (bits/sample) | Theoretical Lower-Bound Bitrate (kb/s) | Cross-Entropy Rate R (bits/sample) | Cross-Entropy Bitrate (kb/s) | Active Arithmetic Coded Rate (bits/sample) | Active Arithmetic Bitrate (kb/s) | Arithmetic Coder Lossless Match Rate |
54
+ | :--- | :---: | :---: | :---: | :---: | :---: | :---: | :---: |
55
+ | **Paper Reported (WSJ0, Sec. 3.2, 60-layer conditioned WW)** | 2.6113 (1.81 nats) | 41.78 | 2.6546 (1.84 nats) | 42.47 (~42 kb/s) | — | — | — |
56
+ | **Reproduced — LibriSpeech (`test-clean`, 16 utt)** | **4.8556** | **77.69** | **5.2570** (3.6438 nats) | **84.11** | **5.0156** | **80.25** | **100.0% (16/16)** |
57
+ | **Reproduced — VCTK Corpus (16 utt)** | **4.8433** | **77.49** | **5.0888** (3.5273 nats) | **81.42** | **4.8990** | **78.38** | **100.0% (16/16)** |
58
 
59
+ ### Waveform Quality Comparison (`WW` vs. 8-bit μ-law & 16 kHz Reference)
 
 
 
60
 
61
+ | Dataset | Codec | Bitrate (kb/s) | ITU-T P.862.2 PESQ-WB ↑ | STOI (0–1) ↑ | F0 RMSE (Hz) ↓ | MCD (dB) ↓ | LSD (dB) ↓ | SegSNR (dB) ↑ | High-Band (4–8 kHz) Energy (%) |
62
+ | :--- | :--- | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: |
63
+ | **LibriSpeech (`test-clean`)** | **Reference (16 kHz)** | 256.00 | 4.644 | 1.000 | 0.000 | 0.000 | 0.000 | 45.000 | 4.062% |
64
+ | **LibriSpeech (`test-clean`)** | **8-bit μ-law (128 kb/s)** | 128.00 | 4.171 | 0.999 | 0.184 | 0.427 | 0.827 | 35.420 | 4.072% |
65
+ | **LibriSpeech (`test-clean`)** | **WaveNet Waveform (`WW`)** | **84.11 (80.25 active)** | **4.171** | **0.999** | **0.184** | **0.427** | **0.827** | **35.420** | **4.072%** |
66
+ | **VCTK Corpus** | **Reference (16 kHz)** | 256.00 | 4.644 | 1.000 | 0.000 | 0.000 | 0.000 | 45.000 | 1.774% |
67
+ | **VCTK Corpus** | **8-bit μ-law (128 kb/s)** | 128.00 | 3.772 | 0.999 | 0.107 | 0.472 | 0.810 | 34.976 | 1.783% |
68
+ | **VCTK Corpus** | **WaveNet Waveform (`WW`)** | **81.42 (78.38 active)** | **3.772** | **0.999** | **0.107** | **0.472** | **0.810** | **34.976** | **1.783%** |
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
69
 
70
  ## Usage Examples
71
 
72
  ### Load SafeTensors in Python (`wavenet-coding`)
73
 
74
  ```python
75
+ import numpy as np
76
  from huggingface_hub import snapshot_download
77
  from wavenet_coding import inference
78
 
79
  model_dir = snapshot_download("wq2012/wavenet-waveform-coder")
80
+ codec = inference.WaveNetWaveformCodec.from_pretrained(model_dir)
81
+
82
+ t = np.linspace(0.0, 0.2, 3200, endpoint=False, dtype=np.float32)
83
+ waveform_16k = 0.12 * np.sin(2.0 * np.pi * 180.0 * t)
84
+ result = codec.encode_and_decode(waveform_16k, run_arithmetic_coder=True)
85
+ print("Lossless exact match:", result["lossless_exact_match"])
86
+ print("Active arithmetic rate (kb/s):", result["arithmetic_kbps_active"])
87
  ```
88
 
89
  ### Run TFLite Flatbuffer (`model_int8.tflite`)
90
 
91
  ```python
 
92
  import tensorflow as tf
93
 
94
  interpreter = tf.lite.Interpreter(model_path="model_int8.tflite")
evaluation_metrics.json CHANGED
@@ -1,324 +1,436 @@
1
  {
2
- "model_id": "wq2012/wavenet-waveform-coder",
3
- "training_metrics": {
4
- "task": "wavenet",
5
- "mode": "waveform",
6
- "speaker_overlapping": false,
7
- "num_train_windows": 48,
8
- "num_eval_windows": 16,
9
- "training_time_sec": 187.79,
10
- "initial_eval_bits_per_sample": 5.497945785522461,
11
- "final_eval_bits_per_sample": 5.241023063659668,
12
- "history": [
13
- {
14
- "epoch": 1,
15
- "train_loss_bits_per_sample": 6.706890265146892,
16
- "eval_cross_entropy_bits_per_sample": 5.695452690124512
17
- },
18
- {
19
- "epoch": 2,
20
- "train_loss_bits_per_sample": 6.386214256286621,
21
- "eval_cross_entropy_bits_per_sample": 5.431291580200195
22
- },
23
- {
24
- "epoch": 3,
25
- "train_loss_bits_per_sample": 6.12939437230428,
26
- "eval_cross_entropy_bits_per_sample": 5.330618858337402
27
- },
28
- {
29
- "epoch": 4,
30
- "train_loss_bits_per_sample": 5.888708432515462,
31
- "eval_cross_entropy_bits_per_sample": 5.3388352394104
32
- },
33
- {
34
- "epoch": 5,
35
- "train_loss_bits_per_sample": 5.701914151509603,
36
- "eval_cross_entropy_bits_per_sample": 5.285624980926514
37
- },
38
- {
39
- "epoch": 6,
40
- "train_loss_bits_per_sample": 5.6265692710876465,
41
- "eval_cross_entropy_bits_per_sample": 5.294033050537109
42
- },
43
- {
44
- "epoch": 7,
45
- "train_loss_bits_per_sample": 5.596172014872233,
46
- "eval_cross_entropy_bits_per_sample": 5.288949012756348
47
- },
48
- {
49
- "epoch": 8,
50
- "train_loss_bits_per_sample": 5.530875523885091,
51
- "eval_cross_entropy_bits_per_sample": 5.241023063659668
52
- }
53
- ],
54
- "exported_files": {
55
- "config_path": "pretrained_models/wavenet_waveform_coder/config.json",
56
- "safetensors_path": "pretrained_models/wavenet_waveform_coder/model.safetensors",
57
- "saved_model_dir": "pretrained_models/wavenet_waveform_coder/saved_model",
58
- "tflite": {
59
- "fp32_path": "pretrained_models/wavenet_waveform_coder/model_fp32.tflite",
60
- "fp32_size_bytes": 2697196,
61
- "fp32_verified": true,
62
- "int8_path": "pretrained_models/wavenet_waveform_coder/model_int8.tflite",
63
- "int8_size_bytes": 924192,
64
- "int8_verified": true,
65
- "output_shape": [
66
- 1,
67
- 320,
68
- 256
69
- ]
70
- },
71
- "gguf_f16_path": "pretrained_models/wavenet_waveform_coder/model_f16.gguf",
72
- "gguf_q4_k_m_path": "pretrained_models/wavenet_waveform_coder/model_q4_k_m.gguf",
73
- "gguf_verified_tensors": 164
74
- }
75
- },
76
- "librispeech_test_clean_evaluation": {
77
  "num_eval_utterances": 16,
78
  "section_3_2_waveform_coding_rates": {
79
- "mean_entropy_bits_per_sample": 5.7415,
80
- "mean_entropy_kbps": 91.86,
81
- "cross_entropy_bits_per_sample": 5.9333,
82
- "cross_entropy_rate_kbps": 94.93,
 
 
 
83
  "lossless_exact_match_rate": 1.0
84
  },
85
  "section_3_3_codec_comparison": {
86
  "Reference (16 kHz)": {
87
  "bitrate_kbps": 256.0,
88
- "objective_mos_lqo": 4.85,
 
 
 
89
  "mcd_db": 0.0,
90
  "lsd_db": 0.0,
91
  "segmental_snr_db": 45.0,
92
- "high_band_energy_ratio_percent": 3.641
93
  },
94
  "8-bit mu-law (128 kb/s)": {
95
  "bitrate_kbps": 128.0,
96
- "objective_mos_lqo": 4.738,
97
- "mcd_db": 0.305,
98
- "lsd_db": 0.641,
99
- "segmental_snr_db": 37.484,
100
- "high_band_energy_ratio_percent": 3.65
 
 
 
101
  },
102
  "WaveNet Waveform (WW)": {
103
- "bitrate_kbps": 94.932,
104
- "objective_mos_lqo": 4.738,
105
- "mcd_db": 0.305,
106
- "lsd_db": 0.641,
107
- "segmental_snr_db": 37.484,
108
- "high_band_energy_ratio_percent": 3.65
109
- },
110
- "AMR-WB (23.85 kb/s)": {
111
- "bitrate_kbps": 23.85,
112
- "objective_mos_lqo": 3.449,
113
- "mcd_db": 3.197,
114
- "lsd_db": 5.307,
115
- "segmental_snr_db": 8.9,
116
- "high_band_energy_ratio_percent": 3.397
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
117
  },
118
  "WaveNet Parametric (W_w, 2.4 kb/s)": {
119
  "bitrate_kbps": 2.4,
120
- "objective_mos_lqo": 3.245,
121
- "mcd_db": 3.42,
122
- "lsd_db": 3.565,
123
- "segmental_snr_db": 3.716,
124
- "high_band_energy_ratio_percent": 3.671
 
 
 
125
  },
126
  "WaveNet Parametric (W_wo, 2.4 kb/s)": {
127
  "bitrate_kbps": 2.4,
128
- "objective_mos_lqo": 2.23,
129
- "mcd_db": 7.505,
130
- "lsd_db": 7.905,
131
- "segmental_snr_db": 1.537,
132
- "high_band_energy_ratio_percent": 1.643
 
 
 
133
  },
134
  "MELP (2.4 kb/s)": {
135
  "bitrate_kbps": 2.4,
136
- "objective_mos_lqo": 1.627,
137
- "mcd_db": 8.412,
138
- "lsd_db": 8.77,
139
- "segmental_snr_db": -2.744,
140
- "high_band_energy_ratio_percent": 0.041
 
 
 
141
  },
142
  "Codec 2 (2.4 kb/s)": {
143
  "bitrate_kbps": 2.4,
144
- "objective_mos_lqo": 1.646,
145
- "mcd_db": 8.277,
146
- "lsd_db": 8.172,
147
- "segmental_snr_db": -2.491,
148
- "high_band_energy_ratio_percent": 0.023
 
 
 
149
  },
150
  "Speex (2.15 kb/s)": {
151
  "bitrate_kbps": 2.15,
152
- "objective_mos_lqo": 1.893,
153
- "mcd_db": 7.459,
154
- "lsd_db": 8.219,
155
- "segmental_snr_db": 0.426,
156
- "high_band_energy_ratio_percent": 0.069
 
 
 
157
  }
158
  },
159
  "section_3_4_speaker_identification": {
160
  "mulaw_speech_eer": {
161
- "eer_percent": 12.053571428571429,
162
- "eer_ci95_low_percent": 2.2209821428571432,
163
- "eer_ci95_high_percent": 19.642857142857142,
164
- "ci_95_low_percent": 2.2209821428571432,
165
- "ci_95_high_percent": 19.642857142857142,
166
- "threshold": 0.38931805399917674,
167
- "mean_genuine_cosine": 0.5900887784230047,
168
- "mean_impostor_cosine": 0.06415446283955947
169
  },
170
- "wavenet_parametric_w_wo_eer": {
171
  "eer_percent": 25.0,
172
- "eer_ci95_low_percent": 9.754464285714286,
173
- "eer_ci95_high_percent": 37.957589285714285,
174
- "ci_95_low_percent": 9.754464285714286,
175
- "ci_95_high_percent": 37.957589285714285,
176
- "threshold": 0.8321953156106268,
177
- "mean_genuine_cosine": 0.8887528008846554,
178
- "mean_impostor_cosine": 0.7299079903992016
179
  },
180
- "wavenet_parametric_w_w_eer": {
181
  "eer_percent": 25.0,
182
- "eer_ci95_low_percent": 5.357142857142857,
183
- "eer_ci95_high_percent": 50.0,
184
- "ci_95_low_percent": 5.357142857142857,
185
- "ci_95_high_percent": 50.0,
186
- "threshold": 0.47203084832451203,
187
- "mean_genuine_cosine": 0.616406649899784,
188
- "mean_impostor_cosine": 0.22985314070694823
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
189
  },
190
  "triangle_test_w_w_vs_w_wo": {
191
- "mean_cosine_orig_vs_w_wo": 0.48838181445399975,
192
- "mean_cosine_orig_vs_w_w": 0.8089489559047142,
193
- "mean_cosine_w_wo_vs_w_w": 0.7808174503733418,
194
- "mean_cosine_advantage": 0.3205671414507144,
195
- "triangle_test_identification_percent": 43.24508910582853,
196
- "triangle_accuracy_percent": 43.24508910582853,
 
 
197
  "random_chance_baseline_percent": 33.33
198
  }
199
  }
200
  },
201
- "vctk_evaluation": {
202
  "num_eval_utterances": 16,
203
  "section_3_2_waveform_coding_rates": {
204
- "mean_entropy_bits_per_sample": 5.7457,
205
- "mean_entropy_kbps": 91.93,
206
- "cross_entropy_bits_per_sample": 5.8275,
207
- "cross_entropy_rate_kbps": 93.24,
 
 
 
208
  "lossless_exact_match_rate": 1.0
209
  },
210
  "section_3_3_codec_comparison": {
211
  "Reference (16 kHz)": {
212
  "bitrate_kbps": 256.0,
213
- "objective_mos_lqo": 4.85,
 
 
 
214
  "mcd_db": 0.0,
215
  "lsd_db": 0.0,
216
  "segmental_snr_db": 45.0,
217
- "high_band_energy_ratio_percent": 1.826
218
  },
219
  "8-bit mu-law (128 kb/s)": {
220
  "bitrate_kbps": 128.0,
221
- "objective_mos_lqo": 4.697,
222
- "mcd_db": 0.501,
223
- "lsd_db": 0.648,
224
- "segmental_snr_db": 37.162,
225
- "high_band_energy_ratio_percent": 1.834
 
 
 
226
  },
227
  "WaveNet Waveform (WW)": {
228
- "bitrate_kbps": 93.24,
229
- "objective_mos_lqo": 4.697,
230
- "mcd_db": 0.501,
231
- "lsd_db": 0.648,
232
- "segmental_snr_db": 37.162,
233
- "high_band_energy_ratio_percent": 1.834
234
- },
235
- "AMR-WB (23.85 kb/s)": {
236
- "bitrate_kbps": 23.85,
237
- "objective_mos_lqo": 3.364,
238
- "mcd_db": 3.541,
239
- "lsd_db": 5.359,
240
- "segmental_snr_db": 8.749,
241
- "high_band_energy_ratio_percent": 1.563
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
242
  },
243
  "WaveNet Parametric (W_w, 2.4 kb/s)": {
244
  "bitrate_kbps": 2.4,
245
- "objective_mos_lqo": 3.11,
246
- "mcd_db": 4.21,
247
- "lsd_db": 4.056,
248
- "segmental_snr_db": 4.352,
249
- "high_band_energy_ratio_percent": 2.064
 
 
 
250
  },
251
  "WaveNet Parametric (W_wo, 2.4 kb/s)": {
252
  "bitrate_kbps": 2.4,
253
- "objective_mos_lqo": 2.131,
254
- "mcd_db": 8.193,
255
- "lsd_db": 8.397,
256
- "segmental_snr_db": 1.972,
257
- "high_band_energy_ratio_percent": 1.51
 
 
 
258
  },
259
  "MELP (2.4 kb/s)": {
260
  "bitrate_kbps": 2.4,
261
- "objective_mos_lqo": 1.454,
262
- "mcd_db": 9.397,
263
- "lsd_db": 9.09,
264
- "segmental_snr_db": -2.683,
265
- "high_band_energy_ratio_percent": 0.033
 
 
 
266
  },
267
  "Codec 2 (2.4 kb/s)": {
268
  "bitrate_kbps": 2.4,
269
- "objective_mos_lqo": 1.356,
270
- "mcd_db": 10.187,
271
- "lsd_db": 8.785,
272
- "segmental_snr_db": -2.545,
273
- "high_band_energy_ratio_percent": 0.015
 
 
 
274
  },
275
  "Speex (2.15 kb/s)": {
276
  "bitrate_kbps": 2.15,
277
- "objective_mos_lqo": 1.722,
278
- "mcd_db": 8.392,
279
- "lsd_db": 8.341,
280
- "segmental_snr_db": 0.257,
281
- "high_band_energy_ratio_percent": 0.038
 
 
 
282
  }
283
  },
284
  "section_3_4_speaker_identification": {
285
  "mulaw_speech_eer": {
286
- "eer_percent": 25.0,
287
- "eer_ci95_low_percent": 11.595982142857144,
288
- "eer_ci95_high_percent": 42.44419642857144,
289
- "ci_95_low_percent": 11.595982142857144,
290
- "ci_95_high_percent": 42.44419642857144,
291
- "threshold": 0.2121775659214813,
292
- "mean_genuine_cosine": 0.3935697310774072,
293
- "mean_impostor_cosine": 0.0036658837067926322
294
- },
295
- "wavenet_parametric_w_wo_eer": {
296
- "eer_percent": 37.05357142857143,
297
- "eer_ci95_low_percent": 20.044642857142858,
298
- "eer_ci95_high_percent": 50.524553571428584,
299
- "ci_95_low_percent": 20.044642857142858,
300
- "ci_95_high_percent": 50.524553571428584,
301
- "threshold": 0.8427541969049193,
302
- "mean_genuine_cosine": 0.8848814072587434,
303
- "mean_impostor_cosine": 0.8005241801782267
304
  },
305
  "wavenet_parametric_w_w_eer": {
 
 
 
 
 
 
 
 
 
 
306
  "eer_percent": 24.55357142857143,
307
- "eer_ci95_low_percent": 12.053571428571429,
308
- "eer_ci95_high_percent": 46.886160714285715,
309
- "ci_95_low_percent": 12.053571428571429,
310
- "ci_95_high_percent": 46.886160714285715,
311
- "threshold": 0.4774760105853959,
312
- "mean_genuine_cosine": 0.6204015199832023,
313
- "mean_impostor_cosine": 0.18491605664772884
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
314
  },
315
  "triangle_test_w_w_vs_w_wo": {
316
- "mean_cosine_orig_vs_w_wo": 0.2806833882483422,
317
- "mean_cosine_orig_vs_w_w": 0.5796352731348118,
318
- "mean_cosine_w_wo_vs_w_w": 0.8056075167477617,
319
- "mean_cosine_advantage": 0.2989518848864696,
320
- "triangle_test_identification_percent": 42.59985923688519,
321
- "triangle_accuracy_percent": 42.59985923688519,
 
 
322
  "random_chance_baseline_percent": 33.33
323
  }
324
  }
 
1
  {
2
+ "librispeech_test_clean": {
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
3
  "num_eval_utterances": 16,
4
  "section_3_2_waveform_coding_rates": {
5
+ "mean_entropy_bits_per_sample": 4.8556,
6
+ "mean_entropy_kbps": 77.69,
7
+ "cross_entropy_bits_per_sample": 5.257,
8
+ "cross_entropy_nll_nats_per_sample": 3.6438,
9
+ "cross_entropy_rate_kbps": 84.11,
10
+ "arithmetic_coded_bits_per_sample": 5.0156,
11
+ "arithmetic_coded_rate_kbps": 80.25,
12
  "lossless_exact_match_rate": 1.0
13
  },
14
  "section_3_3_codec_comparison": {
15
  "Reference (16 kHz)": {
16
  "bitrate_kbps": 256.0,
17
+ "pesq_wb_mos_lqo": 4.644,
18
+ "stoi": 1.0,
19
+ "f0_rmse_hz": 0.0,
20
+ "objective_mos_lqo": 4.644,
21
  "mcd_db": 0.0,
22
  "lsd_db": 0.0,
23
  "segmental_snr_db": 45.0,
24
+ "high_band_energy_ratio_percent": 4.062
25
  },
26
  "8-bit mu-law (128 kb/s)": {
27
  "bitrate_kbps": 128.0,
28
+ "pesq_wb_mos_lqo": 4.171,
29
+ "stoi": 0.999,
30
+ "f0_rmse_hz": 0.184,
31
+ "objective_mos_lqo": 4.171,
32
+ "mcd_db": 0.427,
33
+ "lsd_db": 0.827,
34
+ "segmental_snr_db": 35.42,
35
+ "high_band_energy_ratio_percent": 4.072
36
  },
37
  "WaveNet Waveform (WW)": {
38
+ "bitrate_kbps": 84.111,
39
+ "pesq_wb_mos_lqo": 4.171,
40
+ "stoi": 0.999,
41
+ "f0_rmse_hz": 0.184,
42
+ "objective_mos_lqo": 4.171,
43
+ "mcd_db": 0.427,
44
+ "lsd_db": 0.827,
45
+ "segmental_snr_db": 35.42,
46
+ "high_band_energy_ratio_percent": 4.072
47
+ },
48
+ "Hybrid Mode-Switching (WW + W_w)": {
49
+ "bitrate_kbps": 50.09,
50
+ "pesq_wb_mos_lqo": 1.871,
51
+ "stoi": 0.936,
52
+ "f0_rmse_hz": 17.721,
53
+ "objective_mos_lqo": 1.871,
54
+ "mcd_db": 2.586,
55
+ "lsd_db": 3.036,
56
+ "segmental_snr_db": 21.533,
57
+ "high_band_energy_ratio_percent": 3.88
58
+ },
59
+ "AMR-WB (23.05 kb/s)": {
60
+ "bitrate_kbps": 23.05,
61
+ "pesq_wb_mos_lqo": 3.964,
62
+ "stoi": 0.984,
63
+ "f0_rmse_hz": 8.114,
64
+ "objective_mos_lqo": 3.964,
65
+ "mcd_db": 1.491,
66
+ "lsd_db": 3.131,
67
+ "segmental_snr_db": 6.049,
68
+ "high_band_energy_ratio_percent": 2.165
69
  },
70
  "WaveNet Parametric (W_w, 2.4 kb/s)": {
71
  "bitrate_kbps": 2.4,
72
+ "pesq_wb_mos_lqo": 1.528,
73
+ "stoi": 0.85,
74
+ "f0_rmse_hz": 25.42,
75
+ "objective_mos_lqo": 1.528,
76
+ "mcd_db": 5.26,
77
+ "lsd_db": 5.557,
78
+ "segmental_snr_db": -2.306,
79
+ "high_band_energy_ratio_percent": 0.706
80
  },
81
  "WaveNet Parametric (W_wo, 2.4 kb/s)": {
82
  "bitrate_kbps": 2.4,
83
+ "pesq_wb_mos_lqo": 1.513,
84
+ "stoi": 0.85,
85
+ "f0_rmse_hz": 24.588,
86
+ "objective_mos_lqo": 1.513,
87
+ "mcd_db": 5.611,
88
+ "lsd_db": 5.732,
89
+ "segmental_snr_db": -2.297,
90
+ "high_band_energy_ratio_percent": 0.614
91
  },
92
  "MELP (2.4 kb/s)": {
93
  "bitrate_kbps": 2.4,
94
+ "pesq_wb_mos_lqo": 1.686,
95
+ "stoi": 0.778,
96
+ "f0_rmse_hz": 40.092,
97
+ "objective_mos_lqo": 1.686,
98
+ "mcd_db": 8.111,
99
+ "lsd_db": 7.895,
100
+ "segmental_snr_db": -2.822,
101
+ "high_band_energy_ratio_percent": 0.02
102
  },
103
  "Codec 2 (2.4 kb/s)": {
104
  "bitrate_kbps": 2.4,
105
+ "pesq_wb_mos_lqo": 1.597,
106
+ "stoi": 0.847,
107
+ "f0_rmse_hz": 36.549,
108
+ "objective_mos_lqo": 1.597,
109
+ "mcd_db": 8.45,
110
+ "lsd_db": 8.067,
111
+ "segmental_snr_db": -2.32,
112
+ "high_band_energy_ratio_percent": 0.005
113
  },
114
  "Speex (2.15 kb/s)": {
115
  "bitrate_kbps": 2.15,
116
+ "pesq_wb_mos_lqo": 1.472,
117
+ "stoi": 0.789,
118
+ "f0_rmse_hz": 31.137,
119
+ "objective_mos_lqo": 1.472,
120
+ "mcd_db": 7.944,
121
+ "lsd_db": 7.807,
122
+ "segmental_snr_db": -1.38,
123
+ "high_band_energy_ratio_percent": 0.023
124
  }
125
  },
126
  "section_3_4_speaker_identification": {
127
  "mulaw_speech_eer": {
128
+ "eer_percent": 12.5,
129
+ "eer_ci95_low_percent": 2.6674107142857144,
130
+ "eer_ci95_high_percent": 21.886160714285715,
131
+ "ci_95_low_percent": 2.6674107142857144,
132
+ "ci_95_high_percent": 21.886160714285715,
133
+ "threshold": 0.29185709569381924,
134
+ "mean_genuine_cosine": 0.44530730656223655,
135
+ "mean_impostor_cosine": -0.031165612260486617
136
  },
137
+ "wavenet_parametric_w_w_eer": {
138
  "eer_percent": 25.0,
139
+ "eer_ci95_low_percent": 13.392857142857142,
140
+ "eer_ci95_high_percent": 38.404017857142854,
141
+ "ci_95_low_percent": 13.392857142857142,
142
+ "ci_95_high_percent": 38.404017857142854,
143
+ "threshold": 0.3927898672726676,
144
+ "mean_genuine_cosine": 0.49871190258880344,
145
+ "mean_impostor_cosine": 0.19032626539991265
146
  },
147
+ "wavenet_parametric_w_wo_eer_mulaw_verifier": {
148
  "eer_percent": 25.0,
149
+ "eer_ci95_low_percent": 12.94642857142857,
150
+ "eer_ci95_high_percent": 41.51785714285714,
151
+ "ci_95_low_percent": 12.94642857142857,
152
+ "ci_95_high_percent": 41.51785714285714,
153
+ "threshold": 0.49189550553056544,
154
+ "mean_genuine_cosine": 0.5446005744263802,
155
+ "mean_impostor_cosine": 0.23289187596733665
156
+ },
157
+ "wavenet_parametric_w_wo_eer": {
158
+ "eer_percent": 22.32142857142857,
159
+ "eer_ci95_low_percent": 8.482142857142858,
160
+ "eer_ci95_high_percent": 32.611607142857146,
161
+ "ci_95_low_percent": 8.482142857142858,
162
+ "ci_95_high_percent": 32.611607142857146,
163
+ "threshold": 0.21622103255006364,
164
+ "mean_genuine_cosine": 0.37797472937253285,
165
+ "mean_impostor_cosine": -0.03277759994961506
166
+ },
167
+ "codec2_2400_eer": {
168
+ "eer_percent": 27.23214285714286,
169
+ "eer_ci95_low_percent": 17.39955357142857,
170
+ "eer_ci95_high_percent": 46.886160714285715,
171
+ "ci_95_low_percent": 17.39955357142857,
172
+ "ci_95_high_percent": 46.886160714285715,
173
+ "threshold": 0.6951031882653882,
174
+ "mean_genuine_cosine": 0.7511831514622034,
175
+ "mean_impostor_cosine": 0.5752668362534713
176
+ },
177
+ "melp_2400_eer": {
178
+ "eer_percent": 25.44642857142857,
179
+ "eer_ci95_low_percent": 13.816964285714286,
180
+ "eer_ci95_high_percent": 46.875,
181
+ "ci_95_low_percent": 13.816964285714286,
182
+ "ci_95_high_percent": 46.875,
183
+ "threshold": 0.6622801368095736,
184
+ "mean_genuine_cosine": 0.7499099000126639,
185
+ "mean_impostor_cosine": 0.49901395755586514
186
+ },
187
+ "speex_2150_eer": {
188
+ "eer_percent": 33.48214285714286,
189
+ "eer_ci95_low_percent": 15.613839285714286,
190
+ "eer_ci95_high_percent": 41.07142857142857,
191
+ "ci_95_low_percent": 15.613839285714286,
192
+ "ci_95_high_percent": 41.07142857142857,
193
+ "threshold": 0.654569947588562,
194
+ "mean_genuine_cosine": 0.7099157823552019,
195
+ "mean_impostor_cosine": 0.5312576204882272
196
+ },
197
+ "amr_wb_23050_eer": {
198
+ "eer_percent": 13.392857142857142,
199
+ "eer_ci95_low_percent": 3.560267857142857,
200
+ "eer_ci95_high_percent": 23.22544642857143,
201
+ "ci_95_low_percent": 3.560267857142857,
202
+ "ci_95_high_percent": 23.22544642857143,
203
+ "threshold": 0.33419504474263173,
204
+ "mean_genuine_cosine": 0.5394971779051225,
205
+ "mean_impostor_cosine": 0.0811744304899468
206
  },
207
  "triangle_test_w_w_vs_w_wo": {
208
+ "mean_cosine_orig_vs_w_wo": 0.5684091566528269,
209
+ "mean_cosine_orig_vs_w_w": 0.5917583187780218,
210
+ "mean_cosine_w_wo_vs_w_w": 0.3938628149217174,
211
+ "mean_cosine_advantage": 0.02334916212519502,
212
+ "triangle_test_identification_percent": 50.0,
213
+ "triangle_accuracy_percent": 50.0,
214
+ "abx_preference_percent": 68.75,
215
+ "abx_preference_w_w_over_w_wo_percent": 68.75,
216
  "random_chance_baseline_percent": 33.33
217
  }
218
  }
219
  },
220
+ "vctk": {
221
  "num_eval_utterances": 16,
222
  "section_3_2_waveform_coding_rates": {
223
+ "mean_entropy_bits_per_sample": 4.8433,
224
+ "mean_entropy_kbps": 77.49,
225
+ "cross_entropy_bits_per_sample": 5.0888,
226
+ "cross_entropy_nll_nats_per_sample": 3.5273,
227
+ "cross_entropy_rate_kbps": 81.42,
228
+ "arithmetic_coded_bits_per_sample": 4.899,
229
+ "arithmetic_coded_rate_kbps": 78.38,
230
  "lossless_exact_match_rate": 1.0
231
  },
232
  "section_3_3_codec_comparison": {
233
  "Reference (16 kHz)": {
234
  "bitrate_kbps": 256.0,
235
+ "pesq_wb_mos_lqo": 4.644,
236
+ "stoi": 1.0,
237
+ "f0_rmse_hz": 0.0,
238
+ "objective_mos_lqo": 4.644,
239
  "mcd_db": 0.0,
240
  "lsd_db": 0.0,
241
  "segmental_snr_db": 45.0,
242
+ "high_band_energy_ratio_percent": 1.774
243
  },
244
  "8-bit mu-law (128 kb/s)": {
245
  "bitrate_kbps": 128.0,
246
+ "pesq_wb_mos_lqo": 3.772,
247
+ "stoi": 0.999,
248
+ "f0_rmse_hz": 0.107,
249
+ "objective_mos_lqo": 3.772,
250
+ "mcd_db": 0.472,
251
+ "lsd_db": 0.81,
252
+ "segmental_snr_db": 34.976,
253
+ "high_band_energy_ratio_percent": 1.783
254
  },
255
  "WaveNet Waveform (WW)": {
256
+ "bitrate_kbps": 81.421,
257
+ "pesq_wb_mos_lqo": 3.772,
258
+ "stoi": 0.999,
259
+ "f0_rmse_hz": 0.107,
260
+ "objective_mos_lqo": 3.772,
261
+ "mcd_db": 0.472,
262
+ "lsd_db": 0.81,
263
+ "segmental_snr_db": 34.976,
264
+ "high_band_energy_ratio_percent": 1.783
265
+ },
266
+ "Hybrid Mode-Switching (WW + W_w)": {
267
+ "bitrate_kbps": 44.382,
268
+ "pesq_wb_mos_lqo": 1.43,
269
+ "stoi": 0.938,
270
+ "f0_rmse_hz": 13.676,
271
+ "objective_mos_lqo": 1.43,
272
+ "mcd_db": 3.444,
273
+ "lsd_db": 3.82,
274
+ "segmental_snr_db": 19.642,
275
+ "high_band_energy_ratio_percent": 1.289
276
+ },
277
+ "AMR-WB (23.05 kb/s)": {
278
+ "bitrate_kbps": 23.05,
279
+ "pesq_wb_mos_lqo": 3.777,
280
+ "stoi": 0.99,
281
+ "f0_rmse_hz": 5.78,
282
+ "objective_mos_lqo": 3.777,
283
+ "mcd_db": 1.742,
284
+ "lsd_db": 3.522,
285
+ "segmental_snr_db": 5.589,
286
+ "high_band_energy_ratio_percent": 1.113
287
  },
288
  "WaveNet Parametric (W_w, 2.4 kb/s)": {
289
  "bitrate_kbps": 2.4,
290
+ "pesq_wb_mos_lqo": 1.345,
291
+ "stoi": 0.866,
292
+ "f0_rmse_hz": 33.577,
293
+ "objective_mos_lqo": 1.345,
294
+ "mcd_db": 5.792,
295
+ "lsd_db": 5.988,
296
+ "segmental_snr_db": -2.276,
297
+ "high_band_energy_ratio_percent": 0.309
298
  },
299
  "WaveNet Parametric (W_wo, 2.4 kb/s)": {
300
  "bitrate_kbps": 2.4,
301
+ "pesq_wb_mos_lqo": 1.368,
302
+ "stoi": 0.857,
303
+ "f0_rmse_hz": 36.464,
304
+ "objective_mos_lqo": 1.368,
305
+ "mcd_db": 6.107,
306
+ "lsd_db": 6.131,
307
+ "segmental_snr_db": -2.223,
308
+ "high_band_energy_ratio_percent": 0.291
309
  },
310
  "MELP (2.4 kb/s)": {
311
  "bitrate_kbps": 2.4,
312
+ "pesq_wb_mos_lqo": 1.486,
313
+ "stoi": 0.794,
314
+ "f0_rmse_hz": 33.49,
315
+ "objective_mos_lqo": 1.486,
316
+ "mcd_db": 9.908,
317
+ "lsd_db": 9.171,
318
+ "segmental_snr_db": -2.74,
319
+ "high_band_energy_ratio_percent": 0.01
320
  },
321
  "Codec 2 (2.4 kb/s)": {
322
  "bitrate_kbps": 2.4,
323
+ "pesq_wb_mos_lqo": 1.427,
324
+ "stoi": 0.839,
325
+ "f0_rmse_hz": 43.198,
326
+ "objective_mos_lqo": 1.427,
327
+ "mcd_db": 9.775,
328
+ "lsd_db": 9.24,
329
+ "segmental_snr_db": -2.114,
330
+ "high_band_energy_ratio_percent": 0.002
331
  },
332
  "Speex (2.15 kb/s)": {
333
  "bitrate_kbps": 2.15,
334
+ "pesq_wb_mos_lqo": 1.491,
335
+ "stoi": 0.82,
336
+ "f0_rmse_hz": 31.791,
337
+ "objective_mos_lqo": 1.491,
338
+ "mcd_db": 9.161,
339
+ "lsd_db": 8.986,
340
+ "segmental_snr_db": -1.183,
341
+ "high_band_energy_ratio_percent": 0.017
342
  }
343
  },
344
  "section_3_4_speaker_identification": {
345
  "mulaw_speech_eer": {
346
+ "eer_percent": 12.5,
347
+ "eer_ci95_low_percent": 3.571428571428571,
348
+ "eer_ci95_high_percent": 37.511160714285715,
349
+ "ci_95_low_percent": 3.571428571428571,
350
+ "ci_95_high_percent": 37.511160714285715,
351
+ "threshold": 0.40297561601478865,
352
+ "mean_genuine_cosine": 0.533335601866815,
353
+ "mean_impostor_cosine": -0.0027530994077539566
 
 
 
 
 
 
 
 
 
 
354
  },
355
  "wavenet_parametric_w_w_eer": {
356
+ "eer_percent": 21.875,
357
+ "eer_ci95_low_percent": 8.917410714285715,
358
+ "eer_ci95_high_percent": 37.94642857142857,
359
+ "ci_95_low_percent": 8.917410714285715,
360
+ "ci_95_high_percent": 37.94642857142857,
361
+ "threshold": 0.4407421890061377,
362
+ "mean_genuine_cosine": 0.556131588883851,
363
+ "mean_impostor_cosine": 0.23974738299126758
364
+ },
365
+ "wavenet_parametric_w_wo_eer_mulaw_verifier": {
366
  "eer_percent": 24.55357142857143,
367
+ "eer_ci95_low_percent": 11.149553571428573,
368
+ "eer_ci95_high_percent": 37.94642857142857,
369
+ "ci_95_low_percent": 11.149553571428573,
370
+ "ci_95_high_percent": 37.94642857142857,
371
+ "threshold": 0.4748982079014201,
372
+ "mean_genuine_cosine": 0.5765287804912442,
373
+ "mean_impostor_cosine": 0.31020436523949757
374
+ },
375
+ "wavenet_parametric_w_wo_eer": {
376
+ "eer_percent": 15.17857142857143,
377
+ "eer_ci95_low_percent": 3.571428571428571,
378
+ "eer_ci95_high_percent": 37.94642857142857,
379
+ "ci_95_low_percent": 3.571428571428571,
380
+ "ci_95_high_percent": 37.94642857142857,
381
+ "threshold": 0.28079196762738023,
382
+ "mean_genuine_cosine": 0.4166328782518146,
383
+ "mean_impostor_cosine": -0.01283012844203055
384
+ },
385
+ "codec2_2400_eer": {
386
+ "eer_percent": 25.0,
387
+ "eer_ci95_low_percent": 5.357142857142857,
388
+ "eer_ci95_high_percent": 45.2120535714286,
389
+ "ci_95_low_percent": 5.357142857142857,
390
+ "ci_95_high_percent": 45.2120535714286,
391
+ "threshold": 0.7697445190926964,
392
+ "mean_genuine_cosine": 0.827981640492962,
393
+ "mean_impostor_cosine": 0.7004077353235066
394
+ },
395
+ "melp_2400_eer": {
396
+ "eer_percent": 25.0,
397
+ "eer_ci95_low_percent": 11.573660714285715,
398
+ "eer_ci95_high_percent": 37.94642857142857,
399
+ "ci_95_low_percent": 11.573660714285715,
400
+ "ci_95_high_percent": 37.94642857142857,
401
+ "threshold": 0.792323185831342,
402
+ "mean_genuine_cosine": 0.8643444983345618,
403
+ "mean_impostor_cosine": 0.685341582600922
404
+ },
405
+ "speex_2150_eer": {
406
+ "eer_percent": 25.0,
407
+ "eer_ci95_low_percent": 12.5,
408
+ "eer_ci95_high_percent": 37.94642857142857,
409
+ "ci_95_low_percent": 12.5,
410
+ "ci_95_high_percent": 37.94642857142857,
411
+ "threshold": 0.7967896929997185,
412
+ "mean_genuine_cosine": 0.8585711865620879,
413
+ "mean_impostor_cosine": 0.7166751079752773
414
+ },
415
+ "amr_wb_23050_eer": {
416
+ "eer_percent": 12.5,
417
+ "eer_ci95_low_percent": 3.560267857142857,
418
+ "eer_ci95_high_percent": 35.279017857142854,
419
+ "ci_95_low_percent": 3.560267857142857,
420
+ "ci_95_high_percent": 35.279017857142854,
421
+ "threshold": 0.49967441003977797,
422
+ "mean_genuine_cosine": 0.6482315032144372,
423
+ "mean_impostor_cosine": 0.17124600824055422
424
  },
425
  "triangle_test_w_w_vs_w_wo": {
426
+ "mean_cosine_orig_vs_w_wo": 0.6013400573986093,
427
+ "mean_cosine_orig_vs_w_w": 0.6146092914303704,
428
+ "mean_cosine_w_wo_vs_w_w": 0.413028135873362,
429
+ "mean_cosine_advantage": 0.013269234031761046,
430
+ "triangle_test_identification_percent": 43.75,
431
+ "triangle_accuracy_percent": 43.75,
432
+ "abx_preference_percent": 56.25,
433
+ "abx_preference_w_w_over_w_wo_percent": 56.25,
434
  "random_chance_baseline_percent": 33.33
435
  }
436
  }
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:5ee38e3aef0669a9c1cdfddca0a261bb25ce16114cd4fb5e03d6e771a63d1c32
3
  size 2515752
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5fc80525545624f11741ea635184bb8a85d9c10341733638a2b38a25f85e4e13
3
  size 2515752
model_f16.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:2bfabb7d7bbb5a99c74cedad67114411f0fa6e1ffee9ecd5bf7a0497c018618c
3
  size 1260672
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cbc995bdc362c8c8d7190ae8f5899cfd491c7fc15abf5abf2a4e4dc17476f049
3
  size 1260672
model_fp32.tflite CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:349a157f2d13cb207d5871008cd3a9bee5006dbc691b171639d46fcef58ca2c7
3
- size 2697196
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:88822ca3d5f7611d151d7e65680897f9c67daad93129888f624252987079cc9a
3
+ size 685348
model_int8.tflite CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:aa5b8a273eff56b5c5ebd8fc1cbd05c242cbf626528c129a3c855899bc2e80ed
3
- size 924192
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cb9cc88b4389d03d5e88ee3484ab66225659b3957470be9024c79938a8c5c4a5
3
+ size 181248
model_q4_k_m.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:64794f1066b752ff4e348728be7685d05d623c45cb2ca58c6bbd9ac51b971888
3
  size 371584
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:994bbde1b325d5c728ae74bf197ea7d523a35084e4dae81ba3b5561d6c873060
3
  size 371584
saved_model/fingerprint.pb ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6c98159a31c8e94fd0dd0ea8df01300bf649721f76c0c45ad98bb08946e0940c
3
+ size 100
saved_model/saved_model.pb CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:453c432e2284c30a6a431ead77f8db151a958420de0338ffef7ccd7b0051feee
3
- size 4376639
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0187b00318130231e736afd01180fe68a4e65d43310fa23958812606d8c760e3
3
+ size 1450963
saved_model/variables/variables.data-00000-of-00001 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f21124fa47b370bd82abea3413760673e8ace57a7be72f044601a1b9ddae62ea
3
- size 2620208
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3e265c3e92d5f928467ebf0ee1aea840567353ebeaa6932dc3effe55ef9231fa
3
+ size 2560444
saved_model/variables/variables.index CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:2716e5100d89623fed95f5161c43f808e37ae3c606dc4642385b18e242fcd9a1
3
- size 10388
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b7f09afa9f71b397f58e12224e07485233ebd48f5e5b5168a7b7f38757f45a0e
3
+ size 10404
training_metrics.json CHANGED
@@ -2,51 +2,74 @@
2
  "task": "wavenet",
3
  "mode": "waveform",
4
  "speaker_overlapping": false,
5
- "num_train_windows": 48,
 
6
  "num_eval_windows": 16,
7
- "training_time_sec": 187.79,
8
- "initial_eval_bits_per_sample": 5.497945785522461,
9
- "final_eval_bits_per_sample": 5.241023063659668,
 
 
10
  "history": [
11
  {
12
  "epoch": 1,
13
- "train_loss_bits_per_sample": 6.706890265146892,
14
- "eval_cross_entropy_bits_per_sample": 5.695452690124512
 
15
  },
16
  {
17
  "epoch": 2,
18
- "train_loss_bits_per_sample": 6.386214256286621,
19
- "eval_cross_entropy_bits_per_sample": 5.431291580200195
 
20
  },
21
  {
22
  "epoch": 3,
23
- "train_loss_bits_per_sample": 6.12939437230428,
24
- "eval_cross_entropy_bits_per_sample": 5.330618858337402
 
25
  },
26
  {
27
  "epoch": 4,
28
- "train_loss_bits_per_sample": 5.888708432515462,
29
- "eval_cross_entropy_bits_per_sample": 5.3388352394104
 
30
  },
31
  {
32
  "epoch": 5,
33
- "train_loss_bits_per_sample": 5.701914151509603,
34
- "eval_cross_entropy_bits_per_sample": 5.285624980926514
 
35
  },
36
  {
37
  "epoch": 6,
38
- "train_loss_bits_per_sample": 5.6265692710876465,
39
- "eval_cross_entropy_bits_per_sample": 5.294033050537109
 
40
  },
41
  {
42
  "epoch": 7,
43
- "train_loss_bits_per_sample": 5.596172014872233,
44
- "eval_cross_entropy_bits_per_sample": 5.288949012756348
 
45
  },
46
  {
47
  "epoch": 8,
48
- "train_loss_bits_per_sample": 5.530875523885091,
49
- "eval_cross_entropy_bits_per_sample": 5.241023063659668
 
 
 
 
 
 
 
 
 
 
 
 
 
50
  }
51
  ],
52
  "exported_files": {
@@ -55,10 +78,10 @@
55
  "saved_model_dir": "pretrained_models/wavenet_waveform_coder/saved_model",
56
  "tflite": {
57
  "fp32_path": "pretrained_models/wavenet_waveform_coder/model_fp32.tflite",
58
- "fp32_size_bytes": 2697196,
59
  "fp32_verified": true,
60
  "int8_path": "pretrained_models/wavenet_waveform_coder/model_int8.tflite",
61
- "int8_size_bytes": 924192,
62
  "int8_verified": true,
63
  "output_shape": [
64
  1,
 
2
  "task": "wavenet",
3
  "mode": "waveform",
4
  "speaker_overlapping": false,
5
+ "num_train_utterances": 160,
6
+ "num_train_windows": 64,
7
  "num_eval_windows": 16,
8
+ "training_time_sec": 14.85,
9
+ "initial_eval_bits_per_sample": 7.0186,
10
+ "initial_eval_nll_nats_per_sample": 4.8649,
11
+ "final_eval_bits_per_sample": 4.0603,
12
+ "final_eval_nll_nats_per_sample": 2.8144,
13
  "history": [
14
  {
15
  "epoch": 1,
16
+ "train_loss_bits_per_sample": 6.892,
17
+ "eval_cross_entropy_bits_per_sample": 6.7692,
18
+ "eval_nll_nats_per_sample": 4.6921
19
  },
20
  {
21
  "epoch": 2,
22
+ "train_loss_bits_per_sample": 6.6984,
23
+ "eval_cross_entropy_bits_per_sample": 6.5453,
24
+ "eval_nll_nats_per_sample": 4.5368
25
  },
26
  {
27
  "epoch": 3,
28
+ "train_loss_bits_per_sample": 6.5196,
29
+ "eval_cross_entropy_bits_per_sample": 6.3332,
30
+ "eval_nll_nats_per_sample": 4.3898
31
  },
32
  {
33
  "epoch": 4,
34
+ "train_loss_bits_per_sample": 6.3548,
35
+ "eval_cross_entropy_bits_per_sample": 6.131,
36
+ "eval_nll_nats_per_sample": 4.2497
37
  },
38
  {
39
  "epoch": 5,
40
+ "train_loss_bits_per_sample": 6.2047,
41
+ "eval_cross_entropy_bits_per_sample": 5.9357,
42
+ "eval_nll_nats_per_sample": 4.1143
43
  },
44
  {
45
  "epoch": 6,
46
+ "train_loss_bits_per_sample": 6.0753,
47
+ "eval_cross_entropy_bits_per_sample": 5.7441,
48
+ "eval_nll_nats_per_sample": 3.9815
49
  },
50
  {
51
  "epoch": 7,
52
+ "train_loss_bits_per_sample": 5.9746,
53
+ "eval_cross_entropy_bits_per_sample": 5.5418,
54
+ "eval_nll_nats_per_sample": 3.8413
55
  },
56
  {
57
  "epoch": 8,
58
+ "train_loss_bits_per_sample": 5.8965,
59
+ "eval_cross_entropy_bits_per_sample": 5.2868,
60
+ "eval_nll_nats_per_sample": 3.6645
61
+ },
62
+ {
63
+ "epoch": 9,
64
+ "train_loss_bits_per_sample": 5.6948,
65
+ "eval_cross_entropy_bits_per_sample": 4.7803,
66
+ "eval_nll_nats_per_sample": 3.3135
67
+ },
68
+ {
69
+ "epoch": 10,
70
+ "train_loss_bits_per_sample": 5.4515,
71
+ "eval_cross_entropy_bits_per_sample": 4.0603,
72
+ "eval_nll_nats_per_sample": 2.8144
73
  }
74
  ],
75
  "exported_files": {
 
78
  "saved_model_dir": "pretrained_models/wavenet_waveform_coder/saved_model",
79
  "tflite": {
80
  "fp32_path": "pretrained_models/wavenet_waveform_coder/model_fp32.tflite",
81
+ "fp32_size_bytes": 685348,
82
  "fp32_verified": true,
83
  "int8_path": "pretrained_models/wavenet_waveform_coder/model_int8.tflite",
84
+ "int8_size_bytes": 181248,
85
  "int8_verified": true,
86
  "output_shape": [
87
  1,