richiejp commited on
Commit
668175b
·
verified ·
1 Parent(s): 090a0f3

Sync model card with upstream GitHub inference README

Browse files
Files changed (1) hide show
  1. README.md +30 -21
README.md CHANGED
@@ -15,7 +15,7 @@ license: apache-2.0
15
  acoustic echo cancellation (AEC), noise suppression, and dereverberation of
16
  16 kHz speech, designed to run on commodity CPUs in real time.
17
 
18
- - ~0.9 M parameters (3.5 MB F32)
19
  - ~1.66 ms per 16 ms frame on Zen4 (24 threads) — **≈9.6× realtime**
20
  - Causal, streaming: 256-sample hop, 16 ms algorithmic latency
21
  - F32 reference inference in C++ via [GGML](https://github.com/ggml-org/ggml);
@@ -114,28 +114,37 @@ friendly, but quantized weights have not yet been calibrated and released.
114
 
115
  ## Validation Results
116
 
117
- Numbers below are from the best checkpoint of the AEC fine-tune
118
- (`localvqe-v1-f32.gguf`), evaluated on a 1 000-clip validation split mixing
119
- DNS5-synthesised near/far-end scenes and ICASSP AEC Challenge synthetic
120
- data. AECMOS scores are computed over a 100-clip sub-sample per the standard
121
- AEC Challenge protocol.
122
 
123
- | Metric | Overall | Single-talk far-end | Double-talk |
124
- |---|---:|---:|---:|
125
- | ERLE | — | **+52.2 dB** | — |
126
- | AECMOS echo (↑, 1–5) | 4.36 | 4.46 | 4.33 |
127
- | AECMOS degradation (↑, 1–5) | 4.83 | 5.00 | 4.78 |
128
-
129
- - **ERLE** (Echo Return Loss Enhancement) in dB — higher is better. Only
130
- reported for single-talk far-end, where the mic signal is pure echo and the
131
- ratio `10·log10(E[mic²] / E[enh²])` directly measures echo attenuation.
132
- Overall and double-talk ERLE are omitted because near-end speech in the
133
- mic and enhanced signals dominates the numerator/denominator and the
134
- number stops being a clean echo-removal measurement.
 
135
  - **AECMOS** (Purin et al., ICASSP 2022) is Microsoft's non-intrusive AEC
136
- quality predictor. "Echo" rates how well the echo was removed; "degradation"
137
- rates how clean the resulting speech/residual is. Both are on a 1–5 MOS
138
- scale, higher is better.
 
 
 
 
 
 
 
 
 
 
 
 
139
 
140
  ### Why DNSMOS OVRL is not reported here
141
 
 
15
  acoustic echo cancellation (AEC), noise suppression, and dereverberation of
16
  16 kHz speech, designed to run on commodity CPUs in real time.
17
 
18
+ - ~0.9 M parameters (~3.5 MB F32)
19
  - ~1.66 ms per 16 ms frame on Zen4 (24 threads) — **≈9.6× realtime**
20
  - Causal, streaming: 256-sample hop, 16 ms algorithmic latency
21
  - F32 reference inference in C++ via [GGML](https://github.com/ggml-org/ggml);
 
114
 
115
  ## Validation Results
116
 
117
+ ### Synthetic validation split
 
 
 
 
118
 
119
+ 1000 clips drawn from DNS5 + AEC Challenge synthetic data, AECMOS over
120
+ a 100-clip sub-sample per the standard AEC Challenge protocol.
121
+
122
+ | Metric | Value |
123
+ |---|---:|
124
+ | ERLE (dB) | 15.44 |
125
+ | AECMOS echo (↑, 1–5) | 3.83 |
126
+ | AECMOS degradation (↑, 1–5) | 3.91 |
127
+
128
+ - **ERLE** (Echo Return Loss Enhancement) — `10·log10(E[mic²] / E[enh²])`
129
+ averaged across scenarios. On scenes with active near-end speech both
130
+ numerator and denominator are dominated by speech, so the absolute
131
+ value understates echo-only removal.
132
  - **AECMOS** (Purin et al., ICASSP 2022) is Microsoft's non-intrusive AEC
133
+ quality predictor. "Echo" rates how well echo was removed; "degradation"
134
+ rates how clean the resulting speech is. 1–5 MOS scale, higher is better.
135
+
136
+ ### AEC Challenge 2022 blind set (real recordings)
137
+
138
+ Stratified 150-sample eval (30 per scenario) on the
139
+ [ICASSP 2022 AEC Challenge blind test set](https://github.com/microsoft/AEC-Challenge).
140
+
141
+ | Scenario | AECMOS echo | AECMOS deg | blind ERLE |
142
+ |---|---:|---:|---:|
143
+ | doubletalk | 4.82 | 2.54 | 12.5 dB |
144
+ | doubletalk-with-movement | 4.76 | 2.47 | 9.7 dB |
145
+ | farend-singletalk | 3.45 | 4.93 | 47.7 dB |
146
+ | farend-singletalk-with-movement | 3.96 | 4.93 | 52.5 dB |
147
+ | nearend-singletalk | 4.94 | 3.83 | 4.7 dB |
148
 
149
  ### Why DNSMOS OVRL is not reported here
150