Add CER benchmark (plot + table); mark small fully trained
Browse files
README.md
CHANGED
|
@@ -31,6 +31,25 @@ input (8-16 kHz telephony) --16k--> [FE: 24-layer w2v-BERT 2.0 + LoRA] --feature
|
|
| 31 |
The **FE LoRA adapter is merged into the base weights at load time**, so inference needs **no `peft`** —
|
| 32 |
just `transformers` + `descript-audio-codec`.
|
| 33 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 34 |
## Quick start — infer from the HF checkpoint
|
| 35 |
|
| 36 |
```bash
|
|
@@ -52,8 +71,7 @@ cd CallEnhancer && python infer_callcentre.py \
|
|
| 52 |
|
| 53 |
Prefer Python (load weights from the Hub with `hf_hub_download`)? See **[Python](#python-pull-weights-from-the-hub)** below.
|
| 54 |
|
| 55 |
-
> **Status:**
|
| 56 |
-
> quality keeps improving. It already restores real 8 kHz call-centre audio well.
|
| 57 |
|
| 58 |
## Files
|
| 59 |
|
|
|
|
| 31 |
The **FE LoRA adapter is merged into the base weights at load time**, so inference needs **no `peft`** —
|
| 32 |
just `transformers` + `descript-audio-codec`.
|
| 33 |
|
| 34 |
+
## Benchmark — CER
|
| 35 |
+
|
| 36 |
+
Character Error Rate (Whisper large-v3, **lower is better**) on a held-out **private call-centre
|
| 37 |
+
test set**. CallEnhancer restores telephony-degraded speech so an ASR reads it far more accurately
|
| 38 |
+
than the raw input or general-purpose speech enhancers.
|
| 39 |
+
|
| 40 |
+

|
| 41 |
+
|
| 42 |
+
| model | CER % ↓ |
|
| 43 |
+
|---|---:|
|
| 44 |
+
| degraded (original) | 71.48 |
|
| 45 |
+
| voicefixer | 58.27 |
|
| 46 |
+
| resemble-enhance | 54.96 |
|
| 47 |
+
| sidon-v0.1 | 41.06 |
|
| 48 |
+
| **CallEnhancer-small** (this repo, open source) | **38.91** |
|
| 49 |
+
| **CallEnhancer-base** | **19.01** |
|
| 50 |
+
|
| 51 |
+
This repository hosts **CallEnhancer-small** (open source); **CallEnhancer-base** is the larger model.
|
| 52 |
+
|
| 53 |
## Quick start — infer from the HF checkpoint
|
| 54 |
|
| 55 |
```bash
|
|
|
|
| 71 |
|
| 72 |
Prefer Python (load weights from the Hub with `hf_hub_download`)? See **[Python](#python-pull-weights-from-the-hub)** below.
|
| 73 |
|
| 74 |
+
> **Status:** CallEnhancer-small is fully trained and restores real 8 kHz call-centre audio well.
|
|
|
|
| 75 |
|
| 76 |
## Files
|
| 77 |
|