huseinzolkepliscicom commited on
Commit
401a1a6
·
verified ·
1 Parent(s): 831886d

Add CER benchmark (plot + table); mark small fully trained

Browse files
Files changed (1) hide show
  1. README.md +20 -2
README.md CHANGED
@@ -31,6 +31,25 @@ input (8-16 kHz telephony) --16k--> [FE: 24-layer w2v-BERT 2.0 + LoRA] --feature
31
  The **FE LoRA adapter is merged into the base weights at load time**, so inference needs **no `peft`** —
32
  just `transformers` + `descript-audio-codec`.
33
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
34
  ## Quick start — infer from the HF checkpoint
35
 
36
  ```bash
@@ -52,8 +71,7 @@ cd CallEnhancer && python infer_callcentre.py \
52
 
53
  Prefer Python (load weights from the Hub with `hf_hub_download`)? See **[Python](#python-pull-weights-from-the-hub)** below.
54
 
55
- > **Status:** the decoder is still training and these checkpoints are refreshed periodically
56
- > quality keeps improving. It already restores real 8 kHz call-centre audio well.
57
 
58
  ## Files
59
 
 
31
  The **FE LoRA adapter is merged into the base weights at load time**, so inference needs **no `peft`** —
32
  just `transformers` + `descript-audio-codec`.
33
 
34
+ ## Benchmark — CER
35
+
36
+ Character Error Rate (Whisper large-v3, **lower is better**) on a held-out **private call-centre
37
+ test set**. CallEnhancer restores telephony-degraded speech so an ASR reads it far more accurately
38
+ than the raw input or general-purpose speech enhancers.
39
+
40
+ ![CER on a private call-centre test set](assets/callcentre_cer.png)
41
+
42
+ | model | CER % ↓ |
43
+ |---|---:|
44
+ | degraded (original) | 71.48 |
45
+ | voicefixer | 58.27 |
46
+ | resemble-enhance | 54.96 |
47
+ | sidon-v0.1 | 41.06 |
48
+ | **CallEnhancer-small** (this repo, open source) | **38.91** |
49
+ | **CallEnhancer-base** | **19.01** |
50
+
51
+ This repository hosts **CallEnhancer-small** (open source); **CallEnhancer-base** is the larger model.
52
+
53
  ## Quick start — infer from the HF checkpoint
54
 
55
  ```bash
 
71
 
72
  Prefer Python (load weights from the Hub with `hf_hub_download`)? See **[Python](#python-pull-weights-from-the-hub)** below.
73
 
74
+ > **Status:** CallEnhancer-small is fully trained and restores real 8 kHz call-centre audio well.
 
75
 
76
  ## Files
77