latentASR / docs /RESULTS.md
voidful's picture
Release latentASR adapter, code, docs, and reproducibility artifacts
262fa3f verified
|
Raw
History Blame Contribute Delete
1.39 kB

Results

This release includes JSON and Markdown outputs under results/. The most important caveat is that the clean benchmark gains are single-run directional point estimates, not statistically established improvements.

Clean Main Benchmarks

Model FLEURS WER VoxPopuli WER
Frozen Qwen3-ASR baseline 4.900 9.038
LatentASR, N=4, theta=0 4.776 8.995

Relative WER deltas:

  • FLEURS: -2.54%
  • VoxPopuli: -0.47%

Robustness Diagnostics

At SNR 0 dB:

Dataset Baseline WER LatentASR WER Relative delta
FLEURS 29.81 29.42 -1.32%
VoxPopuli 19.71 19.51 -1.02%

Stress broad suite weighted aggregate:

  • Baseline WER: 36.843
  • LatentASR WER: 36.265
  • Delta: -0.578 pp (-1.57% relative)

ASCEND Diagnostic

ASCEND CER:

  • Baseline: 57.81
  • LatentASR: 48.55
  • Relative CER delta: -16.02%

This is explicitly treated as an overlap-confounded in-domain diagnostic. ASCEND contributes 5/500 activation utterances and speaker-disjointness was not enforced.

Included Result Folders

  • results/paper500_main_eval_20260518/
  • results/paper500_english_clean_noise_20260518/
  • results/paper500_multilingual_streaming_20260518/
  • results/paper500_threshold_20260518/
  • results/paper500_more_testing_stress_20260525/
  • results/paper500_ascend_20260518/