robertp408/mms-1b-all-qxp

Finetuned facebook/mms-1b-all on 1502 Puno Quechua training audio samples from cmflnuzw781hfx067jwv4pt9x.

This model was created from the Mozilla.ai Blueprint: speech-to-text-finetune.

Evaluation results on 562 audio samples of Puno Quechua:

Baseline model (before finetuning) on Puno Quechua

• Word Error Rate (Normalized): 146.227
• Word Error Rate (Orthographic): 100.0
• Character Error Rate (Normalized): 332.297
• Character Error Rate (Orthographic): 344.813
• Loss: 23.528

Finetuned model (after finetuning) on Puno Quechua

• Word Error Rate (Normalized): 19.5
• Word Error Rate (Orthographic): 32.432
• Character Error Rate (Normalized): 2.718
• Character Error Rate (Orthographic): 4.452
• Loss: 0.163