wav2vecresults

This model was trained from scratch on an unknown dataset. It achieves the following results on the evaluation set:

• Loss: 0.3445
• Wer: 0.2804

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 5e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
• lr_scheduler_type: linear
• num_epochs: 16
• mixed_precision_training: Native AMP

Training results

Training Loss	Epoch	Step	Validation Loss	Wer
3.3595	0.2584	100	3.0147	1.0
2.7713	0.5168	200	2.6457	0.9987
2.3829	0.7752	300	2.1221	0.9779
1.6705	1.0336	400	1.4914	0.8859
1.4199	1.2920	500	1.0897	0.8255
1.0916	1.5504	600	0.8375	0.7083
0.9454	1.8088	700	0.7106	0.5955
1.052	2.0672	800	0.6276	0.5671
0.8545	2.3256	900	0.5644	0.5180
0.7128	2.5840	1000	0.5431	0.4991
0.6581	2.8424	1100	0.5072	0.4675
0.6191	3.1008	1200	0.4774	0.4222
0.7273	3.3592	1300	0.4636	0.4184
0.653	3.6176	1400	0.4441	0.4083
0.5957	3.8760	1500	0.4392	0.4178
0.67	4.1344	1600	0.4311	0.4071
0.5323	4.3928	1700	0.4392	0.3995
0.4944	4.6512	1800	0.4168	0.3642
0.5163	4.9096	1900	0.4111	0.3812
0.4862	5.1680	2000	0.4182	0.3724
0.4327	5.4264	2100	0.4103	0.3642
0.5428	5.6848	2200	0.4110	0.3629
0.5885	5.9432	2300	0.3904	0.3617
0.4507	6.2016	2400	0.3933	0.3459
0.4821	6.4599	2500	0.3999	0.3459
0.3707	6.7183	2600	0.3910	0.3516
0.4995	6.9767	2700	0.3839	0.3522
0.4108	7.2351	2800	0.3882	0.3478
0.4508	7.4935	2900	0.3888	0.3447
0.4551	7.7519	3000	0.3861	0.3466
0.2842	8.0103	3100	0.4146	0.3415
0.4566	8.2687	3200	0.4189	0.3592
0.4027	8.5271	3300	0.3945	0.3497
0.4543	8.7855	3400	0.4095	0.3503
0.325	9.0439	3500	0.3837	0.3308
0.4744	9.3023	3600	0.3791	0.3579
0.3841	9.5607	3700	0.3815	0.3144
0.4444	9.8191	3800	0.3729	0.3182
0.3398	10.0775	3900	0.3670	0.3239
0.3695	10.3359	4000	0.3637	0.3157
0.3802	10.5943	4100	0.3536	0.3081
0.3958	10.8527	4200	0.3440	0.2974
0.3055	11.1111	4300	0.3593	0.3031
0.3651	11.3695	4400	0.3543	0.2892
0.3045	11.6279	4500	0.3526	0.2936
0.3498	11.8863	4600	0.3503	0.2861
0.3108	12.1447	4700	0.3564	0.2905
0.3688	12.4031	4800	0.3502	0.2968
0.3453	12.6615	4900	0.3558	0.3050
0.2544	12.9199	5000	0.3508	0.2892
0.3211	13.1783	5100	0.3615	0.2924
0.2879	13.4367	5200	0.3497	0.2886
0.2663	13.6951	5300	0.3582	0.3050
0.3259	13.9535	5400	0.3532	0.2911
0.2812	14.2119	5500	0.3555	0.2886
0.2298	14.4703	5600	0.3407	0.2728
0.3442	14.7287	5700	0.3527	0.2804
0.2619	14.9871	5800	0.3434	0.2716
0.2779	15.2455	5900	0.3424	0.2873
0.2758	15.5039	6000	0.3448	0.2829
0.2339	15.7623	6100	0.3445	0.2804

Framework versions

• Transformers 4.52.4
• Pytorch 2.6.0+cu124
• Datasets 3.6.0
• Tokenizers 0.21.2