ssc-lke-mms-model-mix-adapt-max2

This model was trained from scratch on an unknown dataset. It achieves the following results on the evaluation set:

• Loss: 0.7274
• Cer: 0.1643
• Wer: 0.5911

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 0.001
• train_batch_size: 1
• eval_batch_size: 6
• seed: 42
• gradient_accumulation_steps: 2
• total_train_batch_size: 2
• optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
• lr_scheduler_type: linear
• lr_scheduler_warmup_steps: 100
• num_epochs: 5
• mixed_precision_training: Native AMP

Training results

Training Loss	Epoch	Step	Validation Loss	Cer	Wer
0.6212	0.2339	200	0.7876	0.1790	0.6512
0.6044	0.4678	400	0.7649	0.1723	0.6180
0.6597	0.7018	600	0.7620	0.1726	0.6140
0.6164	0.9357	800	0.7992	0.1790	0.6477
0.6342	1.1696	1000	0.7550	0.1737	0.6153
0.6293	1.4035	1200	0.7642	0.1716	0.6275
0.6013	1.6374	1400	0.7464	0.1696	0.6110
0.5604	1.8713	1600	0.7547	0.1693	0.6044
0.6041	2.1053	1800	0.7622	0.1707	0.6099
0.5403	2.3392	2000	0.7501	0.1668	0.5983
0.5875	2.5731	2200	0.7513	0.1665	0.5953
0.5501	2.8070	2400	0.7437	0.1656	0.5957
0.585	3.0409	2600	0.7390	0.1670	0.5927
0.5539	3.2749	2800	0.7383	0.1674	0.6022
0.4939	3.5088	3000	0.7319	0.1660	0.5983
0.5466	3.7427	3200	0.7358	0.1675	0.5998
0.5196	3.9766	3400	0.7274	0.1668	0.5987
0.5116	4.2105	3600	0.7245	0.1666	0.5978
0.4403	4.4444	3800	0.7387	0.1678	0.6016
0.4876	4.6784	4000	0.7253	0.1644	0.5897
0.5276	4.9123	4200	0.7274	0.1643	0.5911

Framework versions

• Transformers 4.52.1
• Pytorch 2.9.1+cu128
• Datasets 3.6.0
• Tokenizers 0.21.4