speecht5_Mehdi_Final_Model_v2

This model is a fine-tuned version of kingmhd1519/speecht5_Mehdi_Final_Model on an unknown dataset. It achieves the following results on the evaluation set:

• Loss: 0.3991

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 5e-05
• train_batch_size: 4
• eval_batch_size: 2
• seed: 42
• gradient_accumulation_steps: 8
• total_train_batch_size: 32
• optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
• lr_scheduler_type: linear
• lr_scheduler_warmup_steps: 200
• training_steps: 1500
• mixed_precision_training: Native AMP

Training results

Training Loss	Epoch	Step	Validation Loss
0.4336	3.2924	250	0.4085
0.4214	6.5847	500	0.4003
0.4176	9.8771	750	0.3979
0.4064	13.1595	1000	0.3968
0.3999	16.4518	1250	0.3985
0.4028	19.7442	1500	0.3991

Framework versions

• Transformers 4.52.2
• Pytorch 2.6.0+cu124
• Datasets 2.14.4
• Tokenizers 0.21.1