deit-base-patch16-224_rice-leaf-disease-augmented_tl_020125

This model is a fine-tuned version of facebook/deit-base-patch16-224 on an unknown dataset. It achieves the following results on the evaluation set:

• Loss: 0.7678
• Accuracy: 0.757

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 0.001
• train_batch_size: 64
• eval_batch_size: 64
• seed: 42
• optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
• lr_scheduler_type: linear
• lr_scheduler_warmup_ratio: 0.1
• num_epochs: 15

Training results

Training Loss	Epoch	Step	Accuracy	Validation Loss
2.0085	1.0	250	0.4305	1.7920
1.5371	2.0	500	0.5935	1.3467
1.2212	3.0	750	0.658	1.1434
1.0695	4.0	1000	0.6845	1.0324
0.9787	5.0	1250	0.707	0.9592
0.916	6.0	1500	0.7175	0.9066
0.8713	7.0	1750	0.7255	0.8705
0.8382	8.0	2000	0.736	0.8404
0.8123	9.0	2250	0.7405	0.8190
0.7927	10.0	2500	0.746	0.8022
0.7772	11.0	2750	0.753	0.7892
0.7657	12.0	3000	0.7795	0.753
0.7574	13.0	3250	0.7731	0.7565
0.7518	14.0	3500	0.7693	0.757
0.749	15.0	3750	0.7678	0.757

Framework versions

• Transformers 4.47.1
• Pytorch 2.5.1+cu124
• Datasets 3.2.0
• Tokenizers 0.21.0