ppak10
/

defect-classification-distilbert-baseline-15-epochs

Transformers

Safetensors

Generated from Trainer

Model card Files Files and versions

xet

Community

ppak10 commited on Jan 19, 2025

Commit

bc6b0b2

verified ·

1 Parent(s): 17b375f

Trained model with classification head weights

Browse files

Files changed (1) hide show

README.md +17 -17

README.md CHANGED Viewed

@@ -18,8 +18,8 @@ should probably proofread and complete it, then remove this comment. -->
 This model is a fine-tuned version of [distilbert/distilbert-base-uncased](https://huggingface.co/distilbert/distilbert-base-uncased) on an unknown dataset.
 It achieves the following results on the evaluation set:
-- Loss: 0.3102
-- Accuracy: 0.8662
 ## Model description
@@ -50,21 +50,21 @@ The following hyperparameters were used during training:
 | Training Loss | Epoch | Step  | Validation Loss | Accuracy |
 |:-------------:|:-----:|:-----:|:---------------:|:--------:|
-| 0.6519        | 1.0   | 1062  | 0.5596          | 0.7660   |
-| 0.5007        | 2.0   | 2124  | 0.4208          | 0.8127   |
-| 0.4397        | 3.0   | 3186  | 0.4227          | 0.8160   |
-| 0.4272        | 4.0   | 4248  | 0.3681          | 0.8360   |
-| 0.4058        | 5.0   | 5310  | 0.3544          | 0.8410   |
-| 0.45          | 6.0   | 6372  | 0.3343          | 0.8539   |
-| 0.3567        | 7.0   | 7434  | 0.3266          | 0.8577   |
-| 0.4379        | 8.0   | 8496  | 0.3209          | 0.8605   |
-| 0.3535        | 9.0   | 9558  | 0.3248          | 0.8580   |
-| 0.4036        | 10.0  | 10620 | 0.3230          | 0.8592   |
-| 0.3641        | 11.0  | 11682 | 0.3249          | 0.8591   |
-| 0.3457        | 12.0  | 12744 | 0.3060          | 0.8686   |
-| 0.3725        | 13.0  | 13806 | 0.3093          | 0.8671   |
-| 0.3693        | 14.0  | 14868 | 0.3064          | 0.8683   |
-| 0.3636        | 15.0  | 15930 | 0.3102          | 0.8662   |
 ### Framework versions

 This model is a fine-tuned version of [distilbert/distilbert-base-uncased](https://huggingface.co/distilbert/distilbert-base-uncased) on an unknown dataset.
 It achieves the following results on the evaluation set:
+- Loss: 0.2980
+- Accuracy: 0.8765
 ## Model description
 | Training Loss | Epoch | Step  | Validation Loss | Accuracy |
 |:-------------:|:-----:|:-----:|:---------------:|:--------:|
+| 0.7058        | 1.0   | 1062  | 0.6084          | 0.7927   |
+| 0.5439        | 2.0   | 2124  | 0.4581          | 0.8141   |
+| 0.4417        | 3.0   | 3186  | 0.3951          | 0.8403   |
+| 0.4504        | 4.0   | 4248  | 0.3578          | 0.8487   |
+| 0.428         | 5.0   | 5310  | 0.3352          | 0.8584   |
+| 0.4089        | 6.0   | 6372  | 0.3347          | 0.8638   |
+| 0.3428        | 7.0   | 7434  | 0.3248          | 0.8681   |
+| 0.4219        | 8.0   | 8496  | 0.3178          | 0.8715   |
+| 0.3689        | 9.0   | 9558  | 0.3044          | 0.8736   |
+| 0.3891        | 10.0  | 10620 | 0.3037          | 0.8724   |
+| 0.3849        | 11.0  | 11682 | 0.3064          | 0.8713   |
+| 0.3302        | 12.0  | 12744 | 0.3006          | 0.8758   |
+| 0.3576        | 13.0  | 13806 | 0.3016          | 0.8742   |
+| 0.3548        | 14.0  | 14868 | 0.2990          | 0.8766   |
+| 0.3596        | 15.0  | 15930 | 0.2980          | 0.8765   |
 ### Framework versions