Model save

README.md

@@ -15,7 +15,7 @@ should probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [distilbert/distilgpt2](https://huggingface.co/distilbert/distilgpt2) on an unknown dataset.
 It achieves the following results on the evaluation set:
-- Loss: 4.3565
+- Loss: 3.8488
 
 ## Model description
 
@@ -34,33 +34,38 @@ More information needed
 ### Training hyperparameters
 
 The following hyperparameters were used during training:
-- learning_rate: 8e-05
+- learning_rate: 0.0002
 - train_batch_size: 16
 - eval_batch_size: 32
 - seed: 42
 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
 - lr_scheduler_type: linear
 - lr_scheduler_warmup_steps: 500
-- num_epochs: 3
+- num_epochs: 4
 
 ### Training results
 
 | Training Loss | Epoch | Step  | Validation Loss |
 |:-------------:|:-----:|:-----:|:---------------:|
-| 6.6049        | 0.21  | 1000  | 5.6029          |
-| 5.4429        | 0.42  | 2000  | 5.1985          |
-| 5.1379        | 0.63  | 3000  | 4.9480          |
-| 4.9697        | 0.84  | 4000  | 4.8117          |
-| 4.82          | 1.05  | 5000  | 4.7015          |
-| 4.7219        | 1.26  | 6000  | 4.6272          |
-| 4.648         | 1.47  | 7000  | 4.5548          |
-| 4.6005        | 1.68  | 8000  | 4.5024          |
-| 4.5511        | 1.89  | 9000  | 4.4625          |
-| 4.4843        | 2.1   | 10000 | 4.4290          |
-| 4.4343        | 2.31  | 11000 | 4.4026          |
-| 4.4215        | 2.52  | 12000 | 4.3810          |
-| 4.4033        | 2.73  | 13000 | 4.3652          |
-| 4.3886        | 2.94  | 14000 | 4.3565          |
+| 6.2132        | 0.21  | 1000  | 5.2772          |
+| 5.0485        | 0.42  | 2000  | 4.7982          |
+| 4.7238        | 0.63  | 3000  | 4.5621          |
+| 4.5529        | 0.84  | 4000  | 4.4206          |
+| 4.4022        | 1.05  | 5000  | 4.3098          |
+| 4.2349        | 1.26  | 6000  | 4.2299          |
+| 4.1795        | 1.47  | 7000  | 4.1560          |
+| 4.1286        | 1.68  | 8000  | 4.0875          |
+| 4.0866        | 1.89  | 9000  | 4.0361          |
+| 3.9584        | 2.1   | 10000 | 4.0204          |
+| 3.8666        | 2.31  | 11000 | 3.9785          |
+| 3.8471        | 2.52  | 12000 | 3.9498          |
+| 3.8463        | 2.73  | 13000 | 3.9202          |
+| 3.8116        | 2.94  | 14000 | 3.8936          |
+| 3.697         | 3.15  | 15000 | 3.8964          |
+| 3.6553        | 3.36  | 16000 | 3.8825          |
+| 3.6525        | 3.56  | 17000 | 3.8660          |
+| 3.6494        | 3.77  | 18000 | 3.8522          |
+| 3.6542        | 3.98  | 19000 | 3.8488          |
 
 
 ### Framework versions

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:66993644c445b0219c24cfda32d3d232e01b115285986f30838b73f490f2019c
+oid sha256:3b60ed2827e34ad999716fe7186404150b5c3bb7366d8bc0a203304919acbca1
 size 327657928

runs/Mar25_10-08-58_gweltaz-NUC10i7FNK/events.out.tfevents.1711357745.gweltaz-NUC10i7FNK

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:23db59003b1f4d4c1567207a169e4e4cf50306af5130f2bb7a38d959a3c937a9
+size 8679

runs/Mar30_12-51-25_gweltaz-NUC10i7FNK/events.out.tfevents.1711799493.gweltaz-NUC10i7FNK

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:f8fb536290ac203da9a69888bca00cfe591e34ff3e0a4be67e2612c6f710e3a6
-size 13310
+oid sha256:a8af7aea697449d20f3b45fe73522971fdfe28a4b5a4d864ae35017794e07c7a
+size 14437