ninagroot/GPT2-705Mtest

README.md

@@ -13,7 +13,7 @@ should probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [](https://huggingface.co/) on an unknown dataset.
 It achieves the following results on the evaluation set:
-- Loss: 8.4951
+- Loss: 7.4496
 
 ## Model description
 
@@ -41,16 +41,19 @@ The following hyperparameters were used during training:
 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
 - lr_scheduler_type: cosine
 - lr_scheduler_warmup_steps: 100
-- num_epochs: 4
+- num_epochs: 10
 - mixed_precision_training: Native AMP
 
 ### Training results
 
 | Training Loss | Epoch | Step | Validation Loss |
 |:-------------:|:-----:|:----:|:---------------:|
-| No log        | 0.57  | 1    | 9.7287          |
-| No log        | 1.71  | 3    | 8.6584          |
-| No log        | 2.29  | 4    | 8.4951          |
+| No log        | 0.57  | 1    | 9.7861          |
+| No log        | 1.71  | 3    | 8.5878          |
+| No log        | 2.86  | 5    | 8.2583          |
+| No log        | 4.0   | 7    | 7.9939          |
+| No log        | 4.57  | 8    | 7.8503          |
+| No log        | 5.71  | 10   | 7.4496          |
 
 
 ### Framework versions

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:f9d9b0b3e4b9d4d3eb8d6a2d864f309f5e9c8f487a1624c87f5308022fd39b35
+oid sha256:ac4dca2e1fb9d9cdba14ce6b42938c577249cf20a62d6333dd44fbf7cadca77e
 size 2796386080

runs/Apr16_10-53-17_gcn9.local.snellius.surf.nl/events.out.tfevents.1713257606.gcn9.local.snellius.surf.nl.519590.0

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:af1de6411d658079a2137b1394476c83f09cf4f9a0bb8f3c086420a143fdc1dd
+size 6623

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:8e1c25d61443ea7e925936ff8d26fb0d6644c0ea4416f0400a73314e5ef280b8
+oid sha256:0f1af8c960cef3e70b4e192c4c07ce00ff29c5f09cee895c2e3708179dad2ee8
 size 4984