Hugging Face's logo

ninagroot
/
GPT2-705M-ORIGINAL

Text Generation
Transformers
TensorBoard
Safetensors
gpt2
Generated from Trainer
text-generation-inference
Model card Files
xet
Metrics Community
ninagroot commited on
Commit
b8b0bda
·
verified ·
1 Parent(s): 6c52f16

ninagroot/GPT2-705M

Browse files
Files changed (4) hide show
  1. README.md +37 -37
  2. model.safetensors +1 -1
  3. runs/Apr22_17-51-17_gcn36.local.snellius.surf.nl/events.out.tfevents.1713801087.gcn36.local.snellius.surf.nl.310481.0 +3 -0
  4. training_args.bin +1 -1
README.md CHANGED
@@ -13,7 +13,7 @@ should probably proofread and complete it, then remove this comment. -->
13
 
14
  This model is a fine-tuned version of [](https://huggingface.co/) on an unknown dataset.
15
  It achieves the following results on the evaluation set:
16
- - Loss: 5.6270
17
 
18
  ## Model description
19
 
@@ -48,42 +48,42 @@ The following hyperparameters were used during training:
48
 
49
  | Training Loss | Epoch | Step | Validation Loss |
50
  |:-------------:|:-----:|:----:|:---------------:|
51
- | 8.5925 | 0.89 | 2 | 7.6311 |
52
- | 7.3515 | 1.78 | 4 | 7.4152 |
53
- | 7.0062 | 2.67 | 6 | 8.1091 |
54
- | 6.9438 | 4.0 | 9 | 6.8820 |
55
- | 6.677 | 4.89 | 11 | 6.5554 |
56
- | 6.4148 | 5.78 | 13 | 6.3059 |
57
- | 8.9017 | 6.67 | 15 | 6.8685 |
58
- | 5.9771 | 8.0 | 18 | 6.0891 |
59
- | 5.954 | 8.89 | 20 | 5.9980 |
60
- | 5.5408 | 9.78 | 22 | 5.8510 |
61
- | 5.5317 | 10.67 | 24 | 5.7076 |
62
- | 5.3339 | 12.0 | 27 | 5.5818 |
63
- | 5.1349 | 12.89 | 29 | 5.5237 |
64
- | 4.8787 | 13.78 | 31 | 5.3607 |
65
- | 4.7378 | 14.67 | 33 | 5.3155 |
66
- | 4.5963 | 16.0 | 36 | 5.2132 |
67
- | 4.5486 | 16.89 | 38 | 5.2021 |
68
- | 4.3607 | 17.78 | 40 | 5.1855 |
69
- | 4.1617 | 18.67 | 42 | 5.1495 |
70
- | 4.0081 | 20.0 | 45 | 5.2205 |
71
- | 3.8752 | 20.89 | 47 | 5.1662 |
72
- | 3.7416 | 21.78 | 49 | 5.1064 |
73
- | 3.5625 | 22.67 | 51 | 5.1971 |
74
- | 3.4833 | 24.0 | 54 | 5.2674 |
75
- | 3.4561 | 24.89 | 56 | 5.2434 |
76
- | 3.289 | 25.78 | 58 | 5.3531 |
77
- | 3.0789 | 26.67 | 60 | 5.2836 |
78
- | 2.9881 | 28.0 | 63 | 5.3600 |
79
- | 2.78 | 28.89 | 65 | 5.4213 |
80
- | 2.7596 | 29.78 | 67 | 5.5054 |
81
- | 2.7092 | 30.67 | 69 | 5.5174 |
82
- | 2.4973 | 32.0 | 72 | 5.5720 |
83
- | 2.4325 | 32.89 | 74 | 5.5919 |
84
- | 2.4212 | 33.78 | 76 | 5.6215 |
85
- | 2.4784 | 34.67 | 78 | 5.6264 |
86
- | 2.4055 | 35.56 | 80 | 5.6270 |
87
 
88
 
89
  ### Framework versions
 
13
 
14
  This model is a fine-tuned version of [](https://huggingface.co/) on an unknown dataset.
15
  It achieves the following results on the evaluation set:
16
+ - Loss: 4.8747
17
 
18
  ## Model description
19
 
 
48
 
49
  | Training Loss | Epoch | Step | Validation Loss |
50
  |:-------------:|:-----:|:----:|:---------------:|
51
+ | 8.6484 | 0.89 | 2 | 7.5910 |
52
+ | 7.4125 | 1.78 | 4 | 7.3845 |
53
+ | 7.177 | 2.67 | 6 | 8.4543 |
54
+ | 6.8693 | 4.0 | 9 | 7.1517 |
55
+ | 6.7375 | 4.89 | 11 | 6.7577 |
56
+ | 6.4793 | 5.78 | 13 | 6.3863 |
57
+ | 6.155 | 6.67 | 15 | 6.1743 |
58
+ | 5.8146 | 8.0 | 18 | 5.8802 |
59
+ | 5.5765 | 8.89 | 20 | 5.6410 |
60
+ | 5.1699 | 9.78 | 22 | 5.4458 |
61
+ | 5.1785 | 10.67 | 24 | 5.3271 |
62
+ | 4.854 | 12.0 | 27 | 5.0277 |
63
+ | 4.8076 | 12.89 | 29 | 4.9158 |
64
+ | 4.5975 | 13.78 | 31 | 4.9445 |
65
+ | 4.385 | 14.67 | 33 | 4.8140 |
66
+ | 4.4167 | 16.0 | 36 | 4.6747 |
67
+ | 4.3464 | 16.89 | 38 | 4.5966 |
68
+ | 4.1645 | 17.78 | 40 | 4.4547 |
69
+ | 3.9958 | 18.67 | 42 | 4.4993 |
70
+ | 3.8152 | 20.0 | 45 | 4.4591 |
71
+ | 3.6949 | 20.89 | 47 | 4.4364 |
72
+ | 3.6767 | 21.78 | 49 | 4.4040 |
73
+ | 3.5244 | 22.67 | 51 | 4.4034 |
74
+ | 3.3385 | 24.0 | 54 | 4.4621 |
75
+ | 3.2586 | 24.89 | 56 | 4.5152 |
76
+ | 3.1222 | 25.78 | 58 | 4.5277 |
77
+ | 2.8846 | 26.67 | 60 | 4.5638 |
78
+ | 2.7718 | 28.0 | 63 | 4.6443 |
79
+ | 2.5681 | 28.89 | 65 | 4.6683 |
80
+ | 2.5383 | 29.78 | 67 | 4.7204 |
81
+ | 2.4544 | 30.67 | 69 | 4.7512 |
82
+ | 2.2336 | 32.0 | 72 | 4.7927 |
83
+ | 2.1591 | 32.89 | 74 | 4.8253 |
84
+ | 2.1328 | 33.78 | 76 | 4.8684 |
85
+ | 2.1649 | 34.67 | 78 | 4.8750 |
86
+ | 2.1091 | 35.56 | 80 | 4.8747 |
87
 
88
 
89
  ### Framework versions
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:40aec222e6f700bd7d8d9f3afee737bd5fc50e1df079cb21ebb911cb9db49a3c
3
  size 2747965216
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:59f9b32e01cb286bf7b3f5bf3c4452b35c89854ce4edeb937cbd1a3f0e29c890
3
  size 2747965216
runs/Apr22_17-51-17_gcn36.local.snellius.surf.nl/events.out.tfevents.1713801087.gcn36.local.snellius.surf.nl.310481.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:58471ee2ad8843ffe404867bbc87a0bb1e00f9a9c6fc28bbc214ba133c01c3c1
3
+ size 31161
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:5685ee84a21f9d295bec8aa5aea5bb524739050e8420d2112a1e6f09cdd47898
3
  size 4984
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d0e8c7544a44d2168b581b5ef35f1b96ca96f33b184b742628c864897f209e2f
3
  size 4984