Hugging Face's logo

ninagroot
/
GPT2-705-RUN1

Text Generation
Transformers
TensorBoard
Safetensors
gpt2
Generated from Trainer
text-generation-inference
Model card Files
xet
Metrics Community
ninagroot commited on
Commit
f56c415
·
verified ·
1 Parent(s): d6dff25

ninagroot/GPT2-705Mtest

Browse files
Files changed (4) hide show
  1. README.md +7 -10
  2. model.safetensors +1 -1
  3. runs/Apr16_10-46-06_gcn42.local.snellius.surf.nl/events.out.tfevents.1713257174.gcn42.local.snellius.surf.nl.873404.0 +3 -0
  4. training_args.bin +1 -1
README.md CHANGED
@@ -13,7 +13,7 @@ should probably proofread and complete it, then remove this comment. -->
13
 
14
  This model is a fine-tuned version of [](https://huggingface.co/) on an unknown dataset.
15
  It achieves the following results on the evaluation set:
16
- - Loss: 5.3544
17
 
18
  ## Model description
19
 
@@ -36,24 +36,21 @@ The following hyperparameters were used during training:
36
  - train_batch_size: 16
37
  - eval_batch_size: 8
38
  - seed: 42
39
- - gradient_accumulation_steps: 2
40
- - total_train_batch_size: 32
41
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
42
  - lr_scheduler_type: cosine
43
  - lr_scheduler_warmup_steps: 100
44
- - num_epochs: 6
45
  - mixed_precision_training: Native AMP
46
 
47
  ### Training results
48
 
49
  | Training Loss | Epoch | Step | Validation Loss |
50
  |:-------------:|:-----:|:----:|:---------------:|
51
- | No log | 1.0 | 7 | 7.8584 |
52
- | No log | 2.0 | 14 | 7.0791 |
53
- | 7.2479 | 3.0 | 21 | 6.6600 |
54
- | 7.2479 | 4.0 | 28 | 6.1304 |
55
- | 7.2479 | 5.0 | 35 | 5.6312 |
56
- | 4.9652 | 6.0 | 42 | 5.3544 |
57
 
58
 
59
  ### Framework versions
 
13
 
14
  This model is a fine-tuned version of [](https://huggingface.co/) on an unknown dataset.
15
  It achieves the following results on the evaluation set:
16
+ - Loss: 8.4951
17
 
18
  ## Model description
19
 
 
36
  - train_batch_size: 16
37
  - eval_batch_size: 8
38
  - seed: 42
39
+ - gradient_accumulation_steps: 8
40
+ - total_train_batch_size: 128
41
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
42
  - lr_scheduler_type: cosine
43
  - lr_scheduler_warmup_steps: 100
44
+ - num_epochs: 4
45
  - mixed_precision_training: Native AMP
46
 
47
  ### Training results
48
 
49
  | Training Loss | Epoch | Step | Validation Loss |
50
  |:-------------:|:-----:|:----:|:---------------:|
51
+ | No log | 0.57 | 1 | 9.7287 |
52
+ | No log | 1.71 | 3 | 8.6584 |
53
+ | No log | 2.29 | 4 | 8.4951 |
 
 
 
54
 
55
 
56
  ### Framework versions
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:3cd0f919698c0e7c05db9b9d9eae4ed4e0a06a219be62f0ff0f38adeaeee1a27
3
  size 2796386080
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f9d9b0b3e4b9d4d3eb8d6a2d864f309f5e9c8f487a1624c87f5308022fd39b35
3
  size 2796386080
runs/Apr16_10-46-06_gcn42.local.snellius.surf.nl/events.out.tfevents.1713257174.gcn42.local.snellius.surf.nl.873404.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:93e07de9f2c579c9f4bd4feed3cfd962b8c63377be16f02beda2e170d2410b37
3
+ size 5825
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ac0dc354c825c7dbd8b75226092f116da8373585f12e8323fd463d140293fcf8
3
  size 4984
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8e1c25d61443ea7e925936ff8d26fb0d6644c0ea4416f0400a73314e5ef280b8
3
  size 4984