seongj commited on
Commit
62a8ef8
·
1 Parent(s): ae858c0

update model card README.md

Browse files
Files changed (1) hide show
  1. README.md +10 -1
README.md CHANGED
@@ -13,6 +13,8 @@ should probably proofread and complete it, then remove this comment. -->
13
  # gpt2lm
14
 
15
  This model is a fine-tuned version of [gpt2](https://huggingface.co/gpt2) on an unknown dataset.
 
 
16
 
17
  ## Model description
18
 
@@ -41,10 +43,17 @@ The following hyperparameters were used during training:
41
  - lr_scheduler_type: cosine
42
  - lr_scheduler_warmup_steps: 1000
43
  - num_epochs: 1
44
- - mixed_precision_training: Native AMP
45
 
46
  ### Training results
47
 
 
 
 
 
 
 
 
 
48
 
49
 
50
  ### Framework versions
 
13
  # gpt2lm
14
 
15
  This model is a fine-tuned version of [gpt2](https://huggingface.co/gpt2) on an unknown dataset.
16
+ It achieves the following results on the evaluation set:
17
+ - Loss: 1.2929
18
 
19
  ## Model description
20
 
 
43
  - lr_scheduler_type: cosine
44
  - lr_scheduler_warmup_steps: 1000
45
  - num_epochs: 1
 
46
 
47
  ### Training results
48
 
49
+ | Training Loss | Epoch | Step | Validation Loss |
50
+ |:-------------:|:-----:|:-----:|:---------------:|
51
+ | 2.5666 | 0.16 | 5000 | 1.8018 |
52
+ | 1.6685 | 0.31 | 10000 | 1.5932 |
53
+ | 1.4956 | 0.47 | 15000 | 1.4797 |
54
+ | 1.3802 | 0.62 | 20000 | 1.3924 |
55
+ | 1.2885 | 0.78 | 25000 | 1.3243 |
56
+ | 1.2355 | 0.93 | 30000 | 1.2929 |
57
 
58
 
59
  ### Framework versions