dd3434 commited on
Commit
0dbf666
·
verified ·
1 Parent(s): 6984d7c

End of training

Browse files
Files changed (1) hide show
  1. README.md +14 -13
README.md CHANGED
@@ -16,8 +16,8 @@ should probably proofread and complete it, then remove this comment. -->
16
 
17
  This model is a fine-tuned version of [kykim/bert-kor-base](https://huggingface.co/kykim/bert-kor-base) on an unknown dataset.
18
  It achieves the following results on the evaluation set:
19
- - Loss: 0.2414
20
- - Accuracy: 0.9149
21
 
22
  ## Model description
23
 
@@ -37,25 +37,26 @@ More information needed
37
 
38
  The following hyperparameters were used during training:
39
  - learning_rate: 2e-05
40
- - train_batch_size: 128
41
- - eval_batch_size: 128
42
  - seed: 42
43
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
44
  - lr_scheduler_type: linear
45
- - num_epochs: 2
46
 
47
  ### Training results
48
 
49
  | Training Loss | Epoch | Step | Validation Loss | Accuracy |
50
  |:-------------:|:-----:|:----:|:---------------:|:--------:|
51
- | No log | 0.23 | 100 | 0.3599 | 0.8855 |
52
- | No log | 0.46 | 200 | 0.3003 | 0.8995 |
53
- | No log | 0.7 | 300 | 0.2731 | 0.9092 |
54
- | No log | 0.93 | 400 | 0.2682 | 0.9103 |
55
- | 0.3663 | 1.16 | 500 | 0.2616 | 0.9105 |
56
- | 0.3663 | 1.39 | 600 | 0.2522 | 0.9144 |
57
- | 0.3663 | 1.62 | 700 | 0.2462 | 0.9149 |
58
- | 0.3663 | 1.86 | 800 | 0.2414 | 0.9149 |
 
59
 
60
 
61
  ### Framework versions
 
16
 
17
  This model is a fine-tuned version of [kykim/bert-kor-base](https://huggingface.co/kykim/bert-kor-base) on an unknown dataset.
18
  It achieves the following results on the evaluation set:
19
+ - Loss: 0.5054
20
+ - Accuracy: 0.8618
21
 
22
  ## Model description
23
 
 
37
 
38
  The following hyperparameters were used during training:
39
  - learning_rate: 2e-05
40
+ - train_batch_size: 32
41
+ - eval_batch_size: 32
42
  - seed: 42
43
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
44
  - lr_scheduler_type: linear
45
+ - num_epochs: 5
46
 
47
  ### Training results
48
 
49
  | Training Loss | Epoch | Step | Validation Loss | Accuracy |
50
  |:-------------:|:-----:|:----:|:---------------:|:--------:|
51
+ | No log | 0.55 | 100 | 0.4919 | 0.8230 |
52
+ | No log | 1.1 | 200 | 0.4253 | 0.8509 |
53
+ | No log | 1.65 | 300 | 0.4203 | 0.8556 |
54
+ | No log | 2.2 | 400 | 0.4475 | 0.8711 |
55
+ | 0.411 | 2.75 | 500 | 0.4450 | 0.8649 |
56
+ | 0.411 | 3.3 | 600 | 0.4582 | 0.8665 |
57
+ | 0.411 | 3.85 | 700 | 0.4824 | 0.8649 |
58
+ | 0.411 | 4.4 | 800 | 0.4810 | 0.8696 |
59
+ | 0.411 | 4.95 | 900 | 0.5054 | 0.8618 |
60
 
61
 
62
  ### Framework versions