dd3434 commited on
Commit
603afad
·
verified ·
1 Parent(s): b1f70a1

End of training

Browse files
Files changed (2) hide show
  1. README.md +12 -11
  2. pytorch_model.bin +1 -1
README.md CHANGED
@@ -16,8 +16,8 @@ should probably proofread and complete it, then remove this comment. -->
16
 
17
  This model is a fine-tuned version of [kykim/bert-kor-base](https://huggingface.co/kykim/bert-kor-base) on an unknown dataset.
18
  It achieves the following results on the evaluation set:
19
- - Loss: 1.0590
20
- - Accuracy: 0.8587
21
 
22
  ## Model description
23
 
@@ -42,21 +42,22 @@ The following hyperparameters were used during training:
42
  - seed: 42
43
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
44
  - lr_scheduler_type: linear
 
45
  - num_epochs: 5
46
 
47
  ### Training results
48
 
49
  | Training Loss | Epoch | Step | Validation Loss | Accuracy |
50
  |:-------------:|:-----:|:----:|:---------------:|:--------:|
51
- | 0.6008 | 0.55 | 100 | 0.4586 | 0.8525 |
52
- | 0.4733 | 1.1 | 200 | 0.4955 | 0.8463 |
53
- | 0.3034 | 1.65 | 300 | 0.4289 | 0.8602 |
54
- | 0.2576 | 2.2 | 400 | 0.6020 | 0.8401 |
55
- | 0.2013 | 2.75 | 500 | 0.5233 | 0.8509 |
56
- | 0.1409 | 3.3 | 600 | 0.6732 | 0.8665 |
57
- | 0.1544 | 3.85 | 700 | 0.6559 | 0.8711 |
58
- | 0.0918 | 4.4 | 800 | 0.9371 | 0.8556 |
59
- | 0.0851 | 4.95 | 900 | 1.0590 | 0.8587 |
60
 
61
 
62
  ### Framework versions
 
16
 
17
  This model is a fine-tuned version of [kykim/bert-kor-base](https://huggingface.co/kykim/bert-kor-base) on an unknown dataset.
18
  It achieves the following results on the evaluation set:
19
+ - Loss: 0.8983
20
+ - Accuracy: 0.8494
21
 
22
  ## Model description
23
 
 
42
  - seed: 42
43
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
44
  - lr_scheduler_type: linear
45
+ - lr_scheduler_warmup_steps: 500
46
  - num_epochs: 5
47
 
48
  ### Training results
49
 
50
  | Training Loss | Epoch | Step | Validation Loss | Accuracy |
51
  |:-------------:|:-----:|:----:|:---------------:|:--------:|
52
+ | 1.0165 | 0.55 | 100 | 0.4991 | 0.8276 |
53
+ | 0.5172 | 1.1 | 200 | 0.4169 | 0.8432 |
54
+ | 0.4037 | 1.65 | 300 | 0.4564 | 0.8401 |
55
+ | 0.3634 | 2.2 | 400 | 0.5709 | 0.8416 |
56
+ | 0.3281 | 2.75 | 500 | 0.5841 | 0.8152 |
57
+ | 0.2753 | 3.3 | 600 | 0.5686 | 0.8634 |
58
+ | 0.2083 | 3.85 | 700 | 0.5608 | 0.8478 |
59
+ | 0.125 | 4.4 | 800 | 0.7229 | 0.8494 |
60
+ | 0.1023 | 4.95 | 900 | 0.8983 | 0.8494 |
61
 
62
 
63
  ### Framework versions
pytorch_model.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:2f140fe5875467f72a681c7d71141afc42e03d3ef38570d76b4e4dc83b4b3d15
3
  size 473270510
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bb3494620bcb22a346ddd8998dc474e2040ba8aa074aca54907ab52367d7efdf
3
  size 473270510