End of training

README.md

@@ -17,8 +17,8 @@ should probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [Definite/klue-bert-mlm-bible](https://huggingface.co/Definite/klue-bert-mlm-bible) on an unknown dataset.
 It achieves the following results on the evaluation set:
-- Loss: 0.0495
-- Accuracy: 0.986
+- Loss: 0.0816
+- Accuracy: 0.988
 
 ## Model description
 
@@ -43,14 +43,18 @@ The following hyperparameters were used during training:
 - seed: 42
 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
 - lr_scheduler_type: linear
-- num_epochs: 2
+- num_epochs: 6
 
 ### Training results
 
 | Training Loss | Epoch | Step | Validation Loss | Accuracy |
 |:-------------:|:-----:|:----:|:---------------:|:--------:|
-| No log        | 1.0   | 313  | 0.0749          | 0.9767   |
-| 0.1659        | 2.0   | 626  | 0.0495          | 0.986    |
+| No log        | 1.0   | 313  | 0.1386          | 0.984    |
+| 0.0203        | 2.0   | 626  | 0.0910          | 0.9853   |
+| 0.0203        | 3.0   | 939  | 0.0745          | 0.989    |
+| 0.0031        | 4.0   | 1252 | 0.0900          | 0.9877   |
+| 0.0004        | 5.0   | 1565 | 0.0823          | 0.988    |
+| 0.0004        | 6.0   | 1878 | 0.0816          | 0.988    |
 
 
 ### Framework versions

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:47bd314cbd5b2ffa02ecd7e13325533e654802b9ed2e83f61bb2c44c3dabd73a
+oid sha256:d03f5c0e51086c9f8ad8ce72a4dee9773fd080c4a58ccc7cccee585bad99f40f
 size 442505216