Hugging Face's logo

CocoRoF
/
KoModernBERT-chp-05

Fill-Mask
Transformers
Safetensors
modernbert
Generated from Trainer
Model card Files
xet
Community
CocoRoF commited on
Commit
eeb1213
·
verified ·
1 Parent(s): 5dab61a

cc-100_15-17 Done

Browse files
Files changed (1) hide show
  1. README.md +16 -16
README.md CHANGED
@@ -1,22 +1,22 @@
1
  ---
2
  library_name: transformers
3
  license: apache-2.0
4
- base_model: CocoRoF/KoModernBERT-chp-03
5
  tags:
6
  - generated_from_trainer
7
  model-index:
8
- - name: KoModernBERT-chp-04
9
  results: []
10
  ---
11
 
12
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
13
  should probably proofread and complete it, then remove this comment. -->
14
 
15
- # KoModernBERT-chp-04
16
 
17
- This model is a fine-tuned version of [CocoRoF/KoModernBERT-chp-03](https://huggingface.co/CocoRoF/KoModernBERT-chp-03) on the None dataset.
18
  It achieves the following results on the evaluation set:
19
- - Loss: 2.1738
20
 
21
  ## Model description
22
 
@@ -52,17 +52,17 @@ The following hyperparameters were used during training:
52
 
53
  | Training Loss | Epoch | Step | Validation Loss |
54
  |:-------------:|:------:|:-----:|:---------------:|
55
- | 18.7395 | 0.0904 | 5000 | 2.3312 |
56
- | 18.4567 | 0.1808 | 10000 | 2.3132 |
57
- | 18.0597 | 0.2712 | 15000 | 2.2958 |
58
- | 18.0592 | 0.3616 | 20000 | 2.2780 |
59
- | 18.1118 | 0.4520 | 25000 | 2.2565 |
60
- | 18.1207 | 0.5424 | 30000 | 2.2429 |
61
- | 17.3473 | 0.6329 | 35000 | 2.2228 |
62
- | 17.8666 | 0.7233 | 40000 | 2.2078 |
63
- | 17.909 | 0.8137 | 45000 | 2.1974 |
64
- | 17.1812 | 0.9041 | 50000 | 2.1855 |
65
- | 17.5599 | 0.9945 | 55000 | 2.1738 |
66
 
67
 
68
  ### Framework versions
 
1
  ---
2
  library_name: transformers
3
  license: apache-2.0
4
+ base_model: CocoRoF/KoModernBERT-chp-04
5
  tags:
6
  - generated_from_trainer
7
  model-index:
8
+ - name: KoModernBERT-chp-05
9
  results: []
10
  ---
11
 
12
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
13
  should probably proofread and complete it, then remove this comment. -->
14
 
15
+ # KoModernBERT-chp-05
16
 
17
+ This model is a fine-tuned version of [CocoRoF/KoModernBERT-chp-04](https://huggingface.co/CocoRoF/KoModernBERT-chp-04) on the None dataset.
18
  It achieves the following results on the evaluation set:
19
+ - Loss: 2.0829
20
 
21
  ## Model description
22
 
 
52
 
53
  | Training Loss | Epoch | Step | Validation Loss |
54
  |:-------------:|:------:|:-----:|:---------------:|
55
+ | 17.9483 | 0.0904 | 5000 | 2.1860 |
56
+ | 17.4604 | 0.1808 | 10000 | 2.1737 |
57
+ | 17.2613 | 0.2712 | 15000 | 2.1614 |
58
+ | 17.3945 | 0.3616 | 20000 | 2.1502 |
59
+ | 16.9544 | 0.4520 | 25000 | 2.1386 |
60
+ | 16.8142 | 0.5424 | 30000 | 2.1271 |
61
+ | 16.7899 | 0.6329 | 35000 | 2.1153 |
62
+ | 16.9125 | 0.7233 | 40000 | 2.1080 |
63
+ | 16.954 | 0.8137 | 45000 | 2.1012 |
64
+ | 16.6773 | 0.9041 | 50000 | 2.0931 |
65
+ | 16.8028 | 0.9945 | 55000 | 2.0829 |
66
 
67
 
68
  ### Framework versions