Hugging Face's logo

fabikru
/
trainer

Fill-Mask
Transformers
Safetensors
modernbert
Generated from Trainer
Model card Files
xet
Community
fabikru commited on
Commit
ca1bf41
·
verified ·
1 Parent(s): 3f105fc

model_15M_medium_ds_masking_0.4_explicit_hs_predicted_hparamas

Browse files
Files changed (3) hide show
  1. README.md +17 -13
  2. model.safetensors +1 -1
  3. training_args.bin +1 -1
README.md CHANGED
@@ -16,8 +16,8 @@ should probably proofread and complete it, then remove this comment. -->
16
 
17
  This model is a fine-tuned version of [](https://huggingface.co/) on an unknown dataset.
18
  It achieves the following results on the evaluation set:
19
- - Loss: 0.0991
20
- - Accuracy: 0.9671
21
 
22
  ## Model description
23
 
@@ -50,17 +50,21 @@ The following hyperparameters were used during training:
50
 
51
  | Training Loss | Epoch | Step | Validation Loss | Accuracy |
52
  |:-------------:|:------:|:-----:|:---------------:|:--------:|
53
- | No log | 0 | 0 | 4.3245 | 0.0017 |
54
- | 0.1428 | 0.2190 | 1953 | 0.1174 | 0.9624 |
55
- | 0.1232 | 0.4379 | 3906 | 0.1159 | 0.9627 |
56
- | 0.1347 | 0.6569 | 5859 | 0.1160 | 0.9627 |
57
- | 0.1233 | 0.8759 | 7812 | 0.1096 | 0.9641 |
58
- | 0.1192 | 1.0949 | 9765 | 0.1093 | 0.9643 |
59
- | 0.1113 | 1.3138 | 11718 | 0.1044 | 0.9657 |
60
- | 0.1103 | 1.5328 | 13671 | 0.1010 | 0.9667 |
61
- | 0.1059 | 1.7518 | 15624 | 0.0982 | 0.9676 |
62
- | 0.0 | 1.9707 | 17577 | nan | 0.0 |
63
- | 0.0 | 2.1897 | 19530 | nan | 0.0 |
 
 
 
 
64
 
65
 
66
  ### Framework versions
 
16
 
17
  This model is a fine-tuned version of [](https://huggingface.co/) on an unknown dataset.
18
  It achieves the following results on the evaluation set:
19
+ - Loss: 0.0296
20
+ - Accuracy: 0.9898
21
 
22
  ## Model description
23
 
 
50
 
51
  | Training Loss | Epoch | Step | Validation Loss | Accuracy |
52
  |:-------------:|:------:|:-----:|:---------------:|:--------:|
53
+ | No log | 0 | 0 | 4.2998 | 0.1372 |
54
+ | 0.124 | 0.2190 | 1953 | 0.0899 | 0.9706 |
55
+ | 0.0752 | 0.4379 | 3906 | 0.0637 | 0.9789 |
56
+ | 0.0609 | 0.6569 | 5859 | 0.0520 | 0.9826 |
57
+ | 0.0566 | 0.8759 | 7812 | 0.0505 | 0.9831 |
58
+ | 0.0505 | 1.0949 | 9765 | 0.0453 | 0.9848 |
59
+ | 0.0462 | 1.3138 | 11718 | 0.0412 | 0.9860 |
60
+ | 0.0427 | 1.5328 | 13671 | 0.0397 | 0.9866 |
61
+ | 0.0403 | 1.7518 | 15624 | 0.0372 | 0.9874 |
62
+ | 0.0382 | 1.9707 | 17577 | 0.0344 | 0.9883 |
63
+ | 0.0363 | 2.1897 | 19530 | 0.0339 | 0.9885 |
64
+ | 0.0356 | 2.4087 | 21483 | 0.0322 | 0.9890 |
65
+ | 0.0342 | 2.6276 | 23436 | 0.0310 | 0.9894 |
66
+ | 0.0334 | 2.8466 | 25389 | 0.0302 | 0.9895 |
67
+ | 0.032 | 3.0656 | 27342 | 0.0293 | 0.9899 |
68
 
69
 
70
  ### Framework versions
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:fa265aa22221b592347b5a0a127d91868ffc4354bc128e08be6b60c2cc56e261
3
  size 60925776
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:01cf7fd9400cc4115593a9aa0abdfc7ee3b2f767d21e3a3534ef8619dc9508c4
3
  size 60925776
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c6bd02ee5e06606f224916bc094a9670fbe8709198a2cfb9cf75d329d66bc0b9
3
  size 5905
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ff7e1dbae592dec8499b782e443b38fb589a584456d1004b726480d65db0ca36
3
  size 5905