Hugging Face's logo

fabikru
/
trainer

Fill-Mask
Transformers
Safetensors
modernbert
Generated from Trainer
Model card Files
xet
Community
fabikru commited on
Commit
3f105fc
·
verified ·
1 Parent(s): 284fd81

model_15M_medium_ds_masking_0.1_explicit_hs_predicted_hparamas

Browse files
Files changed (3) hide show
  1. README.md +13 -22
  2. model.safetensors +1 -1
  3. training_args.bin +1 -1
README.md CHANGED
@@ -16,8 +16,8 @@ should probably proofread and complete it, then remove this comment. -->
16
 
17
  This model is a fine-tuned version of [](https://huggingface.co/) on an unknown dataset.
18
  It achieves the following results on the evaluation set:
19
- - Loss: 0.2317
20
- - Accuracy: 0.9237
21
 
22
  ## Model description
23
 
@@ -50,26 +50,17 @@ The following hyperparameters were used during training:
50
 
51
  | Training Loss | Epoch | Step | Validation Loss | Accuracy |
52
  |:-------------:|:------:|:-----:|:---------------:|:--------:|
53
- | No log | 0 | 0 | 4.4632 | 0.0019 |
54
- | 0.4564 | 0.2190 | 1953 | 0.3973 | 0.8732 |
55
- | 0.3637 | 0.4379 | 3906 | 0.3450 | 0.8886 |
56
- | 0.3313 | 0.6569 | 5859 | 0.3169 | 0.8970 |
57
- | 0.3101 | 0.8759 | 7812 | 0.2993 | 0.9026 |
58
- | 0.3062 | 1.0949 | 9765 | 0.2885 | 0.9058 |
59
- | 0.2852 | 1.3138 | 11718 | 0.2776 | 0.9092 |
60
- | 0.2754 | 1.5328 | 13671 | 0.2703 | 0.9117 |
61
- | 0.2689 | 1.7518 | 15624 | 0.2626 | 0.9142 |
62
- | 0.2624 | 1.9707 | 17577 | 0.2566 | 0.9159 |
63
- | 0.2574 | 2.1897 | 19530 | 0.2533 | 0.9169 |
64
- | 0.2547 | 2.4087 | 21483 | 0.2478 | 0.9187 |
65
- | 0.2495 | 2.6276 | 23436 | 0.2434 | 0.9201 |
66
- | 0.2447 | 2.8466 | 25389 | 0.2395 | 0.9213 |
67
- | 0.2416 | 3.0656 | 27342 | 0.2350 | 0.9227 |
68
- | 0.2383 | 3.2846 | 29295 | 0.2331 | 0.9233 |
69
- | 0.2363 | 3.5035 | 31248 | 0.2321 | 0.9236 |
70
- | 0.0 | 3.7225 | 33201 | 0.2309 | 0.9240 |
71
- | 0.0 | 3.9415 | 35154 | 0.2320 | 0.9237 |
72
- | 0.0 | 4.1604 | 37107 | 0.2304 | 0.9241 |
73
 
74
 
75
  ### Framework versions
 
16
 
17
  This model is a fine-tuned version of [](https://huggingface.co/) on an unknown dataset.
18
  It achieves the following results on the evaluation set:
19
+ - Loss: 0.0991
20
+ - Accuracy: 0.9671
21
 
22
  ## Model description
23
 
 
50
 
51
  | Training Loss | Epoch | Step | Validation Loss | Accuracy |
52
  |:-------------:|:------:|:-----:|:---------------:|:--------:|
53
+ | No log | 0 | 0 | 4.3245 | 0.0017 |
54
+ | 0.1428 | 0.2190 | 1953 | 0.1174 | 0.9624 |
55
+ | 0.1232 | 0.4379 | 3906 | 0.1159 | 0.9627 |
56
+ | 0.1347 | 0.6569 | 5859 | 0.1160 | 0.9627 |
57
+ | 0.1233 | 0.8759 | 7812 | 0.1096 | 0.9641 |
58
+ | 0.1192 | 1.0949 | 9765 | 0.1093 | 0.9643 |
59
+ | 0.1113 | 1.3138 | 11718 | 0.1044 | 0.9657 |
60
+ | 0.1103 | 1.5328 | 13671 | 0.1010 | 0.9667 |
61
+ | 0.1059 | 1.7518 | 15624 | 0.0982 | 0.9676 |
62
+ | 0.0 | 1.9707 | 17577 | nan | 0.0 |
63
+ | 0.0 | 2.1897 | 19530 | nan | 0.0 |
 
 
 
 
 
 
 
 
 
64
 
65
 
66
  ### Framework versions
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:dcd833fc7ee5f7d40833d741dabd16a251eb928798344e8b76c9113827562a8a
3
  size 60925776
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fa265aa22221b592347b5a0a127d91868ffc4354bc128e08be6b60c2cc56e261
3
  size 60925776
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:3cc10ffd859f1450b05826ac813f49be0f0747e5248bcbc28c5728d5933007bf
3
  size 5905
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c6bd02ee5e06606f224916bc094a9670fbe8709198a2cfb9cf75d329d66bc0b9
3
  size 5905