Hugging Face's logo

fabikru
/
trainer

Fill-Mask
Transformers
Safetensors
modernbert
Generated from Trainer
Model card Files
xet
Community
fabikru commited on
Commit
e5b6f90
·
verified ·
1 Parent(s): 056dd6a

model_5M_large_ds_masking_0.2_predicted_hparamas

Browse files
Files changed (3) hide show
  1. README.md +38 -39
  2. model.safetensors +1 -1
  3. training_args.bin +1 -1
README.md CHANGED
@@ -16,8 +16,8 @@ should probably proofread and complete it, then remove this comment. -->
16
 
17
  This model is a fine-tuned version of [](https://huggingface.co/) on an unknown dataset.
18
  It achieves the following results on the evaluation set:
19
- - Loss: 0.2523
20
- - Accuracy: 0.9142
21
 
22
  ## Model description
23
 
@@ -52,43 +52,42 @@ The following hyperparameters were used during training:
52
 
53
  | Training Loss | Epoch | Step | Validation Loss | Accuracy |
54
  |:-------------:|:------:|:----:|:---------------:|:--------:|
55
- | No log | 0 | 0 | 4.4578 | 0.0029 |
56
- | No log | 0.0044 | 122 | 1.0031 | 0.6944 |
57
- | No log | 0.0087 | 244 | 0.6903 | 0.7791 |
58
- | No log | 0.0131 | 366 | 0.5695 | 0.8139 |
59
- | No log | 0.0175 | 488 | 0.5445 | 0.8215 |
60
- | 8.1688 | 0.0218 | 610 | 0.5206 | 0.8292 |
61
- | 8.1688 | 0.0262 | 732 | 0.4568 | 0.8489 |
62
- | 8.1688 | 0.0306 | 854 | 0.4226 | 0.8600 |
63
- | 8.1688 | 0.0349 | 976 | 0.3945 | 0.8684 |
64
- | 4.0756 | 0.0393 | 1098 | 0.3686 | 0.8767 |
65
- | 4.0756 | 0.0437 | 1220 | 0.3483 | 0.8831 |
66
- | 4.0756 | 0.0480 | 1342 | 0.3363 | 0.8869 |
67
- | 4.0756 | 0.0524 | 1464 | 0.3249 | 0.8906 |
68
- | 2.945 | 0.0568 | 1586 | 0.3184 | 0.8928 |
69
- | 2.945 | 0.0611 | 1708 | 0.3092 | 0.8954 |
70
- | 2.945 | 0.0655 | 1830 | 0.3072 | 0.8962 |
71
- | 2.945 | 0.0699 | 1952 | 0.2999 | 0.8985 |
72
- | 2.5794 | 0.0743 | 2074 | 0.2950 | 0.9002 |
73
- | 2.5794 | 0.0786 | 2196 | 0.2924 | 0.9008 |
74
- | 2.5794 | 0.0830 | 2318 | 0.2876 | 0.9022 |
75
- | 2.5794 | 0.0874 | 2440 | 0.2836 | 0.9036 |
76
- | 2.4062 | 0.0917 | 2562 | 0.2790 | 0.9052 |
77
- | 2.4062 | 0.0961 | 2684 | 0.2764 | 0.9062 |
78
- | 2.4062 | 0.1005 | 2806 | 0.2759 | 0.9061 |
79
- | 2.4062 | 0.1048 | 2928 | 0.2735 | 0.9070 |
80
- | 2.3491 | 0.1092 | 3050 | 0.2710 | 0.9080 |
81
- | 2.3491 | 0.1136 | 3172 | 0.2669 | 0.9093 |
82
- | 2.3491 | 0.1179 | 3294 | 0.2656 | 0.9096 |
83
- | 2.3491 | 0.1223 | 3416 | 0.2644 | 0.9100 |
84
- | 2.2145 | 0.1267 | 3538 | 0.2615 | 0.9112 |
85
- | 2.2145 | 0.1310 | 3660 | 0.2603 | 0.9113 |
86
- | 2.2145 | 0.1354 | 3782 | 0.2563 | 0.9129 |
87
- | 2.2145 | 0.1398 | 3904 | 0.2553 | 0.9131 |
88
- | 2.1421 | 0.1441 | 4026 | 0.2527 | 0.9141 |
89
- | 2.1421 | 0.1485 | 4148 | 0.2503 | 0.9148 |
90
- | 2.1421 | 0.1529 | 4270 | 0.2516 | 0.9143 |
91
- | 2.1421 | 0.1572 | 4392 | 0.2515 | 0.9141 |
92
 
93
 
94
  ### Framework versions
 
16
 
17
  This model is a fine-tuned version of [](https://huggingface.co/) on an unknown dataset.
18
  It achieves the following results on the evaluation set:
19
+ - Loss: 0.1505
20
+ - Accuracy: 0.9476
21
 
22
  ## Model description
23
 
 
52
 
53
  | Training Loss | Epoch | Step | Validation Loss | Accuracy |
54
  |:-------------:|:------:|:----:|:---------------:|:--------:|
55
+ | No log | 0 | 0 | 4.4418 | 0.0139 |
56
+ | No log | 0.0044 | 122 | 0.7610 | 0.7639 |
57
+ | No log | 0.0087 | 244 | 0.4993 | 0.8385 |
58
+ | No log | 0.0131 | 366 | 0.3921 | 0.8712 |
59
+ | No log | 0.0175 | 488 | 0.3668 | 0.8783 |
60
+ | 6.5788 | 0.0218 | 610 | 0.3430 | 0.8860 |
61
+ | 6.5788 | 0.0262 | 732 | 0.3129 | 0.8956 |
62
+ | 6.5788 | 0.0306 | 854 | 0.2956 | 0.9016 |
63
+ | 6.5788 | 0.0349 | 976 | 0.2694 | 0.9090 |
64
+ | 2.8797 | 0.0393 | 1098 | 0.2481 | 0.9166 |
65
+ | 2.8797 | 0.0437 | 1220 | 0.2353 | 0.9206 |
66
+ | 2.8797 | 0.0480 | 1342 | 0.2224 | 0.9242 |
67
+ | 2.8797 | 0.0524 | 1464 | 0.2115 | 0.9281 |
68
+ | 1.9967 | 0.0568 | 1586 | 0.2092 | 0.9287 |
69
+ | 1.9967 | 0.0611 | 1708 | 0.1998 | 0.9312 |
70
+ | 1.9967 | 0.0655 | 1830 | 0.1976 | 0.9322 |
71
+ | 1.9967 | 0.0699 | 1952 | 0.1908 | 0.9346 |
72
+ | 1.6721 | 0.0743 | 2074 | 0.1862 | 0.9360 |
73
+ | 1.6721 | 0.0786 | 2196 | 0.1825 | 0.9370 |
74
+ | 1.6721 | 0.0830 | 2318 | 0.1812 | 0.9378 |
75
+ | 1.6721 | 0.0874 | 2440 | 0.1747 | 0.9398 |
76
+ | 1.5178 | 0.0917 | 2562 | 0.1755 | 0.9396 |
77
+ | 1.5178 | 0.0961 | 2684 | 0.1730 | 0.9404 |
78
+ | 1.5178 | 0.1005 | 2806 | 0.1719 | 0.9406 |
79
+ | 1.5178 | 0.1048 | 2928 | 0.1686 | 0.9416 |
80
+ | 1.4607 | 0.1092 | 3050 | 0.1682 | 0.9419 |
81
+ | 1.4607 | 0.1136 | 3172 | 0.1644 | 0.9431 |
82
+ | 1.4607 | 0.1179 | 3294 | 0.1640 | 0.9430 |
83
+ | 1.4607 | 0.1223 | 3416 | 0.1613 | 0.9442 |
84
+ | 1.3879 | 0.1267 | 3538 | 0.1615 | 0.9441 |
85
+ | 1.3879 | 0.1310 | 3660 | 0.1593 | 0.9448 |
86
+ | 1.3879 | 0.1354 | 3782 | 0.1551 | 0.9460 |
87
+ | 1.3879 | 0.1398 | 3904 | 0.1555 | 0.9464 |
88
+ | 1.3075 | 0.1441 | 4026 | 0.1519 | 0.9476 |
89
+ | 1.3075 | 0.1485 | 4148 | 0.1515 | 0.9475 |
90
+ | 1.3075 | 0.1529 | 4270 | 0.1505 | 0.9477 |
 
91
 
92
 
93
  ### Framework versions
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:9db8d5b41a2151b5c2bd62514c305b449eb96ed6fed1c33eb38ac5c1fab8a48b
3
  size 18195880
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:802c070ef8f72ad2b541e367123a06d4f807d87b80e70e73c76b77c44ffab8f4
3
  size 18195880
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ebdac9aced14dee41c7a014115093947be8f4cde7c874511e3c7acd2deeb9e4a
3
  size 5905
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9243e47382667938593c8e5309aaee41f9dd1b236f8168472703bdad9c27ad86
3
  size 5905