Hugging Face's logo

fabikru
/
trainer

Fill-Mask
Transformers
Safetensors
modernbert
Generated from Trainer
Model card Files
xet
Community
fabikru commited on
Commit
f48d93e
·
verified ·
1 Parent(s): 69e0e69

model_15M_small_ds_masking_0.5_predicted_hparamas

Browse files
Files changed (3) hide show
  1. README.md +33 -33
  2. model.safetensors +1 -1
  3. training_args.bin +1 -1
README.md CHANGED
@@ -16,8 +16,8 @@ should probably proofread and complete it, then remove this comment. -->
16
 
17
  This model is a fine-tuned version of [](https://huggingface.co/) on an unknown dataset.
18
  It achieves the following results on the evaluation set:
19
- - Loss: 0.5508
20
- - Accuracy: 0.8118
21
 
22
  ## Model description
23
 
@@ -50,37 +50,37 @@ The following hyperparameters were used during training:
50
 
51
  | Training Loss | Epoch | Step | Validation Loss | Accuracy |
52
  |:-------------:|:-------:|:-----:|:---------------:|:--------:|
53
- | No log | 0 | 0 | 4.4528 | 0.0016 |
54
- | 0.8934 | 0.4302 | 1953 | 0.8072 | 0.7287 |
55
- | 0.7687 | 0.8604 | 3906 | 0.7341 | 0.7523 |
56
- | 0.7224 | 1.2905 | 5859 | 0.6983 | 0.7638 |
57
- | 0.6967 | 1.7207 | 7812 | 0.6746 | 0.7709 |
58
- | 0.6766 | 2.1509 | 9765 | 0.6597 | 0.7762 |
59
- | 0.6601 | 2.5811 | 11718 | 0.6466 | 0.7806 |
60
- | 0.6487 | 3.0112 | 13671 | 0.6323 | 0.7849 |
61
- | 0.6372 | 3.4414 | 15624 | 0.6253 | 0.7872 |
62
- | 0.6308 | 3.8716 | 17577 | 0.6167 | 0.7897 |
63
- | 0.6233 | 4.3018 | 19530 | 0.6119 | 0.7917 |
64
- | 0.6211 | 4.7319 | 21483 | 0.6069 | 0.7932 |
65
- | 0.6127 | 5.1621 | 23436 | 0.6013 | 0.7951 |
66
- | 0.6064 | 5.5923 | 25389 | 0.5973 | 0.7966 |
67
- | 0.6024 | 6.0225 | 27342 | 0.5919 | 0.7983 |
68
- | 0.5987 | 6.4526 | 29295 | 0.5873 | 0.8000 |
69
- | 0.5935 | 6.8828 | 31248 | 0.5854 | 0.8001 |
70
- | 0.5914 | 7.3130 | 33201 | 0.5815 | 0.8014 |
71
- | 0.5883 | 7.7432 | 35154 | 0.5760 | 0.8034 |
72
- | 0.5841 | 8.1733 | 37107 | 0.5732 | 0.8040 |
73
- | 0.5805 | 8.6035 | 39060 | 0.5724 | 0.8043 |
74
- | 0.5768 | 9.0337 | 41013 | 0.5682 | 0.8057 |
75
- | 0.5747 | 9.4639 | 42966 | 0.5637 | 0.8073 |
76
- | 0.5734 | 9.8941 | 44919 | 0.5617 | 0.8079 |
77
- | 0.5677 | 10.3242 | 46872 | 0.5632 | 0.8076 |
78
- | 0.5692 | 10.7544 | 48825 | 0.5596 | 0.8089 |
79
- | 0.5642 | 11.1846 | 50778 | 0.5556 | 0.8103 |
80
- | 0.5633 | 11.6148 | 52731 | 0.5555 | 0.8105 |
81
- | 0.5629 | 12.0449 | 54684 | 0.5512 | 0.8118 |
82
- | 0.5591 | 12.4751 | 56637 | 0.5548 | 0.8105 |
83
- | 0.5579 | 12.9053 | 58590 | 0.5534 | 0.8107 |
84
 
85
 
86
  ### Framework versions
 
16
 
17
  This model is a fine-tuned version of [](https://huggingface.co/) on an unknown dataset.
18
  It achieves the following results on the evaluation set:
19
+ - Loss: 0.3649
20
+ - Accuracy: 0.8733
21
 
22
  ## Model description
23
 
 
50
 
51
  | Training Loss | Epoch | Step | Validation Loss | Accuracy |
52
  |:-------------:|:-------:|:-----:|:---------------:|:--------:|
53
+ | No log | 0 | 0 | 4.4509 | 0.0072 |
54
+ | 0.7148 | 0.4302 | 1953 | 0.6216 | 0.7885 |
55
+ | 0.5807 | 0.8604 | 3906 | 0.5453 | 0.8131 |
56
+ | 0.5322 | 1.2905 | 5859 | 0.5084 | 0.8251 |
57
+ | 0.5068 | 1.7207 | 7812 | 0.4851 | 0.8328 |
58
+ | 0.4855 | 2.1509 | 9765 | 0.4710 | 0.8376 |
59
+ | 0.47 | 2.5811 | 11718 | 0.4552 | 0.8433 |
60
+ | 0.4589 | 3.0112 | 13671 | 0.4455 | 0.8459 |
61
+ | 0.4475 | 3.4414 | 15624 | 0.4383 | 0.8484 |
62
+ | 0.4401 | 3.8716 | 17577 | 0.4276 | 0.8515 |
63
+ | 0.4329 | 4.3018 | 19530 | 0.4218 | 0.8537 |
64
+ | 0.4299 | 4.7319 | 21483 | 0.4167 | 0.8557 |
65
+ | 0.423 | 5.1621 | 23436 | 0.4108 | 0.8568 |
66
+ | 0.4175 | 5.5923 | 25389 | 0.4081 | 0.8584 |
67
+ | 0.4122 | 6.0225 | 27342 | 0.4022 | 0.8607 |
68
+ | 0.4095 | 6.4526 | 29295 | 0.3966 | 0.8625 |
69
+ | 0.4034 | 6.8828 | 31248 | 0.3962 | 0.8623 |
70
+ | 0.4012 | 7.3130 | 33201 | 0.3926 | 0.8636 |
71
+ | 0.3984 | 7.7432 | 35154 | 0.3893 | 0.8650 |
72
+ | 0.395 | 8.1733 | 37107 | 0.3849 | 0.8663 |
73
+ | 0.3904 | 8.6035 | 39060 | 0.3827 | 0.8669 |
74
+ | 0.3873 | 9.0337 | 41013 | 0.3797 | 0.8680 |
75
+ | 0.3865 | 9.4639 | 42966 | 0.3775 | 0.8691 |
76
+ | 0.3839 | 9.8941 | 44919 | 0.3742 | 0.8696 |
77
+ | 0.3781 | 10.3242 | 46872 | 0.3757 | 0.8693 |
78
+ | 0.3806 | 10.7544 | 48825 | 0.3698 | 0.8713 |
79
+ | 0.376 | 11.1846 | 50778 | 0.3703 | 0.8712 |
80
+ | 0.3748 | 11.6148 | 52731 | 0.3672 | 0.8720 |
81
+ | 0.3743 | 12.0449 | 54684 | 0.3643 | 0.8733 |
82
+ | 0.3715 | 12.4751 | 56637 | 0.3662 | 0.8727 |
83
+ | 0.3695 | 12.9053 | 58590 | 0.3666 | 0.8724 |
84
 
85
 
86
  ### Framework versions
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:53d06bfc07b799ccf6d515f9bb3d1429212435d8f326a842d1bcad044e708e6f
3
  size 60925776
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fa8f0a3fb8aa1fb113188ec55e7fbe69b46e7eab0cb61755051222e9762bfa4c
3
  size 60925776
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:153bec54bbdca873dd67b71a240815555aa34c9b671116aa7d49e1072080bc03
3
  size 5905
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cc81299c0a6ea26b4af7dc8a6953ad6af75dfe1fa70e7d8cfa5a016c89291664
3
  size 5905