Hugging Face's logo

kasparas12
/
modernbert_web3_classification

Text Classification
Transformers
Safetensors
modernbert
Generated from Trainer
text-embeddings-inference
Model card Files
xet
Community
kasparas12 commited on
Commit
b332823
·
verified ·
1 Parent(s): b90495e

ModernBERT fine-tuning complete

Browse files
Files changed (3) hide show
  1. README.md +15 -16
  2. model.safetensors +1 -1
  3. training_args.bin +1 -1
README.md CHANGED
@@ -1,27 +1,27 @@
1
  ---
2
  library_name: transformers
3
  license: apache-2.0
4
- base_model: answerdotai/ModernBERT-base
5
  tags:
6
  - generated_from_trainer
7
  metrics:
8
  - accuracy
9
  - f1
10
  model-index:
11
- - name: modernbert-web3-classification
12
  results: []
13
  ---
14
 
15
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
16
  should probably proofread and complete it, then remove this comment. -->
17
 
18
- # modernbert-web3-classification
19
 
20
- This model is a fine-tuned version of [answerdotai/ModernBERT-base](https://huggingface.co/answerdotai/ModernBERT-base) on the None dataset.
21
  It achieves the following results on the evaluation set:
22
- - Loss: 2.2032
23
- - Accuracy: 0.7110
24
- - F1: 0.6925
25
 
26
  ## Model description
27
 
@@ -54,15 +54,14 @@ The following hyperparameters were used during training:
54
 
55
  | Training Loss | Epoch | Step | Validation Loss | Accuracy | F1 |
56
  |:-------------:|:-----:|:----:|:---------------:|:--------:|:------:|
57
- | 3.3409 | 1.0 | 681 | 1.3014 | 0.5764 | 0.5315 |
58
- | 2.4615 | 2.0 | 1362 | 1.1848 | 0.6244 | 0.5946 |
59
- | 1.2474 | 3.0 | 2043 | 1.1272 | 0.7007 | 0.6732 |
60
- | 0.4366 | 4.0 | 2724 | 1.3125 | 0.7129 | 0.6896 |
61
- | 0.2036 | 5.0 | 3405 | 1.4978 | 0.7158 | 0.6990 |
62
- | 0.027 | 6.0 | 4086 | 1.7242 | 0.7116 | 0.6997 |
63
- | 0.0179 | 7.0 | 4767 | 1.8611 | 0.7269 | 0.7133 |
64
- | 0.0155 | 8.0 | 5448 | 2.1055 | 0.7031 | 0.6825 |
65
- | 0.0093 | 9.0 | 6129 | 2.2032 | 0.7110 | 0.6925 |
66
 
67
 
68
  ### Framework versions
 
1
  ---
2
  library_name: transformers
3
  license: apache-2.0
4
+ base_model: answerdotai/modernbert-base
5
  tags:
6
  - generated_from_trainer
7
  metrics:
8
  - accuracy
9
  - f1
10
  model-index:
11
+ - name: modernbert_web3_classification
12
  results: []
13
  ---
14
 
15
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
16
  should probably proofread and complete it, then remove this comment. -->
17
 
18
+ # modernbert_web3_classification
19
 
20
+ This model is a fine-tuned version of [answerdotai/modernbert-base](https://huggingface.co/answerdotai/modernbert-base) on the None dataset.
21
  It achieves the following results on the evaluation set:
22
+ - Loss: 1.9429
23
+ - Accuracy: 0.6923
24
+ - F1: 0.6711
25
 
26
  ## Model description
27
 
 
54
 
55
  | Training Loss | Epoch | Step | Validation Loss | Accuracy | F1 |
56
  |:-------------:|:-----:|:----:|:---------------:|:--------:|:------:|
57
+ | 3.2458 | 1.0 | 643 | 1.4201 | 0.5509 | 0.5134 |
58
+ | 2.5825 | 2.0 | 1286 | 1.3174 | 0.5828 | 0.5521 |
59
+ | 2.0999 | 3.0 | 1929 | 1.3183 | 0.6240 | 0.6020 |
60
+ | 0.7625 | 4.0 | 2572 | 1.3098 | 0.6816 | 0.6592 |
61
+ | 0.333 | 5.0 | 3215 | 1.4979 | 0.6760 | 0.6509 |
62
+ | 0.1715 | 6.0 | 3858 | 1.5728 | 0.6915 | 0.6769 |
63
+ | 0.0617 | 7.0 | 4501 | 1.7623 | 0.6906 | 0.6713 |
64
+ | 0.041 | 8.0 | 5144 | 1.9429 | 0.6923 | 0.6711 |
 
65
 
66
 
67
  ### Framework versions
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:7fbd0c6975c425a728490a580973747504cc9fac860057e134fc9934fe5127ae
3
  size 598516692
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:784af366e6f56b79b3f46d16c6a58637881a08d5e6742927a1d438493b7f0869
3
  size 598516692
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:3845c05056871b3cdf085eb3e0ce588e5e789fab7e73d778f56f009926694063
3
  size 5368
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7d39ea66a69a568fa5cbe38fe4f13b57a393f15d6489f2a87e0e623d53a51c98
3
  size 5368