Hugging Face's logo

yemen2016
/
MeMo_BERT-SA_3

Text Classification
Transformers
TensorBoard
Safetensors
xlm-roberta
Generated from Trainer
text-embeddings-inference
Model card Files
xet
 Metrics Community
yemen2016 commited on
Commit
e28385e
·
verified ·
1 Parent(s): aff09d1

End of training

Browse files
Files changed (3) hide show
  1. README.md +25 -25
  2. model.safetensors +1 -1
  3. runs/Mar15_13-46-07_460c4293bb46/events.out.tfevents.1710512109.460c4293bb46.1677.15 +3 -0
README.md CHANGED
@@ -3,19 +3,19 @@ base_model: MiMe-MeMo/MeMo-BERT-03
3
  tags:
4
  - generated_from_trainer
5
  model-index:
6
- - name: MeMo_BERT-SA_1
7
  results: []
8
  ---
9
 
10
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
11
  should probably proofread and complete it, then remove this comment. -->
12
 
13
- # MeMo_BERT-SA_1
14
 
15
  This model is a fine-tuned version of [MiMe-MeMo/MeMo-BERT-03](https://huggingface.co/MiMe-MeMo/MeMo-BERT-03) on an unknown dataset.
16
  It achieves the following results on the evaluation set:
17
- - Loss: 1.5662
18
- - F1-score: 0.8017
19
 
20
  ## Model description
21
 
@@ -46,31 +46,31 @@ The following hyperparameters were used during training:
46
 
47
  | Training Loss | Epoch | Step | Validation Loss | F1-score |
48
  |:-------------:|:-----:|:----:|:---------------:|:--------:|
49
- | No log | 1.0 | 265 | 0.5706 | 0.7827 |
50
- | 0.5825 | 2.0 | 530 | 0.8631 | 0.7744 |
51
- | 0.5825 | 3.0 | 795 | 1.0419 | 0.7907 |
52
- | 0.1991 | 4.0 | 1060 | 1.3002 | 0.7725 |
53
- | 0.1991 | 5.0 | 1325 | 1.5787 | 0.7788 |
54
- | 0.0536 | 6.0 | 1590 | 1.5427 | 0.8003 |
55
- | 0.0536 | 7.0 | 1855 | 1.5662 | 0.8017 |
56
- | 0.019 | 8.0 | 2120 | 1.7630 | 0.7897 |
57
- | 0.019 | 9.0 | 2385 | 1.8299 | 0.7905 |
58
- | 0.0051 | 10.0 | 2650 | 1.8772 | 0.7923 |
59
- | 0.0051 | 11.0 | 2915 | 1.9660 | 0.7905 |
60
- | 0.0027 | 12.0 | 3180 | 1.9737 | 0.7834 |
61
- | 0.0027 | 13.0 | 3445 | 1.9549 | 0.7826 |
62
- | 0.004 | 14.0 | 3710 | 2.0167 | 0.7841 |
63
- | 0.004 | 15.0 | 3975 | 2.1416 | 0.7827 |
64
- | 0.0003 | 16.0 | 4240 | 2.1687 | 0.7802 |
65
- | 0.0074 | 17.0 | 4505 | 2.0357 | 0.7853 |
66
- | 0.0074 | 18.0 | 4770 | 2.1567 | 0.7806 |
67
- | 0.0002 | 19.0 | 5035 | 2.1614 | 0.7808 |
68
- | 0.0002 | 20.0 | 5300 | 2.0856 | 0.7789 |
69
 
70
 
71
  ### Framework versions
72
 
73
  - Transformers 4.38.2
74
- - Pytorch 2.1.0+cu121
75
  - Datasets 2.18.0
76
  - Tokenizers 0.15.2
 
3
  tags:
4
  - generated_from_trainer
5
  model-index:
6
+ - name: MeMo_BERT-SA_3
7
  results: []
8
  ---
9
 
10
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
11
  should probably proofread and complete it, then remove this comment. -->
12
 
13
+ # MeMo_BERT-SA_3
14
 
15
  This model is a fine-tuned version of [MiMe-MeMo/MeMo-BERT-03](https://huggingface.co/MiMe-MeMo/MeMo-BERT-03) on an unknown dataset.
16
  It achieves the following results on the evaluation set:
17
+ - Loss: 1.4776
18
+ - F1-score: 0.7659
19
 
20
  ## Model description
21
 
 
46
 
47
  | Training Loss | Epoch | Step | Validation Loss | F1-score |
48
  |:-------------:|:-----:|:----:|:---------------:|:--------:|
49
+ | No log | 1.0 | 297 | 0.7872 | 0.7116 |
50
+ | 0.5803 | 2.0 | 594 | 0.9097 | 0.7575 |
51
+ | 0.5803 | 3.0 | 891 | 1.2182 | 0.7518 |
52
+ | 0.2342 | 4.0 | 1188 | 1.3653 | 0.7618 |
53
+ | 0.2342 | 5.0 | 1485 | 1.4776 | 0.7659 |
54
+ | 0.0843 | 6.0 | 1782 | 1.7107 | 0.7535 |
55
+ | 0.0179 | 7.0 | 2079 | 1.7869 | 0.7655 |
56
+ | 0.0179 | 8.0 | 2376 | 1.9367 | 0.7422 |
57
+ | 0.0106 | 9.0 | 2673 | 2.2548 | 0.7404 |
58
+ | 0.0106 | 10.0 | 2970 | 1.9947 | 0.7636 |
59
+ | 0.0078 | 11.0 | 3267 | 2.2236 | 0.7555 |
60
+ | 0.0013 | 12.0 | 3564 | 2.1156 | 0.7573 |
61
+ | 0.0013 | 13.0 | 3861 | 2.2286 | 0.7413 |
62
+ | 0.0039 | 14.0 | 4158 | 2.2651 | 0.7411 |
63
+ | 0.0039 | 15.0 | 4455 | 2.3064 | 0.7411 |
64
+ | 0.0 | 16.0 | 4752 | 2.2598 | 0.7500 |
65
+ | 0.0004 | 17.0 | 5049 | 2.1443 | 0.7529 |
66
+ | 0.0004 | 18.0 | 5346 | 2.1092 | 0.7637 |
67
+ | 0.0021 | 19.0 | 5643 | 2.3133 | 0.7619 |
68
+ | 0.0021 | 20.0 | 5940 | 2.2768 | 0.7656 |
69
 
70
 
71
  ### Framework versions
72
 
73
  - Transformers 4.38.2
74
+ - Pytorch 2.2.1+cu121
75
  - Datasets 2.18.0
76
  - Tokenizers 0.15.2
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:912a0f86222924a61f4707b853ec69c231e17efdc09d1e5124ed13ec3604c44e
3
  size 497817180
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:17a8078275b6f5e21051dd9439f2853280de6aefdee20765288a85c26bfa4394
3
  size 497817180
runs/Mar15_13-46-07_460c4293bb46/events.out.tfevents.1710512109.460c4293bb46.1677.15 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a79b6ff3033efd061771b086de622e0af8d636a0fdd0af8c728e1428288137ad
3
+ size 411