Hugging Face's logo

Jasoncpit
/
Roberta_finetuned_PMV

Text Classification
Transformers
TensorBoard
Safetensors
roberta
Generated from Trainer
Model card Files
xet
 Metrics Community
Jasoncpit commited on
Commit
9445670
·
1 Parent(s): 0b4ae2b

End of training

Browse files
Files changed (10) hide show
  1. README.md +112 -0
  2. config.json +38 -0
  3. model.safetensors +3 -0
  4. runs/Dec13_09-56-57_d583c148c8b9/events.out.tfevents.1702461423.d583c148c8b9.47.0 +3 -0
  5. runs/Dec13_09-56-57_d583c148c8b9/events.out.tfevents.1702461554.d583c148c8b9.47.1 +3 -0
  6. runs/Dec13_10-02-02_d583c148c8b9/events.out.tfevents.1702461722.d583c148c8b9.47.2 +3 -0
  7. runs/Dec13_10-02-02_d583c148c8b9/events.out.tfevents.1702462032.d583c148c8b9.47.3 +3 -0
  8. runs/Dec13_10-07-45_d583c148c8b9/events.out.tfevents.1702462065.d583c148c8b9.47.4 +3 -0
  9. runs/Dec13_10-07-45_d583c148c8b9/events.out.tfevents.1702462790.d583c148c8b9.47.5 +3 -0
  10. training_args.bin +3 -0
README.md ADDED
@@ -0,0 +1,112 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ base_model: roberta-base
4
+ tags:
5
+ - generated_from_trainer
6
+ metrics:
7
+ - accuracy
8
+ - f1
9
+ model-index:
10
+ - name: results
11
+ results: []
12
+ ---
13
+
14
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
15
+ should probably proofread and complete it, then remove this comment. -->
16
+
17
+ # results
18
+
19
+ This model is a fine-tuned version of [roberta-base](https://huggingface.co/roberta-base) on an unknown dataset.
20
+ It achieves the following results on the evaluation set:
21
+ - Loss: 2.8299
22
+ - Accuracy: 0.6038
23
+ - F1: 0.5980
24
+
25
+ ## Model description
26
+
27
+ More information needed
28
+
29
+ ## Intended uses & limitations
30
+
31
+ More information needed
32
+
33
+ ## Training and evaluation data
34
+
35
+ More information needed
36
+
37
+ ## Training procedure
38
+
39
+ ### Training hyperparameters
40
+
41
+ The following hyperparameters were used during training:
42
+ - learning_rate: 2e-05
43
+ - train_batch_size: 32
44
+ - eval_batch_size: 32
45
+ - seed: 42
46
+ - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
47
+ - lr_scheduler_type: linear
48
+ - lr_scheduler_warmup_ratio: 0.1
49
+ - num_epochs: 50
50
+
51
+ ### Training results
52
+
53
+ | Training Loss | Epoch | Step | Validation Loss | Accuracy | F1 |
54
+ |:-------------:|:-----:|:----:|:---------------:|:--------:|:------:|
55
+ | No log | 1.0 | 24 | 1.1029 | 0.1772 | 0.0627 |
56
+ | No log | 2.0 | 48 | 1.0290 | 0.5063 | 0.3404 |
57
+ | No log | 3.0 | 72 | 0.9006 | 0.5949 | 0.5268 |
58
+ | No log | 4.0 | 96 | 0.8745 | 0.6013 | 0.6014 |
59
+ | No log | 5.0 | 120 | 0.8370 | 0.5696 | 0.5730 |
60
+ | No log | 6.0 | 144 | 0.8020 | 0.6709 | 0.6623 |
61
+ | No log | 7.0 | 168 | 0.8105 | 0.6835 | 0.6759 |
62
+ | No log | 8.0 | 192 | 0.9875 | 0.6329 | 0.6251 |
63
+ | No log | 9.0 | 216 | 1.1282 | 0.6266 | 0.6317 |
64
+ | No log | 10.0 | 240 | 1.2444 | 0.5949 | 0.5950 |
65
+ | No log | 11.0 | 264 | 1.1916 | 0.6456 | 0.6394 |
66
+ | No log | 12.0 | 288 | 1.5230 | 0.5886 | 0.5905 |
67
+ | No log | 13.0 | 312 | 1.4544 | 0.6456 | 0.6381 |
68
+ | No log | 14.0 | 336 | 1.6109 | 0.6076 | 0.6093 |
69
+ | No log | 15.0 | 360 | 1.6181 | 0.6203 | 0.6213 |
70
+ | No log | 16.0 | 384 | 1.6836 | 0.6392 | 0.6382 |
71
+ | No log | 17.0 | 408 | 1.7056 | 0.6709 | 0.6648 |
72
+ | No log | 18.0 | 432 | 1.9027 | 0.5949 | 0.5968 |
73
+ | No log | 19.0 | 456 | 1.7156 | 0.6835 | 0.6695 |
74
+ | No log | 20.0 | 480 | 1.8976 | 0.6392 | 0.6376 |
75
+ | 0.3619 | 21.0 | 504 | 1.8731 | 0.6139 | 0.6172 |
76
+ | 0.3619 | 22.0 | 528 | 1.8723 | 0.6709 | 0.6570 |
77
+ | 0.3619 | 23.0 | 552 | 2.1482 | 0.5886 | 0.5921 |
78
+ | 0.3619 | 24.0 | 576 | 1.8633 | 0.6203 | 0.6198 |
79
+ | 0.3619 | 25.0 | 600 | 1.7921 | 0.6392 | 0.6373 |
80
+ | 0.3619 | 26.0 | 624 | 1.8867 | 0.6203 | 0.6229 |
81
+ | 0.3619 | 27.0 | 648 | 1.8571 | 0.6646 | 0.6535 |
82
+ | 0.3619 | 28.0 | 672 | 1.9876 | 0.6266 | 0.6295 |
83
+ | 0.3619 | 29.0 | 696 | 1.8853 | 0.6519 | 0.6452 |
84
+ | 0.3619 | 30.0 | 720 | 2.0321 | 0.6266 | 0.6315 |
85
+ | 0.3619 | 31.0 | 744 | 1.8590 | 0.6646 | 0.6553 |
86
+ | 0.3619 | 32.0 | 768 | 2.2514 | 0.6266 | 0.6297 |
87
+ | 0.3619 | 33.0 | 792 | 1.8813 | 0.6646 | 0.6647 |
88
+ | 0.3619 | 34.0 | 816 | 2.1837 | 0.6139 | 0.6158 |
89
+ | 0.3619 | 35.0 | 840 | 1.8851 | 0.6709 | 0.6682 |
90
+ | 0.3619 | 36.0 | 864 | 2.0150 | 0.6329 | 0.6346 |
91
+ | 0.3619 | 37.0 | 888 | 1.9542 | 0.6709 | 0.6703 |
92
+ | 0.3619 | 38.0 | 912 | 2.0234 | 0.6582 | 0.6551 |
93
+ | 0.3619 | 39.0 | 936 | 2.1399 | 0.6329 | 0.6350 |
94
+ | 0.3619 | 40.0 | 960 | 2.1121 | 0.6329 | 0.6357 |
95
+ | 0.3619 | 41.0 | 984 | 2.0931 | 0.6266 | 0.6291 |
96
+ | 0.0321 | 42.0 | 1008 | 1.9945 | 0.6772 | 0.6757 |
97
+ | 0.0321 | 43.0 | 1032 | 2.0745 | 0.6646 | 0.6652 |
98
+ | 0.0321 | 44.0 | 1056 | 2.0226 | 0.6835 | 0.6795 |
99
+ | 0.0321 | 45.0 | 1080 | 2.1174 | 0.6582 | 0.6589 |
100
+ | 0.0321 | 46.0 | 1104 | 2.1243 | 0.6456 | 0.6467 |
101
+ | 0.0321 | 47.0 | 1128 | 2.1506 | 0.6203 | 0.6226 |
102
+ | 0.0321 | 48.0 | 1152 | 2.1542 | 0.6329 | 0.6350 |
103
+ | 0.0321 | 49.0 | 1176 | 2.1295 | 0.6582 | 0.6580 |
104
+ | 0.0321 | 50.0 | 1200 | 2.1290 | 0.6582 | 0.6580 |
105
+
106
+
107
+ ### Framework versions
108
+
109
+ - Transformers 4.35.0
110
+ - Pytorch 2.0.0
111
+ - Datasets 2.1.0
112
+ - Tokenizers 0.14.1
config.json ADDED
@@ -0,0 +1,38 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "_name_or_path": "roberta-base",
3
+ "architectures": [
4
+ "RobertaForSequenceClassification"
5
+ ],
6
+ "attention_probs_dropout_prob": 0.1,
7
+ "bos_token_id": 0,
8
+ "classifier_dropout": null,
9
+ "eos_token_id": 2,
10
+ "hidden_act": "gelu",
11
+ "hidden_dropout_prob": 0.1,
12
+ "hidden_size": 768,
13
+ "id2label": {
14
+ "0": "LABEL_0",
15
+ "1": "LABEL_1",
16
+ "2": "LABEL_2"
17
+ },
18
+ "initializer_range": 0.02,
19
+ "intermediate_size": 3072,
20
+ "label2id": {
21
+ "LABEL_0": 0,
22
+ "LABEL_1": 1,
23
+ "LABEL_2": 2
24
+ },
25
+ "layer_norm_eps": 1e-05,
26
+ "max_position_embeddings": 514,
27
+ "model_type": "roberta",
28
+ "num_attention_heads": 12,
29
+ "num_hidden_layers": 12,
30
+ "pad_token_id": 1,
31
+ "position_embedding_type": "absolute",
32
+ "problem_type": "single_label_classification",
33
+ "torch_dtype": "float32",
34
+ "transformers_version": "4.35.0",
35
+ "type_vocab_size": 1,
36
+ "use_cache": true,
37
+ "vocab_size": 50265
38
+ }
model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6fba8c3bc6f01049257442b43cb854d83320e158ad9d2957e0f7046f939b5ecf
3
+ size 498615900
runs/Dec13_09-56-57_d583c148c8b9/events.out.tfevents.1702461423.d583c148c8b9.47.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fd8cf15c430e82ecee2ac083f62fbdb3cdafabb6d47c2a368b4838b21e9a32e4
3
+ size 6057
runs/Dec13_09-56-57_d583c148c8b9/events.out.tfevents.1702461554.d583c148c8b9.47.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ce2de45143a476fdde97b3fd9c715353242e06ccf1f6516705dbfb3c24222288
3
+ size 359
runs/Dec13_10-02-02_d583c148c8b9/events.out.tfevents.1702461722.d583c148c8b9.47.2 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d935a093761652ec277576e7d2eeaf69c09cad44bb3db7a6e75332a1736c1851
3
+ size 6543
runs/Dec13_10-02-02_d583c148c8b9/events.out.tfevents.1702462032.d583c148c8b9.47.3 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:51f10a327129bb9d6096bf6dc00aa6dde3b9503dc59633a1623ab8ce1da85371
3
+ size 457
runs/Dec13_10-07-45_d583c148c8b9/events.out.tfevents.1702462065.d583c148c8b9.47.4 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:43d767c2e6e82425a4f2d7a058890f54c85cc5fb93477aa0767f35adff349fd7
3
+ size 23442
runs/Dec13_10-07-45_d583c148c8b9/events.out.tfevents.1702462790.d583c148c8b9.47.5 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6ea261c07ca10c85cdbeecd3838a23c308c5b90be6fe12b441c352d6807303f9
3
+ size 457
training_args.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8824ced956afa88d13e59a9dba306f4913ae09c1c31a714a3ea167f6bc9c8108
3
+ size 4091