trungpq commited on
Commit
888f916
·
verified ·
1 Parent(s): 7e858b4

End of training

Browse files
Files changed (4) hide show
  1. README.md +68 -0
  2. config.json +26 -0
  3. model.safetensors +3 -0
  4. training_args.bin +3 -0
README.md ADDED
@@ -0,0 +1,68 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: transformers
3
+ tags:
4
+ - generated_from_trainer
5
+ metrics:
6
+ - accuracy
7
+ model-index:
8
+ - name: slac-single-head
9
+ results: []
10
+ ---
11
+
12
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
13
+ should probably proofread and complete it, then remove this comment. -->
14
+
15
+ # slac-single-head
16
+
17
+ This model is a fine-tuned version of [](https://huggingface.co/) on an unknown dataset.
18
+ It achieves the following results on the evaluation set:
19
+ - Loss: 0.2427
20
+ - Accuracy: 0.9493
21
+ - F1 Macro: 0.9026
22
+ - Precision Macro: 0.8893
23
+ - Recall Macro: 0.9182
24
+ - Total Tf: [938, 215, 5145, 110]
25
+
26
+ ## Model description
27
+
28
+ More information needed
29
+
30
+ ## Intended uses & limitations
31
+
32
+ More information needed
33
+
34
+ ## Training and evaluation data
35
+
36
+ More information needed
37
+
38
+ ## Training procedure
39
+
40
+ ### Training hyperparameters
41
+
42
+ The following hyperparameters were used during training:
43
+ - learning_rate: 2e-05
44
+ - train_batch_size: 32
45
+ - eval_batch_size: 32
46
+ - seed: 42
47
+ - optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
48
+ - lr_scheduler_type: linear
49
+ - lr_scheduler_warmup_steps: 424
50
+ - num_epochs: 5
51
+
52
+ ### Training results
53
+
54
+ | Training Loss | Epoch | Step | Validation Loss | Accuracy | F1 Macro | Precision Macro | Recall Macro | Total Tf |
55
+ |:-------------:|:-----:|:----:|:---------------:|:--------:|:--------:|:---------------:|:------------:|:---------------------:|
56
+ | 0.3241 | 1.0 | 425 | 0.3027 | 0.9203 | 0.8632 | 0.8415 | 0.9114 | [961, 424, 4936, 87] |
57
+ | 0.267 | 2.0 | 850 | 0.2239 | 0.9494 | 0.9047 | 0.8951 | 0.9214 | [956, 232, 5128, 92] |
58
+ | 0.1973 | 3.0 | 1275 | 0.2265 | 0.9521 | 0.9061 | 0.8995 | 0.9140 | [932, 191, 5169, 116] |
59
+ | 0.1418 | 4.0 | 1700 | 0.2320 | 0.9476 | 0.9018 | 0.8855 | 0.9219 | [953, 241, 5119, 95] |
60
+ | 0.1222 | 5.0 | 2125 | 0.2427 | 0.9493 | 0.9026 | 0.8893 | 0.9182 | [938, 215, 5145, 110] |
61
+
62
+
63
+ ### Framework versions
64
+
65
+ - Transformers 4.51.1
66
+ - Pytorch 2.8.0.dev20250515+cu128
67
+ - Datasets 3.5.0
68
+ - Tokenizers 0.21.1
config.json ADDED
@@ -0,0 +1,26 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "architectures": [
3
+ "BERTModel"
4
+ ],
5
+ "id2label": {
6
+ "0": "LABEL_0",
7
+ "1": "LABEL_1",
8
+ "2": "LABEL_2",
9
+ "3": "LABEL_3"
10
+ },
11
+ "label2id": {
12
+ "LABEL_0": 0,
13
+ "LABEL_1": 1,
14
+ "LABEL_2": 2,
15
+ "LABEL_3": 3
16
+ },
17
+ "model_type": "bert_model_multi_label",
18
+ "pos_weight": [
19
+ 3.0,
20
+ 3.0,
21
+ 3.0,
22
+ 2.8530913216108904
23
+ ],
24
+ "torch_dtype": "float32",
25
+ "transformers_version": "4.51.1"
26
+ }
model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6490c6c13481a256fc319a82977d74f41c362f3ee11274c1c9c9b842e4ed4d9b
3
+ size 437964888
training_args.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c717db64ae436ced081768fda7a708d11b1b4f99f0ae689af74ff4f75c03651b
3
+ size 5777