TakalaWang commited on
Commit
cddd309
·
verified ·
1 Parent(s): f6526b4

Model save

Browse files
Files changed (5) hide show
  1. README.md +89 -0
  2. model.safetensors +1 -1
  3. special_tokens_map.json +7 -0
  4. tokenizer_config.json +58 -0
  5. vocab.txt +0 -0
README.md ADDED
@@ -0,0 +1,89 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: transformers
3
+ license: apache-2.0
4
+ base_model: bert-base-uncased
5
+ tags:
6
+ - generated_from_trainer
7
+ metrics:
8
+ - accuracy
9
+ model-index:
10
+ - name: bert-finetuned-balanced
11
+ results: []
12
+ ---
13
+
14
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
15
+ should probably proofread and complete it, then remove this comment. -->
16
+
17
+ # bert-finetuned-balanced
18
+
19
+ This model is a fine-tuned version of [bert-base-uncased](https://huggingface.co/bert-base-uncased) on an unknown dataset.
20
+ It achieves the following results on the evaluation set:
21
+ - Loss: 0.8651
22
+ - Accuracy: 0.6333
23
+
24
+ ## Model description
25
+
26
+ More information needed
27
+
28
+ ## Intended uses & limitations
29
+
30
+ More information needed
31
+
32
+ ## Training and evaluation data
33
+
34
+ More information needed
35
+
36
+ ## Training procedure
37
+
38
+ ### Training hyperparameters
39
+
40
+ The following hyperparameters were used during training:
41
+ - learning_rate: 1e-05
42
+ - train_batch_size: 4
43
+ - eval_batch_size: 4
44
+ - seed: 42
45
+ - optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
46
+ - lr_scheduler_type: linear
47
+ - num_epochs: 5
48
+
49
+ ### Training results
50
+
51
+ | Training Loss | Epoch | Step | Validation Loss | Accuracy |
52
+ |:-------------:|:------:|:----:|:---------------:|:--------:|
53
+ | 1.0534 | 0.1676 | 30 | 0.9162 | 0.5778 |
54
+ | 0.821 | 0.3352 | 60 | 0.8341 | 0.5667 |
55
+ | 0.8791 | 0.5028 | 90 | 0.7851 | 0.5667 |
56
+ | 0.8847 | 0.6704 | 120 | 0.7736 | 0.6667 |
57
+ | 0.8273 | 0.8380 | 150 | 0.7690 | 0.6556 |
58
+ | 0.7989 | 1.0056 | 180 | 0.7653 | 0.6111 |
59
+ | 0.7231 | 1.1732 | 210 | 0.8225 | 0.6667 |
60
+ | 0.7673 | 1.3408 | 240 | 0.7698 | 0.6111 |
61
+ | 0.709 | 1.5084 | 270 | 0.8806 | 0.6 |
62
+ | 0.7077 | 1.6760 | 300 | 0.7960 | 0.6 |
63
+ | 0.6683 | 1.8436 | 330 | 0.8490 | 0.6556 |
64
+ | 0.8022 | 2.0112 | 360 | 0.7545 | 0.6222 |
65
+ | 0.5894 | 2.1788 | 390 | 0.7770 | 0.6222 |
66
+ | 0.6824 | 2.3464 | 420 | 0.7857 | 0.6111 |
67
+ | 0.6207 | 2.5140 | 450 | 0.8809 | 0.6444 |
68
+ | 0.5354 | 2.6816 | 480 | 0.8210 | 0.6667 |
69
+ | 0.5477 | 2.8492 | 510 | 0.8469 | 0.5667 |
70
+ | 0.7838 | 3.0168 | 540 | 0.8597 | 0.6778 |
71
+ | 0.4587 | 3.1844 | 570 | 0.8234 | 0.6667 |
72
+ | 0.413 | 3.3520 | 600 | 0.8538 | 0.6667 |
73
+ | 0.5733 | 3.5196 | 630 | 0.8568 | 0.6556 |
74
+ | 0.5397 | 3.6872 | 660 | 0.8436 | 0.6333 |
75
+ | 0.4786 | 3.8547 | 690 | 0.8106 | 0.6222 |
76
+ | 0.4804 | 4.0223 | 720 | 0.8356 | 0.6222 |
77
+ | 0.4861 | 4.1899 | 750 | 0.8465 | 0.6111 |
78
+ | 0.4289 | 4.3575 | 780 | 0.8480 | 0.6222 |
79
+ | 0.2878 | 4.5251 | 810 | 0.8485 | 0.6333 |
80
+ | 0.3368 | 4.6927 | 840 | 0.8653 | 0.6333 |
81
+ | 0.4615 | 4.8603 | 870 | 0.8651 | 0.6333 |
82
+
83
+
84
+ ### Framework versions
85
+
86
+ - Transformers 4.51.3
87
+ - Pytorch 2.7.0+cu128
88
+ - Datasets 3.5.1
89
+ - Tokenizers 0.21.1
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:a1272fd4e702f8edf3d50b6a583243ee18a33c4bd4e5b35303b2866568b4fb10
3
  size 437964800
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f1e7cb8da053f52a11fbd6d8f2d22acf798190d81055971aadbd5b9f6683250c
3
  size 437964800
special_tokens_map.json ADDED
@@ -0,0 +1,7 @@
 
 
 
 
 
 
 
 
1
+ {
2
+ "cls_token": "[CLS]",
3
+ "mask_token": "[MASK]",
4
+ "pad_token": "[PAD]",
5
+ "sep_token": "[SEP]",
6
+ "unk_token": "[UNK]"
7
+ }
tokenizer_config.json ADDED
@@ -0,0 +1,58 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "added_tokens_decoder": {
3
+ "0": {
4
+ "content": "[PAD]",
5
+ "lstrip": false,
6
+ "normalized": false,
7
+ "rstrip": false,
8
+ "single_word": false,
9
+ "special": true
10
+ },
11
+ "100": {
12
+ "content": "[UNK]",
13
+ "lstrip": false,
14
+ "normalized": false,
15
+ "rstrip": false,
16
+ "single_word": false,
17
+ "special": true
18
+ },
19
+ "101": {
20
+ "content": "[CLS]",
21
+ "lstrip": false,
22
+ "normalized": false,
23
+ "rstrip": false,
24
+ "single_word": false,
25
+ "special": true
26
+ },
27
+ "102": {
28
+ "content": "[SEP]",
29
+ "lstrip": false,
30
+ "normalized": false,
31
+ "rstrip": false,
32
+ "single_word": false,
33
+ "special": true
34
+ },
35
+ "103": {
36
+ "content": "[MASK]",
37
+ "lstrip": false,
38
+ "normalized": false,
39
+ "rstrip": false,
40
+ "single_word": false,
41
+ "special": true
42
+ }
43
+ },
44
+ "clean_up_tokenization_spaces": true,
45
+ "cls_token": "[CLS]",
46
+ "do_basic_tokenize": true,
47
+ "do_lower_case": true,
48
+ "extra_special_tokens": {},
49
+ "mask_token": "[MASK]",
50
+ "model_max_length": 512,
51
+ "never_split": null,
52
+ "pad_token": "[PAD]",
53
+ "sep_token": "[SEP]",
54
+ "strip_accents": null,
55
+ "tokenize_chinese_chars": true,
56
+ "tokenizer_class": "BertTokenizer",
57
+ "unk_token": "[UNK]"
58
+ }
vocab.txt ADDED
The diff for this file is too large to render. See raw diff