credentek commited on
Commit
bb6a4e4
·
verified ·
1 Parent(s): eae9ad4

End of training

Browse files
README.md CHANGED
@@ -16,7 +16,7 @@ should probably proofread and complete it, then remove this comment. -->
16
 
17
  This model is a fine-tuned version of [bert-base-uncased](https://huggingface.co/bert-base-uncased) on an unknown dataset.
18
  It achieves the following results on the evaluation set:
19
- - Loss: 0.6836
20
 
21
  ## Model description
22
 
@@ -39,7 +39,7 @@ The following hyperparameters were used during training:
39
  - train_batch_size: 16
40
  - eval_batch_size: 16
41
  - seed: 42
42
- - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
43
  - lr_scheduler_type: linear
44
  - num_epochs: 25
45
 
@@ -47,36 +47,35 @@ The following hyperparameters were used during training:
47
 
48
  | Training Loss | Epoch | Step | Validation Loss |
49
  |:-------------:|:-----:|:-----:|:---------------:|
50
- | 1.8063 | 1.0 | 2163 | 1.4250 |
51
- | 0.9374 | 2.0 | 4326 | 0.8589 |
52
- | 0.743 | 3.0 | 6489 | 0.7322 |
53
- | 0.6568 | 4.0 | 8652 | 0.7122 |
54
- | 0.5919 | 5.0 | 10815 | 0.7026 |
55
- | 0.5826 | 6.0 | 12978 | 0.6974 |
56
- | 0.5772 | 7.0 | 15141 | 0.6856 |
57
- | 0.5479 | 8.0 | 17304 | 0.6836 |
58
- | 0.5541 | 9.0 | 19467 | 0.7033 |
59
- | 0.5025 | 10.0 | 21630 | 0.6976 |
60
- | 0.5322 | 11.0 | 23793 | 0.7045 |
61
- | 0.5438 | 12.0 | 25956 | 0.7032 |
62
- | 0.531 | 13.0 | 28119 | 0.7244 |
63
- | 0.5139 | 14.0 | 30282 | 0.7449 |
64
- | 0.5157 | 15.0 | 32445 | 0.7325 |
65
- | 0.5027 | 16.0 | 34608 | 0.7330 |
66
- | 0.5104 | 17.0 | 36771 | 0.7469 |
67
- | 0.4872 | 18.0 | 38934 | 0.7384 |
68
- | 0.4824 | 19.0 | 41097 | 0.7281 |
69
- | 0.4987 | 20.0 | 43260 | 0.7474 |
70
- | 0.5055 | 21.0 | 45423 | 0.7670 |
71
- | 0.501 | 22.0 | 47586 | 0.7483 |
72
- | 0.493 | 23.0 | 49749 | 0.7518 |
73
- | 0.4986 | 24.0 | 51912 | 0.7529 |
74
- | 0.4696 | 25.0 | 54075 | 0.7587 |
75
 
76
 
77
  ### Framework versions
78
 
79
- - Transformers 4.44.2
80
- - Pytorch 2.4.1+cu121
81
- - Datasets 2.21.0
82
- - Tokenizers 0.19.1
 
16
 
17
  This model is a fine-tuned version of [bert-base-uncased](https://huggingface.co/bert-base-uncased) on an unknown dataset.
18
  It achieves the following results on the evaluation set:
19
+ - Loss: 0.6760
20
 
21
  ## Model description
22
 
 
39
  - train_batch_size: 16
40
  - eval_batch_size: 16
41
  - seed: 42
42
+ - optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
43
  - lr_scheduler_type: linear
44
  - num_epochs: 25
45
 
 
47
 
48
  | Training Loss | Epoch | Step | Validation Loss |
49
  |:-------------:|:-----:|:-----:|:---------------:|
50
+ | 1.7046 | 1.0 | 2163 | 1.3254 |
51
+ | 0.9319 | 2.0 | 4326 | 0.8316 |
52
+ | 0.748 | 3.0 | 6489 | 0.7299 |
53
+ | 0.6583 | 4.0 | 8652 | 0.6946 |
54
+ | 0.6182 | 5.0 | 10815 | 0.6901 |
55
+ | 0.5848 | 6.0 | 12978 | 0.6760 |
56
+ | 0.5789 | 7.0 | 15141 | 0.6797 |
57
+ | 0.543 | 8.0 | 17304 | 0.6948 |
58
+ | 0.5364 | 9.0 | 19467 | 0.7041 |
59
+ | 0.5203 | 10.0 | 21630 | 0.7032 |
60
+ | 0.4974 | 11.0 | 23793 | 0.7076 |
61
+ | 0.519 | 12.0 | 25956 | 0.7232 |
62
+ | 0.5235 | 13.0 | 28119 | 0.7073 |
63
+ | 0.5332 | 14.0 | 30282 | 0.7254 |
64
+ | 0.5109 | 15.0 | 32445 | 0.7158 |
65
+ | 0.5031 | 16.0 | 34608 | 0.7207 |
66
+ | 0.5169 | 17.0 | 36771 | 0.7369 |
67
+ | 0.4915 | 18.0 | 38934 | 0.7322 |
68
+ | 0.4975 | 19.0 | 41097 | 0.7422 |
69
+ | 0.4961 | 20.0 | 43260 | 0.7533 |
70
+ | 0.4692 | 21.0 | 45423 | 0.7670 |
71
+ | 0.5122 | 22.0 | 47586 | 0.7420 |
72
+ | 0.5024 | 23.0 | 49749 | 0.7388 |
73
+ | 0.4867 | 24.0 | 51912 | 0.7470 |
74
+ | 0.4884 | 25.0 | 54075 | 0.7474 |
75
 
76
 
77
  ### Framework versions
78
 
79
+ - Transformers 4.46.2
80
+ - Pytorch 2.5.1+cu124
81
+ - Tokenizers 0.20.3
 
config.json CHANGED
@@ -360,7 +360,7 @@
360
  "position_embedding_type": "absolute",
361
  "problem_type": "single_label_classification",
362
  "torch_dtype": "float32",
363
- "transformers_version": "4.44.2",
364
  "type_vocab_size": 2,
365
  "use_cache": true,
366
  "vocab_size": 30522
 
360
  "position_embedding_type": "absolute",
361
  "problem_type": "single_label_classification",
362
  "torch_dtype": "float32",
363
+ "transformers_version": "4.46.2",
364
  "type_vocab_size": 2,
365
  "use_cache": true,
366
  "vocab_size": 30522
label_encoder.joblib CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c6c8b9d31a3847bd1b68b12505ffe4c3041de30a4cdc249180c2f94c4da0ed16
3
  size 19815
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9ca8601805eca2d956a713605f0af78cd550827649415539151611fe9974e121
3
  size 19815
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:2788ca413f68085b0049a72f1004e91590300c2043f687055f8ec81341267933
3
- size 438546164
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7fd8c1e6b69dd453ef6517645ef9ae8dee8c9b07d2341a7130c54fba5e84dd59
3
+ size 438469264
runs/Nov19_17-56-46_credentek-desktop/events.out.tfevents.1732019207.credentek-desktop.4407.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ab6f73f19afc39a9a493f16f50ce66c83c93b744d2b0fa42ae1fc7ea22c77e73
3
+ size 45685
runs/Nov19_17-56-46_credentek-desktop/events.out.tfevents.1732029422.credentek-desktop.4407.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:71f3a015ce9f2c4c25a9c8ee2410f3a87e9b5e01437f1b6680696e013588c130
3
+ size 364
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:fe5cce021d090bbd2fb8a0c8804420b2b5d72fa8ea557a4522518a24cc043922
3
- size 5304
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6964a011fa1856707121d6210c9e7842841fb41f6bb057dd9fc442eb4bf31501
3
+ size 5368