Hugging Face's logo

dtorber
/
bert-base-cased

Text Classification
Transformers
TensorBoard
Safetensors
bert
Generated from Trainer
Model card Files
xet
Metrics Community
dtorber commited on
Commit
a4f9d18
·
verified ·
1 Parent(s): a427b30

Model save

Browse files
Files changed (4) hide show
  1. README.md +11 -17
  2. model.safetensors +1 -1
  3. runs/Apr12_10-02-35_tardis/events.out.tfevents.1712908991.tardis.102394.0 +2 -2
  4. runs/Apr12_10-02-35_tardis/events.out.tfevents.1712909617.tardis.102394.1 +3 -0
README.md CHANGED
@@ -18,14 +18,14 @@ should probably proofread and complete it, then remove this comment. -->
18
 
19
  This model is a fine-tuned version of [google-bert/bert-base-cased](https://huggingface.co/google-bert/bert-base-cased) on the None dataset.
20
  It achieves the following results on the evaluation set:
21
- - Loss: 0.3452
22
- - F1 Macro: 0.9122
23
- - F1: 0.9423
24
- - F1 Neg: 0.8821
25
  - Acc: 0.9225
26
- - Prec: 0.9440
27
- - Recall: 0.9405
28
- - Mcc: 0.8244
29
 
30
  ## Model description
31
 
@@ -51,22 +51,16 @@ The following hyperparameters were used during training:
51
  - distributed_type: multi-GPU
52
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
53
  - lr_scheduler_type: linear
54
- - num_epochs: 9
55
  - mixed_precision_training: Native AMP
56
 
57
  ### Training results
58
 
59
  | Training Loss | Epoch | Step | Validation Loss | F1 Macro | F1 | F1 Neg | Acc | Prec | Recall | Mcc |
60
  |:-------------:|:-----:|:----:|:---------------:|:--------:|:------:|:------:|:------:|:------:|:------:|:------:|
61
- | No log | 1.0 | 412 | 0.2874 | 0.8817 | 0.9175 | 0.8459 | 0.8925 | 0.9019 | 0.9336 | 0.7644 |
62
- | 0.4079 | 2.0 | 824 | 0.3926 | 0.8937 | 0.9243 | 0.8632 | 0.9025 | 0.9189 | 0.9297 | 0.7875 |
63
- | 0.2262 | 3.0 | 1236 | 0.4043 | 0.9135 | 0.9373 | 0.8897 | 0.92 | 0.9409 | 0.9336 | 0.8270 |
64
- | 0.1144 | 4.0 | 1648 | 0.4935 | 0.9055 | 0.9312 | 0.8797 | 0.9125 | 0.9368 | 0.9258 | 0.8111 |
65
- | 0.0444 | 5.0 | 2060 | 0.6089 | 0.9063 | 0.9304 | 0.8822 | 0.9125 | 0.9474 | 0.9141 | 0.8136 |
66
- | 0.0444 | 6.0 | 2472 | 0.6717 | 0.9063 | 0.9304 | 0.8822 | 0.9125 | 0.9474 | 0.9141 | 0.8136 |
67
- | 0.0211 | 7.0 | 2884 | 0.7189 | 0.8963 | 0.9264 | 0.8662 | 0.905 | 0.9192 | 0.9336 | 0.7928 |
68
- | 0.0127 | 8.0 | 3296 | 0.7510 | 0.8988 | 0.9284 | 0.8693 | 0.9075 | 0.9195 | 0.9375 | 0.7980 |
69
- | 0.0025 | 9.0 | 3708 | 0.7730 | 0.9058 | 0.9310 | 0.8805 | 0.9125 | 0.9402 | 0.9219 | 0.8118 |
70
 
71
 
72
  ### Framework versions
 
18
 
19
  This model is a fine-tuned version of [google-bert/bert-base-cased](https://huggingface.co/google-bert/bert-base-cased) on the None dataset.
20
  It achieves the following results on the evaluation set:
21
+ - Loss: 0.3280
22
+ - F1 Macro: 0.9125
23
+ - F1: 0.9421
24
+ - F1 Neg: 0.8830
25
  - Acc: 0.9225
26
+ - Prec: 0.9474
27
+ - Recall: 0.9368
28
+ - Mcc: 0.8252
29
 
30
  ## Model description
31
 
 
51
  - distributed_type: multi-GPU
52
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
53
  - lr_scheduler_type: linear
54
+ - num_epochs: 3
55
  - mixed_precision_training: Native AMP
56
 
57
  ### Training results
58
 
59
  | Training Loss | Epoch | Step | Validation Loss | F1 Macro | F1 | F1 Neg | Acc | Prec | Recall | Mcc |
60
  |:-------------:|:-----:|:----:|:---------------:|:--------:|:------:|:------:|:------:|:------:|:------:|:------:|
61
+ | 0.2495 | 1.0 | 1647 | 0.3554 | 0.9111 | 0.9349 | 0.8874 | 0.9175 | 0.9442 | 0.9258 | 0.8226 |
62
+ | 0.091 | 2.0 | 3294 | 0.5621 | 0.9011 | 0.9308 | 0.8714 | 0.91 | 0.9167 | 0.9453 | 0.8031 |
63
+ | 0.0202 | 3.0 | 4941 | 0.6612 | 0.9049 | 0.9318 | 0.8780 | 0.9125 | 0.9300 | 0.9336 | 0.8098 |
 
 
 
 
 
 
64
 
65
 
66
  ### Framework versions
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:0004d555a54b6517b1975a3ba774d59720f121640a1314635c08cd3b09489887
3
  size 433270768
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cf48b2b86e340fff349a79f7eadd3f510dac7346d4b336f704f9e737bc664a5d
3
  size 433270768
runs/Apr12_10-02-35_tardis/events.out.tfevents.1712908991.tardis.102394.0 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:dd61af2e5b7ecd7e8d68bdb69f0d88733d24a76b23924f412fa84f078d993882
3
- size 7387
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:81ee44159419186dbee9c806e942d62195b369f1e60cf31a3c8999f112d42a6f
3
+ size 8985
runs/Apr12_10-02-35_tardis/events.out.tfevents.1712909617.tardis.102394.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0272f34d53abe2a043341c0284dd7a23438535543ed18635a0fffceb8e496223
3
+ size 699