Hugging Face's logo

dtorber
/
bertweet-base

Text Classification
Transformers
TensorBoard
Safetensors
roberta
Generated from Trainer
Model card Files
xet
Metrics Community
dtorber commited on
Commit
2d059fe
·
verified ·
1 Parent(s): 08c49df

Model save

Browse files
Files changed (2) hide show
  1. README.md +16 -19
  2. runs/Apr06_11-17-44_tardis/events.out.tfevents.1712395069.tardis.2343.4 +2 -2
README.md CHANGED
@@ -17,14 +17,14 @@ should probably proofread and complete it, then remove this comment. -->
17
 
18
  This model is a fine-tuned version of [vinai/bertweet-base](https://huggingface.co/vinai/bertweet-base) on the None dataset.
19
  It achieves the following results on the evaluation set:
20
- - Loss: 0.7685
21
- - F1 Macro: 0.8269
22
- - F1: 0.8697
23
- - F1 Neg: 0.7841
24
- - Acc: 0.8375
25
- - Prec: 0.8930
26
- - Recall: 0.8477
27
- - Mcc: 0.6558
28
 
29
  ## Model description
30
 
@@ -44,24 +44,21 @@ More information needed
44
 
45
  The following hyperparameters were used during training:
46
  - learning_rate: 2e-05
47
- - train_batch_size: 8
48
- - eval_batch_size: 8
49
  - seed: 42
50
- - distributed_type: multi-GPU
51
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
52
  - lr_scheduler_type: linear
53
- - num_epochs: 5
54
  - mixed_precision_training: Native AMP
55
 
56
  ### Training results
57
 
58
- | Training Loss | Epoch | Step | Validation Loss | F1 Macro | F1 | F1 Neg | Acc | Prec | Recall | Mcc |
59
- |:-------------:|:-----:|:----:|:---------------:|:--------:|:------:|:------:|:------:|:------:|:------:|:------:|
60
- | 0.6468 | 1.0 | 592 | 0.5371 | 0.7329 | 0.8451 | 0.6207 | 0.78 | 0.7692 | 0.9375 | 0.5069 |
61
- | 0.454 | 2.0 | 1184 | 0.5912 | 0.7849 | 0.8419 | 0.7279 | 0.8 | 0.852 | 0.8320 | 0.5702 |
62
- | 0.4138 | 3.0 | 1776 | 0.6924 | 0.7853 | 0.8685 | 0.7020 | 0.8175 | 0.8060 | 0.9414 | 0.5951 |
63
- | 0.3396 | 4.0 | 2368 | 0.7403 | 0.8233 | 0.8577 | 0.7888 | 0.83 | 0.9234 | 0.8008 | 0.6594 |
64
- | 0.3215 | 5.0 | 2960 | 0.7685 | 0.8269 | 0.8697 | 0.7841 | 0.8375 | 0.8930 | 0.8477 | 0.6558 |
65
 
66
 
67
  ### Framework versions
 
17
 
18
  This model is a fine-tuned version of [vinai/bertweet-base](https://huggingface.co/vinai/bertweet-base) on the None dataset.
19
  It achieves the following results on the evaluation set:
20
+ - Loss: 0.6568
21
+ - F1 Macro: 0.3902
22
+ - F1: 0.7805
23
+ - F1 Neg: 0.0
24
+ - Acc: 0.64
25
+ - Prec: 0.64
26
+ - Recall: 1.0
27
+ - Mcc: 0.0
28
 
29
  ## Model description
30
 
 
44
 
45
  The following hyperparameters were used during training:
46
  - learning_rate: 2e-05
47
+ - train_batch_size: 16
48
+ - eval_batch_size: 16
49
  - seed: 42
 
50
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
51
  - lr_scheduler_type: linear
52
+ - num_epochs: 3
53
  - mixed_precision_training: Native AMP
54
 
55
  ### Training results
56
 
57
+ | Training Loss | Epoch | Step | Validation Loss | F1 Macro | F1 | F1 Neg | Acc | Prec | Recall | Mcc |
58
+ |:-------------:|:-----:|:----:|:---------------:|:--------:|:------:|:------:|:----:|:----:|:------:|:---:|
59
+ | No log | 1.0 | 10 | 0.7766 | 0.3902 | 0.7805 | 0.0 | 0.64 | 0.64 | 1.0 | 0.0 |
60
+ | No log | 2.0 | 20 | 0.6608 | 0.3902 | 0.7805 | 0.0 | 0.64 | 0.64 | 1.0 | 0.0 |
61
+ | No log | 3.0 | 30 | 0.6568 | 0.3902 | 0.7805 | 0.0 | 0.64 | 0.64 | 1.0 | 0.0 |
 
 
62
 
63
 
64
  ### Framework versions
runs/Apr06_11-17-44_tardis/events.out.tfevents.1712395069.tardis.2343.4 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:67e4aecb045c13e7af89509f9887bf036955fc720e9f02b9bc641183d95180a2
3
- size 5641
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a66bc479de7493365605ae86985a15bb64a3e265520c6a68d09a0e9dbda23fac
3
+ size 7187