Hugging Face's logo

dtorber
/
bertweet-base

Text Classification
Transformers
TensorBoard
Safetensors
roberta
Generated from Trainer
Model card Files
xet
Metrics Community
dtorber commited on
Commit
2fd1565
·
verified ·
1 Parent(s): 0678548

Model save

Browse files
Files changed (1) hide show
  1. README.md +12 -16
README.md CHANGED
@@ -17,14 +17,14 @@ should probably proofread and complete it, then remove this comment. -->
17
 
18
  This model is a fine-tuned version of [vinai/bertweet-base](https://huggingface.co/vinai/bertweet-base) on the None dataset.
19
  It achieves the following results on the evaluation set:
20
- - Loss: 0.5645
21
- - F1 Macro: 0.8513
22
- - F1: 0.9041
23
- - F1 Neg: 0.7984
24
- - Acc: 0.87
25
- - Prec: 0.8974
26
- - Recall: 0.9108
27
- - Mcc: 0.7027
28
 
29
  ## Model description
30
 
@@ -50,18 +50,14 @@ The following hyperparameters were used during training:
50
  - distributed_type: multi-GPU
51
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
52
  - lr_scheduler_type: linear
53
- - num_epochs: 5
54
  - mixed_precision_training: Native AMP
55
 
56
  ### Training results
57
 
58
- | Training Loss | Epoch | Step | Validation Loss | F1 Macro | F1 | F1 Neg | Acc | Prec | Recall | Mcc |
59
- |:-------------:|:-----:|:----:|:---------------:|:--------:|:------:|:------:|:------:|:------:|:------:|:------:|
60
- | 0.6718 | 1.0 | 614 | 0.6382 | 0.6919 | 0.8136 | 0.5702 | 0.74 | 0.7517 | 0.8867 | 0.4083 |
61
- | 0.5134 | 2.0 | 1228 | 0.5523 | 0.7460 | 0.7657 | 0.7263 | 0.7475 | 0.9429 | 0.6445 | 0.5564 |
62
- | 0.4637 | 3.0 | 1842 | 0.5460 | 0.8362 | 0.8837 | 0.7887 | 0.85 | 0.8769 | 0.8906 | 0.6726 |
63
- | 0.4004 | 4.0 | 2456 | 0.6145 | 0.8160 | 0.8505 | 0.7815 | 0.8225 | 0.9224 | 0.7891 | 0.6471 |
64
- | 0.3192 | 5.0 | 3070 | 0.5929 | 0.8476 | 0.8911 | 0.8042 | 0.86 | 0.8876 | 0.8945 | 0.6953 |
65
 
66
 
67
  ### Framework versions
 
17
 
18
  This model is a fine-tuned version of [vinai/bertweet-base](https://huggingface.co/vinai/bertweet-base) on the None dataset.
19
  It achieves the following results on the evaluation set:
20
+ - Loss: 0.5414
21
+ - F1 Macro: 0.7179
22
+ - F1: 0.8053
23
+ - F1 Neg: 0.6304
24
+ - Acc: 0.745
25
+ - Prec: 0.7873
26
+ - Recall: 0.8242
27
+ - Mcc: 0.4373
28
 
29
  ## Model description
30
 
 
50
  - distributed_type: multi-GPU
51
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
52
  - lr_scheduler_type: linear
53
+ - num_epochs: 1
54
  - mixed_precision_training: Native AMP
55
 
56
  ### Training results
57
 
58
+ | Training Loss | Epoch | Step | Validation Loss | F1 Macro | F1 | F1 Neg | Acc | Prec | Recall | Mcc |
59
+ |:-------------:|:-----:|:----:|:---------------:|:--------:|:------:|:------:|:-----:|:------:|:------:|:------:|
60
+ | 0.6385 | 1.0 | 614 | 0.5414 | 0.7179 | 0.8053 | 0.6304 | 0.745 | 0.7873 | 0.8242 | 0.4373 |
 
 
 
 
61
 
62
 
63
  ### Framework versions