Hugging Face's logo

ThuyNT03
/
xlm-roberta-base-Final_Mixed-aug_replace_BERT-1

Text Classification
Transformers
PyTorch
xlm-roberta
Generated from Trainer
text-embeddings-inference
Model card Files
xet
 Community
1
ThuyNT03 commited on
Commit
36c06d4
·
1 Parent(s): 6579602

Training completed!

Browse files
Files changed (2) hide show
  1. README.md +14 -14
  2. pytorch_model.bin +1 -1
README.md CHANGED
@@ -18,9 +18,9 @@ should probably proofread and complete it, then remove this comment. -->
18
 
19
  This model is a fine-tuned version of [xlm-roberta-base](https://huggingface.co/xlm-roberta-base) on the None dataset.
20
  It achieves the following results on the evaluation set:
21
- - Loss: 0.7304
22
- - Accuracy: 0.72
23
- - F1: 0.7148
24
 
25
  ## Model description
26
 
@@ -42,7 +42,7 @@ The following hyperparameters were used during training:
42
  - learning_rate: 2e-05
43
  - train_batch_size: 16
44
  - eval_batch_size: 16
45
- - seed: 42
46
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
47
  - lr_scheduler_type: linear
48
  - num_epochs: 8
@@ -51,19 +51,19 @@ The following hyperparameters were used during training:
51
 
52
  | Training Loss | Epoch | Step | Validation Loss | Accuracy | F1 |
53
  |:-------------:|:-----:|:----:|:---------------:|:--------:|:------:|
54
- | 1.0588 | 1.0 | 88 | 0.8362 | 0.62 | 0.5692 |
55
- | 0.9033 | 2.0 | 176 | 0.8056 | 0.65 | 0.6389 |
56
- | 0.8125 | 3.0 | 264 | 0.7567 | 0.71 | 0.6985 |
57
- | 0.7047 | 4.0 | 352 | 0.6164 | 0.76 | 0.7562 |
58
- | 0.6141 | 5.0 | 440 | 0.6961 | 0.74 | 0.7345 |
59
- | 0.5241 | 6.0 | 528 | 0.6949 | 0.72 | 0.7168 |
60
- | 0.4213 | 7.0 | 616 | 0.7377 | 0.73 | 0.7243 |
61
- | 0.4149 | 8.0 | 704 | 0.7304 | 0.72 | 0.7148 |
62
 
63
 
64
  ### Framework versions
65
 
66
- - Transformers 4.32.1
67
  - Pytorch 2.0.1+cu118
68
- - Datasets 2.14.4
69
  - Tokenizers 0.13.3
 
18
 
19
  This model is a fine-tuned version of [xlm-roberta-base](https://huggingface.co/xlm-roberta-base) on the None dataset.
20
  It achieves the following results on the evaluation set:
21
+ - Loss: 0.7460
22
+ - Accuracy: 0.75
23
+ - F1: 0.7473
24
 
25
  ## Model description
26
 
 
42
  - learning_rate: 2e-05
43
  - train_batch_size: 16
44
  - eval_batch_size: 16
45
+ - seed: 41
46
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
47
  - lr_scheduler_type: linear
48
  - num_epochs: 8
 
51
 
52
  | Training Loss | Epoch | Step | Validation Loss | Accuracy | F1 |
53
  |:-------------:|:-----:|:----:|:---------------:|:--------:|:------:|
54
+ | 1.0554 | 1.0 | 88 | 0.9377 | 0.5 | 0.4177 |
55
+ | 0.8929 | 2.0 | 176 | 0.8133 | 0.64 | 0.5654 |
56
+ | 0.7778 | 3.0 | 264 | 0.6756 | 0.73 | 0.7154 |
57
+ | 0.6686 | 4.0 | 352 | 0.6923 | 0.75 | 0.7378 |
58
+ | 0.5672 | 5.0 | 440 | 0.6880 | 0.77 | 0.7706 |
59
+ | 0.5009 | 6.0 | 528 | 0.7243 | 0.77 | 0.7668 |
60
+ | 0.3978 | 7.0 | 616 | 0.7148 | 0.76 | 0.7584 |
61
+ | 0.3843 | 8.0 | 704 | 0.7460 | 0.75 | 0.7473 |
62
 
63
 
64
  ### Framework versions
65
 
66
+ - Transformers 4.33.1
67
  - Pytorch 2.0.1+cu118
68
+ - Datasets 2.14.5
69
  - Tokenizers 0.13.3
pytorch_model.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:54088e00301459b58c18601127218d092cc2dc443d47ad9c1c783087e71e53e1
3
  size 1112252785
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0c9fdf9442a828dfb68fb44f6bc788f41c386ecf8db67baaf5509bfa96921a12
3
  size 1112252785