Hugging Face's logo

bdanko
/
bert-tweeteval-distilroberta

Text Classification
Transformers
Safetensors
roberta
Generated from Trainer
text-embeddings-inference
Model card Files
xet
 Community
bdanko commited on
Commit
aa3bc49
·
verified ·
1 Parent(s): 97d6a2f

End of training

Browse files
Files changed (2) hide show
  1. README.md +9 -8
  2. model.safetensors +1 -1
README.md CHANGED
@@ -16,7 +16,7 @@ should probably proofread and complete it, then remove this comment. -->
16
 
17
  This model is a fine-tuned version of [distilroberta-base](https://huggingface.co/distilroberta-base) on the None dataset.
18
  It achieves the following results on the evaluation set:
19
- - Loss: 0.9741
20
 
21
  ## Model description
22
 
@@ -37,8 +37,8 @@ More information needed
37
  The following hyperparameters were used during training:
38
  - learning_rate: 2e-05
39
  - train_batch_size: 16
40
- - eval_batch_size: 16
41
- - seed: 42
42
  - optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
43
  - lr_scheduler_type: linear
44
  - num_epochs: 20
@@ -47,11 +47,12 @@ The following hyperparameters were used during training:
47
 
48
  | Training Loss | Epoch | Step | Validation Loss |
49
  |:-------------:|:-----:|:----:|:---------------:|
50
- | 0.7006 | 1.0 | 204 | 0.7013 |
51
- | 0.5596 | 2.0 | 408 | 0.6443 |
52
- | 0.3891 | 3.0 | 612 | 0.6844 |
53
- | 0.3281 | 4.0 | 816 | 0.8158 |
54
- | 0.1767 | 5.0 | 1020 | 0.9741 |
 
55
 
56
 
57
  ### Framework versions
 
16
 
17
  This model is a fine-tuned version of [distilroberta-base](https://huggingface.co/distilroberta-base) on the None dataset.
18
  It achieves the following results on the evaluation set:
19
+ - Loss: 1.1791
20
 
21
  ## Model description
22
 
 
37
  The following hyperparameters were used during training:
38
  - learning_rate: 2e-05
39
  - train_batch_size: 16
40
+ - eval_batch_size: 100
41
+ - seed: 15179996
42
  - optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
43
  - lr_scheduler_type: linear
44
  - num_epochs: 20
 
47
 
48
  | Training Loss | Epoch | Step | Validation Loss |
49
  |:-------------:|:-----:|:----:|:---------------:|
50
+ | 0.6591 | 1.0 | 204 | 0.6607 |
51
+ | 0.5444 | 2.0 | 408 | 0.7015 |
52
+ | 0.3962 | 3.0 | 612 | 0.6378 |
53
+ | 0.2703 | 4.0 | 816 | 0.9126 |
54
+ | 0.1748 | 5.0 | 1020 | 1.0216 |
55
+ | 0.1327 | 6.0 | 1224 | 1.1791 |
56
 
57
 
58
  ### Framework versions
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:bb69bace6786a1c9996447146876b2b9121ebb15ad5e27013be75d531c9857fc
3
  size 328498416
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:00d53740c7f2af5e000b54eafde0fcde17e937e144ee07fc8aa4546438c2a32d
3
  size 328498416