Hugging Face's logo

BigTMiami
/
micro_base_help_class_no_pre_seed_0

Text Classification
Transformers
Safetensors
roberta
Generated from Trainer
text-embeddings-inference
Model card Files
xet
 Community
BigTMiami commited on
Commit
49ca097
·
verified ·
1 Parent(s): 781e086

End of training

Browse files
Files changed (2) hide show
  1. README.md +14 -9
  2. model.safetensors +1 -1
README.md CHANGED
@@ -17,9 +17,9 @@ should probably proofread and complete it, then remove this comment. -->
17
 
18
  This model is a fine-tuned version of [roberta-base](https://huggingface.co/roberta-base) on an unknown dataset.
19
  It achieves the following results on the evaluation set:
20
- - Loss: 0.4247
21
- - Accuracy: 0.8594
22
- - F1 Macro: 0.4622
23
 
24
  ## Model description
25
 
@@ -38,23 +38,28 @@ More information needed
38
  ### Training hyperparameters
39
 
40
  The following hyperparameters were used during training:
41
- - learning_rate: 0.0001
42
  - train_batch_size: 16
43
  - eval_batch_size: 16
44
  - seed: 0
45
  - optimizer: Adam with betas=(0.9,0.98) and epsilon=1e-06
46
  - lr_scheduler_type: linear
47
- - lr_scheduler_warmup_ratio: 0.06
48
  - num_epochs: 10
49
 
50
  ### Training results
51
 
52
  | Training Loss | Epoch | Step | Validation Loss | Accuracy | F1 Macro |
53
  |:-------------:|:-----:|:----:|:---------------:|:--------:|:--------:|
54
- | 0.3939 | 1.0 | 313 | 0.4391 | 0.8534 | 0.4605 |
55
- | 0.4228 | 2.0 | 626 | 0.4264 | 0.8534 | 0.4605 |
56
- | 0.4244 | 3.0 | 939 | 0.4344 | 0.8534 | 0.4605 |
57
- | 0.419 | 4.0 | 1252 | 0.4177 | 0.8534 | 0.4605 |
 
 
 
 
 
 
58
 
59
 
60
  ### Framework versions
 
17
 
18
  This model is a fine-tuned version of [roberta-base](https://huggingface.co/roberta-base) on an unknown dataset.
19
  It achieves the following results on the evaluation set:
20
+ - Loss: 0.9454
21
+ - Accuracy: 0.8456
22
+ - F1 Macro: 0.6500
23
 
24
  ## Model description
25
 
 
38
  ### Training hyperparameters
39
 
40
  The following hyperparameters were used during training:
41
+ - learning_rate: 2e-05
42
  - train_batch_size: 16
43
  - eval_batch_size: 16
44
  - seed: 0
45
  - optimizer: Adam with betas=(0.9,0.98) and epsilon=1e-06
46
  - lr_scheduler_type: linear
 
47
  - num_epochs: 10
48
 
49
  ### Training results
50
 
51
  | Training Loss | Epoch | Step | Validation Loss | Accuracy | F1 Macro |
52
  |:-------------:|:-----:|:----:|:---------------:|:--------:|:--------:|
53
+ | 0.3239 | 1.0 | 313 | 0.3666 | 0.8572 | 0.5370 |
54
+ | 0.3208 | 2.0 | 626 | 0.3962 | 0.8536 | 0.4632 |
55
+ | 0.2688 | 3.0 | 939 | 0.3881 | 0.8622 | 0.5912 |
56
+ | 0.2105 | 4.0 | 1252 | 0.5269 | 0.8616 | 0.5922 |
57
+ | 0.1625 | 5.0 | 1565 | 0.6255 | 0.859 | 0.6338 |
58
+ | 0.1188 | 6.0 | 1878 | 0.8231 | 0.8572 | 0.6169 |
59
+ | 0.052 | 7.0 | 2191 | 0.8230 | 0.8616 | 0.6189 |
60
+ | 0.053 | 8.0 | 2504 | 0.9466 | 0.8422 | 0.6496 |
61
+ | 0.0365 | 9.0 | 2817 | 0.9747 | 0.8556 | 0.6365 |
62
+ | 0.0452 | 10.0 | 3130 | 0.9923 | 0.8578 | 0.6360 |
63
 
64
 
65
  ### Framework versions
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:60130e2e67e2d48d380132209fd94f6f4e337c5a62f8f43e7d6bbc88eb010824
3
  size 498612824
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:93e3bde47425d802cd13fa87af2263d015ddb551f9fce02ea7844c82d98a6e68
3
  size 498612824