chamizzu commited on
Commit
e59982c
·
verified ·
1 Parent(s): 2faaa7b

Upload fine-tuned RoBERTa model

Browse files
Files changed (3) hide show
  1. README.md +11 -11
  2. model.safetensors +1 -1
  3. training_args.bin +1 -1
README.md CHANGED
@@ -16,8 +16,8 @@ should probably proofread and complete it, then remove this comment. -->
16
 
17
  This model is a fine-tuned version of [roberta-base](https://huggingface.co/roberta-base) on the None dataset.
18
  It achieves the following results on the evaluation set:
19
- - Loss: 0.2027
20
- - Macro F1: 0.4232
21
 
22
  ## Model description
23
 
@@ -37,8 +37,8 @@ More information needed
37
 
38
  The following hyperparameters were used during training:
39
  - learning_rate: 1e-05
40
- - train_batch_size: 8
41
- - eval_batch_size: 8
42
  - seed: 42
43
  - optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
44
  - lr_scheduler_type: linear
@@ -50,13 +50,13 @@ The following hyperparameters were used during training:
50
 
51
  | Training Loss | Epoch | Step | Validation Loss | Macro F1 |
52
  |:-------------:|:-----:|:-----:|:---------------:|:--------:|
53
- | 0.2029 | 1.0 | 5227 | 0.1979 | 0.3165 |
54
- | 0.1909 | 2.0 | 10454 | 0.1931 | 0.3674 |
55
- | 0.1808 | 3.0 | 15681 | 0.1923 | 0.4173 |
56
- | 0.1754 | 4.0 | 20908 | 0.1941 | 0.4166 |
57
- | 0.1653 | 5.0 | 26135 | 0.1965 | 0.4275 |
58
- | 0.1576 | 6.0 | 31362 | 0.2009 | 0.4295 |
59
- | 0.1516 | 7.0 | 36589 | 0.2027 | 0.4232 |
60
 
61
 
62
  ### Framework versions
 
16
 
17
  This model is a fine-tuned version of [roberta-base](https://huggingface.co/roberta-base) on the None dataset.
18
  It achieves the following results on the evaluation set:
19
+ - Loss: 0.1972
20
+ - Macro F1: 0.4889
21
 
22
  ## Model description
23
 
 
37
 
38
  The following hyperparameters were used during training:
39
  - learning_rate: 1e-05
40
+ - train_batch_size: 16
41
+ - eval_batch_size: 16
42
  - seed: 42
43
  - optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
44
  - lr_scheduler_type: linear
 
50
 
51
  | Training Loss | Epoch | Step | Validation Loss | Macro F1 |
52
  |:-------------:|:-----:|:-----:|:---------------:|:--------:|
53
+ | 0.2093 | 1.0 | 2614 | 0.2019 | 0.4586 |
54
+ | 0.1941 | 2.0 | 5228 | 0.1938 | 0.4815 |
55
+ | 0.1845 | 3.0 | 7842 | 0.1916 | 0.4921 |
56
+ | 0.1764 | 4.0 | 10456 | 0.1928 | 0.4918 |
57
+ | 0.1699 | 5.0 | 13070 | 0.1936 | 0.4963 |
58
+ | 0.1639 | 6.0 | 15684 | 0.1964 | 0.4872 |
59
+ | 0.1608 | 7.0 | 18298 | 0.1972 | 0.4889 |
60
 
61
 
62
  ### Framework versions
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:7a13826dd2c14ada458526021b2844c5cd193e06229832e05923d37f2cf8939b
3
  size 498649736
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5b9e3c2eebd944895e949d09dd822d40cdbec4e5a12b854dd490c0ede4ef4e37
3
  size 498649736
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ba86a8ae55eda3f49fe7853915c5809329dcdec9eca540f865e6a6842027a0f5
3
  size 5368
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:656a40b3ca9a5b95a8bdb92cc2cbd6113dac879d88090fedf6f97e1bc886ac1c
3
  size 5368