procit011 commited on
Commit
9183759
·
verified ·
1 Parent(s): b163d9e

anger_frustration_detection_7_train

Browse files
Files changed (3) hide show
  1. README.md +14 -11
  2. model.safetensors +1 -1
  3. training_args.bin +1 -1
README.md CHANGED
@@ -19,9 +19,9 @@ should probably proofread and complete it, then remove this comment. -->
19
 
20
  This model is a fine-tuned version of [pdelobelle/robbert-v2-dutch-base](https://huggingface.co/pdelobelle/robbert-v2-dutch-base) on the None dataset.
21
  It achieves the following results on the evaluation set:
22
- - Loss: 0.0472
23
- - F1: 0.9916
24
- - Accuracy: 0.9939
25
 
26
  ## Model description
27
 
@@ -40,22 +40,25 @@ More information needed
40
  ### Training hyperparameters
41
 
42
  The following hyperparameters were used during training:
43
- - learning_rate: 5e-05
44
- - train_batch_size: 8
45
  - eval_batch_size: 8
46
  - seed: 42
 
 
47
  - optimizer: Use OptimizerNames.ADAMW_TORCH_FUSED with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
48
- - lr_scheduler_type: linear
49
- - lr_scheduler_warmup_steps: 50
50
- - num_epochs: 3
51
 
52
  ### Training results
53
 
54
  | Training Loss | Epoch | Step | Validation Loss | F1 | Accuracy |
55
  |:-------------:|:-----:|:----:|:---------------:|:------:|:--------:|
56
- | 0.0838 | 1.0 | 2116 | 0.0788 | 0.9843 | 0.9887 |
57
- | 0.0006 | 2.0 | 4232 | 0.0704 | 0.9836 | 0.9882 |
58
- | 0.0001 | 3.0 | 6348 | 0.0552 | 0.9883 | 0.9915 |
 
59
 
60
 
61
  ### Framework versions
 
19
 
20
  This model is a fine-tuned version of [pdelobelle/robbert-v2-dutch-base](https://huggingface.co/pdelobelle/robbert-v2-dutch-base) on the None dataset.
21
  It achieves the following results on the evaluation set:
22
+ - Loss: 0.0796
23
+ - F1: 0.9827
24
+ - Accuracy: 0.9869
25
 
26
  ## Model description
27
 
 
40
  ### Training hyperparameters
41
 
42
  The following hyperparameters were used during training:
43
+ - learning_rate: 2e-05
44
+ - train_batch_size: 4
45
  - eval_batch_size: 8
46
  - seed: 42
47
+ - gradient_accumulation_steps: 4
48
+ - total_train_batch_size: 16
49
  - optimizer: Use OptimizerNames.ADAMW_TORCH_FUSED with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
50
+ - lr_scheduler_type: cosine
51
+ - lr_scheduler_warmup_steps: 0.1
52
+ - num_epochs: 10
53
 
54
  ### Training results
55
 
56
  | Training Loss | Epoch | Step | Validation Loss | F1 | Accuracy |
57
  |:-------------:|:-----:|:----:|:---------------:|:------:|:--------:|
58
+ | 0.5180 | 1.0 | 1107 | 0.0904 | 0.9782 | 0.9837 |
59
+ | 0.0220 | 2.0 | 2214 | 0.0530 | 0.9892 | 0.9919 |
60
+ | 0.1185 | 3.0 | 3321 | 0.0673 | 0.9880 | 0.9910 |
61
+ | 0.0001 | 4.0 | 4428 | 0.0633 | 0.9886 | 0.9914 |
62
 
63
 
64
  ### Framework versions
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:06893d90e2d8a8d4d77d43afd993efa5a10b30b3f9d3457d48352aa5a5381b95
3
  size 467078720
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cde1e43721280d97c45f43b2cffe2c834104223d22c4209eb8b5868359dcc94e
3
  size 467078720
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:6eae7a085b22b0648852c79cb582baced847da3383a46f597e8370c812d80d66
3
  size 5201
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a0a3752cbac8bf116330511dbe83ec0c5118b8e90cc2f1ed769aa8cb9b4dfde4
3
  size 5201