Silicon23 commited on
Commit
d90002b
·
verified ·
1 Parent(s): cc3c2f4

End of training

Browse files
README.md CHANGED
@@ -1,6 +1,6 @@
1
  ---
2
- license: cc-by-nc-4.0
3
- base_model: AIMH/mental-bert-base-cased
4
  tags:
5
  - generated_from_trainer
6
  metrics:
@@ -15,10 +15,10 @@ should probably proofread and complete it, then remove this comment. -->
15
 
16
  # BERTForDetectingDepression-Twitter2015
17
 
18
- This model is a fine-tuned version of [AIMH/mental-bert-base-cased](https://huggingface.co/AIMH/mental-bert-base-cased) on [this dataset](https://www.kaggle.com/datasets/infamouscoder/mental-health-social-media).
19
  It achieves the following results on the evaluation set:
20
- - Loss: 0.5232
21
- - Accuracy: 0.9276
22
 
23
  ## Model description
24
 
@@ -30,33 +30,27 @@ More information needed
30
 
31
  ## Training and evaluation data
32
 
33
- Eval Precision: 0.9206730769230769
34
-
35
- Eval Recall: 0.9364303178484108
36
-
37
- Eval Accuracy: 0.9275629220380601
38
 
39
  ## Training procedure
40
 
41
  ### Training hyperparameters
42
 
43
  The following hyperparameters were used during training:
44
- - learning_rate: 1.8919952478487808e-05
45
- - train_batch_size: 4
46
  - eval_batch_size: 16
47
- - seed: 36
48
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
49
  - lr_scheduler_type: linear
50
- - num_epochs: 4
51
 
52
  ### Training results
53
 
54
- | Training Loss | Epoch | Step | Validation Loss | Accuracy |
55
- |:-------------:|:-----:|:-----:|:---------------:|:--------:|
56
- | 0.3347 | 1.0 | 3665 | 0.3384 | 0.9061 |
57
- | 0.152 | 2.0 | 7330 | 0.4665 | 0.9227 |
58
- | 0.0444 | 3.0 | 10995 | 0.5232 | 0.9276 |
59
- | 0.0057 | 4.0 | 14660 | 0.5890 | 0.9269 |
60
 
61
 
62
  ### Framework versions
 
1
  ---
2
+ license: apache-2.0
3
+ base_model: google-bert/bert-base-uncased
4
  tags:
5
  - generated_from_trainer
6
  metrics:
 
15
 
16
  # BERTForDetectingDepression-Twitter2015
17
 
18
+ This model is a fine-tuned version of [google-bert/bert-base-uncased](https://huggingface.co/google-bert/bert-base-uncased) on an unknown dataset.
19
  It achieves the following results on the evaluation set:
20
+ - Loss: 0.2785
21
+ - Accuracy: 0.9214
22
 
23
  ## Model description
24
 
 
30
 
31
  ## Training and evaluation data
32
 
33
+ More information needed
 
 
 
 
34
 
35
  ## Training procedure
36
 
37
  ### Training hyperparameters
38
 
39
  The following hyperparameters were used during training:
40
+ - learning_rate: 7.022911988641232e-05
41
+ - train_batch_size: 16
42
  - eval_batch_size: 16
43
+ - seed: 15
44
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
45
  - lr_scheduler_type: linear
46
+ - num_epochs: 2
47
 
48
  ### Training results
49
 
50
+ | Training Loss | Epoch | Step | Validation Loss | Accuracy |
51
+ |:-------------:|:-----:|:----:|:---------------:|:--------:|
52
+ | 0.3365 | 1.0 | 917 | 0.2187 | 0.9128 |
53
+ | 0.1213 | 2.0 | 1834 | 0.2785 | 0.9214 |
 
 
54
 
55
 
56
  ### Framework versions
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e18b3b55391290fa102826a1e71aba3750b61eafc8d5a853f755688f29389482
3
  size 437958648
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6997d4b0825355d192e419b5fdd8849af76851f2ff296cf80949f1b89da04c8a
3
  size 437958648
runs/Aug02_03-09-56_8953887c6028/events.out.tfevents.1722569284.8953887c6028.1235.11 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0f1bf001aded118f4bf934e2078ee30aa49cc8eff6ea86ada036dd7d50360dcb
3
+ size 411