Hugging Face's logo

kiatkock
/
sentiment_DiceLoss

Text Classification
Transformers
TensorBoard
Safetensors
bert
Generated from Trainer
text-embeddings-inference
Model card Files
xet
 Metrics Community
kiatkock commited on
Commit
1f4c594
·
verified ·
1 Parent(s): 071452b

End of training

Browse files
Files changed (5) hide show
  1. README.md +33 -5
  2. model.safetensors +1 -1
  3. runs/Jun04_05-52-50_2633a01a23c9/events.out.tfevents.1717480376.2633a01a23c9.2417.0 +3 -0
  4. runs/Jun04_05-52-50_2633a01a23c9/events.out.tfevents.1717481127.2633a01a23c9.2417.1 +3 -0
  5. training_args.bin +1 -1
README.md CHANGED
@@ -17,9 +17,9 @@ should probably proofread and complete it, then remove this comment. -->
17
 
18
  This model is a fine-tuned version of [ahmedrachid/FinancialBERT-Sentiment-Analysis](https://huggingface.co/ahmedrachid/FinancialBERT-Sentiment-Analysis) on the None dataset.
19
  It achieves the following results on the evaluation set:
20
- - Loss: 2.8374
21
- - Accuracy: 0.8171
22
- - F1: 0.7866
23
 
24
  ## Model description
25
 
@@ -46,15 +46,43 @@ The following hyperparameters were used during training:
46
  - total_train_batch_size: 32
47
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
48
  - lr_scheduler_type: linear
49
- - num_epochs: 3
50
 
51
  ### Training results
52
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
53
 
54
 
55
  ### Framework versions
56
 
57
  - Transformers 4.41.2
58
  - Pytorch 2.3.0+cu121
59
- - Datasets 2.19.1
60
  - Tokenizers 0.19.1
 
17
 
18
  This model is a fine-tuned version of [ahmedrachid/FinancialBERT-Sentiment-Analysis](https://huggingface.co/ahmedrachid/FinancialBERT-Sentiment-Analysis) on the None dataset.
19
  It achieves the following results on the evaluation set:
20
+ - Loss: 0.5153
21
+ - Accuracy: 0.8683
22
+ - F1: 0.8376
23
 
24
  ## Model description
25
 
 
46
  - total_train_batch_size: 32
47
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
48
  - lr_scheduler_type: linear
49
+ - num_epochs: 5
50
 
51
  ### Training results
52
 
53
+ | Training Loss | Epoch | Step | Validation Loss | Accuracy | F1 |
54
+ |:-------------:|:------:|:----:|:---------------:|:--------:|:------:|
55
+ | No log | 0.1739 | 50 | 0.5234 | 0.8096 | 0.7723 |
56
+ | No log | 0.3478 | 100 | 0.4390 | 0.8457 | 0.8151 |
57
+ | No log | 0.5217 | 150 | 0.4168 | 0.8491 | 0.8137 |
58
+ | No log | 0.6957 | 200 | 0.4252 | 0.8522 | 0.8150 |
59
+ | No log | 0.8696 | 250 | 0.3931 | 0.8561 | 0.8196 |
60
+ | No log | 1.0435 | 300 | 0.4409 | 0.8409 | 0.8118 |
61
+ | No log | 1.2174 | 350 | 0.4108 | 0.8657 | 0.8271 |
62
+ | No log | 1.3913 | 400 | 0.4382 | 0.8613 | 0.8292 |
63
+ | No log | 1.5652 | 450 | 0.4147 | 0.8622 | 0.8287 |
64
+ | 0.415 | 1.7391 | 500 | 0.4069 | 0.8652 | 0.8331 |
65
+ | 0.415 | 1.9130 | 550 | 0.4170 | 0.8591 | 0.8275 |
66
+ | 0.415 | 2.0870 | 600 | 0.4533 | 0.8626 | 0.8296 |
67
+ | 0.415 | 2.2609 | 650 | 0.4613 | 0.87 | 0.8401 |
68
+ | 0.415 | 2.4348 | 700 | 0.4531 | 0.8770 | 0.8447 |
69
+ | 0.415 | 2.6087 | 750 | 0.4534 | 0.8583 | 0.8277 |
70
+ | 0.415 | 2.7826 | 800 | 0.4756 | 0.8570 | 0.8274 |
71
+ | 0.415 | 2.9565 | 850 | 0.4482 | 0.8683 | 0.8391 |
72
+ | 0.415 | 3.1304 | 900 | 0.4858 | 0.8665 | 0.8350 |
73
+ | 0.415 | 3.3043 | 950 | 0.4873 | 0.8639 | 0.8341 |
74
+ | 0.1812 | 3.4783 | 1000 | 0.5153 | 0.8683 | 0.8376 |
75
+ | 0.1812 | 3.6522 | 1050 | 0.5345 | 0.8578 | 0.8281 |
76
+ | 0.1812 | 3.8261 | 1100 | 0.5372 | 0.8609 | 0.8331 |
77
+ | 0.1812 | 4.0 | 1150 | 0.5172 | 0.8670 | 0.8379 |
78
+ | 0.1812 | 4.1739 | 1200 | 0.5643 | 0.8643 | 0.8342 |
79
+ | 0.1812 | 4.3478 | 1250 | 0.5783 | 0.8622 | 0.8326 |
80
+ | 0.1812 | 4.5217 | 1300 | 0.5909 | 0.8565 | 0.8273 |
81
 
82
 
83
  ### Framework versions
84
 
85
  - Transformers 4.41.2
86
  - Pytorch 2.3.0+cu121
87
+ - Datasets 2.19.2
88
  - Tokenizers 0.19.1
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f562e1bcb56c189d1bc62a3202a599fee739cdcab7842d875f0628e084c71477
3
  size 439039996
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e02074c2abcf0c11748e509b07c34a4c183f8fa4b3017cfec548fc5d09744de5
3
  size 439039996
runs/Jun04_05-52-50_2633a01a23c9/events.out.tfevents.1717480376.2633a01a23c9.2417.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:79f748fc5edad64bfe224cc1075c7b88ce60eac646e34d501c3397740aff9e89
3
+ size 15396
runs/Jun04_05-52-50_2633a01a23c9/events.out.tfevents.1717481127.2633a01a23c9.2417.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7b53cc2872a4d925940ed99366e544e6cda45ad51f46ed6965a376cb6f82cf47
3
+ size 457
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:d3c3bf052b5a73236454a135cb4dae5c75df870e0c318f2aa12545f70e16ba97
3
  size 5112
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:15f88f6ee409296c52084a1774ad78e4909045ca692d0ba80f77cc9b9b449c0c
3
  size 5112