End of training
Browse files
README.md
CHANGED
|
@@ -17,9 +17,9 @@ should probably proofread and complete it, then remove this comment. -->
|
|
| 17 |
|
| 18 |
This model is a fine-tuned version of [ProsusAI/finbert](https://huggingface.co/ProsusAI/finbert) on an unknown dataset.
|
| 19 |
It achieves the following results on the evaluation set:
|
| 20 |
-
- Loss:
|
| 21 |
-
- Accuracy: 0.
|
| 22 |
-
- F1: 0.
|
| 23 |
|
| 24 |
## Model description
|
| 25 |
|
|
@@ -38,21 +38,43 @@ More information needed
|
|
| 38 |
### Training hyperparameters
|
| 39 |
|
| 40 |
The following hyperparameters were used during training:
|
| 41 |
-
- learning_rate:
|
| 42 |
-
- train_batch_size:
|
| 43 |
- eval_batch_size: 8
|
| 44 |
- seed: 42
|
| 45 |
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
|
| 46 |
- lr_scheduler_type: linear
|
| 47 |
-
-
|
|
|
|
| 48 |
|
| 49 |
### Training results
|
| 50 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 51 |
|
| 52 |
|
| 53 |
### Framework versions
|
| 54 |
|
| 55 |
-
- Transformers 4.
|
| 56 |
- Pytorch 2.1.0+cu121
|
| 57 |
-
- Datasets 2.
|
| 58 |
-
- Tokenizers 0.15.
|
|
|
|
| 17 |
|
| 18 |
This model is a fine-tuned version of [ProsusAI/finbert](https://huggingface.co/ProsusAI/finbert) on an unknown dataset.
|
| 19 |
It achieves the following results on the evaluation set:
|
| 20 |
+
- Loss: 0.3175
|
| 21 |
+
- Accuracy: 0.8890
|
| 22 |
+
- F1: 0.8878
|
| 23 |
|
| 24 |
## Model description
|
| 25 |
|
|
|
|
| 38 |
### Training hyperparameters
|
| 39 |
|
| 40 |
The following hyperparameters were used during training:
|
| 41 |
+
- learning_rate: 6.709451461670167e-05
|
| 42 |
+
- train_batch_size: 16
|
| 43 |
- eval_batch_size: 8
|
| 44 |
- seed: 42
|
| 45 |
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
|
| 46 |
- lr_scheduler_type: linear
|
| 47 |
+
- lr_scheduler_warmup_ratio: 0.1
|
| 48 |
+
- num_epochs: 3
|
| 49 |
|
| 50 |
### Training results
|
| 51 |
|
| 52 |
+
| Training Loss | Epoch | Step | Validation Loss | Accuracy | F1 |
|
| 53 |
+
|:-------------:|:-----:|:----:|:---------------:|:--------:|:------:|
|
| 54 |
+
| 0.5653 | 0.15 | 100 | 0.4640 | 0.8293 | 0.8162 |
|
| 55 |
+
| 0.5231 | 0.3 | 200 | 0.3839 | 0.8509 | 0.8542 |
|
| 56 |
+
| 0.4908 | 0.46 | 300 | 0.3755 | 0.8545 | 0.8580 |
|
| 57 |
+
| 0.4285 | 0.61 | 400 | 0.4072 | 0.8509 | 0.8562 |
|
| 58 |
+
| 0.4002 | 0.76 | 500 | 0.3370 | 0.8646 | 0.8672 |
|
| 59 |
+
| 0.3754 | 0.91 | 600 | 0.3175 | 0.8890 | 0.8878 |
|
| 60 |
+
| 0.3276 | 1.06 | 700 | 0.3481 | 0.8948 | 0.8931 |
|
| 61 |
+
| 0.2462 | 1.21 | 800 | 0.3259 | 0.8905 | 0.8909 |
|
| 62 |
+
| 0.2321 | 1.37 | 900 | 0.3405 | 0.8775 | 0.8801 |
|
| 63 |
+
| 0.2177 | 1.52 | 1000 | 0.3446 | 0.8941 | 0.8932 |
|
| 64 |
+
| 0.2467 | 1.67 | 1100 | 0.3743 | 0.8833 | 0.8854 |
|
| 65 |
+
| 0.189 | 1.82 | 1200 | 0.4024 | 0.8955 | 0.8955 |
|
| 66 |
+
| 0.2254 | 1.97 | 1300 | 0.3965 | 0.8869 | 0.8862 |
|
| 67 |
+
| 0.1129 | 2.12 | 1400 | 0.4883 | 0.8912 | 0.8928 |
|
| 68 |
+
| 0.0747 | 2.28 | 1500 | 0.4643 | 0.8984 | 0.8993 |
|
| 69 |
+
| 0.0984 | 2.43 | 1600 | 0.4820 | 0.9020 | 0.9025 |
|
| 70 |
+
| 0.0937 | 2.58 | 1700 | 0.4642 | 0.8991 | 0.8993 |
|
| 71 |
+
| 0.1109 | 2.73 | 1800 | 0.4563 | 0.8984 | 0.8994 |
|
| 72 |
+
| 0.084 | 2.88 | 1900 | 0.4441 | 0.9042 | 0.9046 |
|
| 73 |
|
| 74 |
|
| 75 |
### Framework versions
|
| 76 |
|
| 77 |
+
- Transformers 4.37.2
|
| 78 |
- Pytorch 2.1.0+cu121
|
| 79 |
+
- Datasets 2.17.1
|
| 80 |
+
- Tokenizers 0.15.2
|
model.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 437961724
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:ffe887031bbad7303c589e521962f71e8ea234623fe12c64dd5c3649b02c961a
|
| 3 |
size 437961724
|
runs/Feb26_02-17-25_c4e415ddba5b/events.out.tfevents.1708913846.c4e415ddba5b.1123.6
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:bbcbb3a72e60cba0ec12e374b622d224cd74ae0bd6f28284d635ebad78b3362b
|
| 3 |
+
size 14894
|
runs/Feb26_02-17-25_c4e415ddba5b/events.out.tfevents.1708914115.c4e415ddba5b.1123.7
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:b1e2457eb73dce2b2551ef69eaa2667b3bc83bd4ca22fffecc4652e945e70ad0
|
| 3 |
+
size 457
|