tybys
/

bert-base-banking77-pt2

Text Classification

Generated from Trainer

text-embeddings-inference

Model card Files Files and versions

Metrics Training metrics Community

tybys commited on Mar 20, 2025

Commit

c4dbfe0

·

verified ·

1 Parent(s): 2a00239

Model save

Files changed (1) hide show

README.md +6 -6

README.md CHANGED Viewed

@@ -18,8 +18,8 @@ should probably proofread and complete it, then remove this comment. -->
 This model is a fine-tuned version of [bert-base-uncased](https://huggingface.co/bert-base-uncased) on an unknown dataset.
 It achieves the following results on the evaluation set:
-- Loss: 0.2902
-- F1: 0.9348
 ## Model description
@@ -39,7 +39,7 @@ More information needed
 The following hyperparameters were used during training:
 - learning_rate: 5e-05
-- train_batch_size: 8
 - eval_batch_size: 8
 - seed: 42
 - optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
@@ -50,9 +50,9 @@ The following hyperparameters were used during training:
 | Training Loss | Epoch | Step | Validation Loss | F1     |
 |:-------------:|:-----:|:----:|:---------------:|:------:|
-| 0.7246        | 1.0   | 1251 | 0.6004          | 0.8708 |
-| 0.2434        | 2.0   | 2502 | 0.3234          | 0.9200 |
-| 0.1353        | 3.0   | 3753 | 0.2902          | 0.9348 |
 ### Framework versions

 This model is a fine-tuned version of [bert-base-uncased](https://huggingface.co/bert-base-uncased) on an unknown dataset.
 It achieves the following results on the evaluation set:
+- Loss: 0.3128
+- F1: 0.9280
 ## Model description
 The following hyperparameters were used during training:
 - learning_rate: 5e-05
+- train_batch_size: 16
 - eval_batch_size: 8
 - seed: 42
 - optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
 | Training Loss | Epoch | Step | Validation Loss | F1     |
 |:-------------:|:-----:|:----:|:---------------:|:------:|
+| 1.191         | 1.0   | 626  | 0.8699          | 0.8271 |
+| 0.3913        | 2.0   | 1252 | 0.3949          | 0.9160 |
+| 0.1848        | 3.0   | 1878 | 0.3128          | 0.9280 |
 ### Framework versions