MultiPRIDE-LGBT-Pretrain-it

README.md

@@ -4,6 +4,11 @@ license: apache-2.0
 base_model: nickprock/setfit-italian-hate-speech
 tags:
 - generated_from_trainer
+metrics:
+- accuracy
+- f1
+- precision
+- recall
 model-index:
 - name: MultiPRIDE-LGBT-Pretrain-it
   results: []
@@ -15,6 +20,12 @@ should probably proofread and complete it, then remove this comment. -->
 # MultiPRIDE-LGBT-Pretrain-it
 
 This model is a fine-tuned version of [nickprock/setfit-italian-hate-speech](https://huggingface.co/nickprock/setfit-italian-hate-speech) on the None dataset.
+It achieves the following results on the evaluation set:
+- Loss: 1.5823
+- Accuracy: 0.7485
+- F1: 0.8019
+- Precision: 0.7685
+- Recall: 0.8384
 
 ## Model description
 
@@ -36,11 +47,23 @@ The following hyperparameters were used during training:
 - learning_rate: 2e-05
 - train_batch_size: 8
 - eval_batch_size: 8
-- seed: 85
+- seed: 42
 - optimizer: Use adamw_torch_fused with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
 - lr_scheduler_type: linear
 - num_epochs: 10
 
+### Training results
+
+| Training Loss | Epoch | Step | Validation Loss | Accuracy | F1     | Precision | Recall |
+|:-------------:|:-----:|:----:|:---------------:|:--------:|:------:|:---------:|:------:|
+| 0.6628        | 1.0   | 95   | 0.5273          | 0.7669   | 0.8061 | 0.8144    | 0.7980 |
+| 0.4475        | 2.0   | 190  | 0.6957          | 0.6074   | 0.5676 | 0.8571    | 0.4242 |
+| 0.4579        | 3.0   | 285  | 0.8143          | 0.7669   | 0.8319 | 0.7402    | 0.9495 |
+| 0.2833        | 4.0   | 380  | 0.9317          | 0.7485   | 0.7940 | 0.79      | 0.7980 |
+| 0.1283        | 5.0   | 475  | 1.4316          | 0.7485   | 0.8057 | 0.7589    | 0.8586 |
+| 0.0539        | 6.0   | 570  | 1.5823          | 0.7485   | 0.8019 | 0.7685    | 0.8384 |
+
+
 ### Framework versions
 
 - Transformers 4.57.3

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:64a7e6e1cdd9e77972c592a21de1a644dec4a282c96d4c3bc9e7ec04ff79b432
+oid sha256:9815e32f82b73b115868e843c9436164ac8c28c76cd0e2607f4bc2db52453180
 size 439740408

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:3b29ddd8a29e87d850ff6ee3d9637dfd861624f8621b82daa3d389c9d48327a0
+oid sha256:f9aff3e3222df11efe3d42404d0eafa544d98a3fe444623527dae9a02c5d1a99
 size 5969