MultiPRIDE-DualEncoder-LPFT-it

README.md

@@ -21,11 +21,11 @@ should probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [nickprock/setfit-italian-hate-speech](https://huggingface.co/nickprock/setfit-italian-hate-speech) on the None dataset.
 It achieves the following results on the evaluation set:
-- Loss: 0.0739
-- Accuracy: 0.8773
-- F1: 0.6774
-- Precision: 0.6774
-- Recall: 0.6774
+- Loss: 0.0258
+- Accuracy: 0.9202
+- F1: 0.8060
+- Precision: 0.75
+- Recall: 0.8710
 
 ## Model description
 
@@ -47,7 +47,7 @@ The following hyperparameters were used during training:
 - learning_rate: 2e-05
 - train_batch_size: 8
 - eval_batch_size: 8
-- seed: 68
+- seed: 42
 - optimizer: Use adamw_torch_fused with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
 - lr_scheduler_type: linear
 - num_epochs: 10
@@ -56,11 +56,16 @@ The following hyperparameters were used during training:
 
 | Training Loss | Epoch | Step | Validation Loss | Accuracy | F1     | Precision | Recall |
 |:-------------:|:-----:|:----:|:---------------:|:--------:|:------:|:---------:|:------:|
-| 0.1788        | 1.0   | 95   | 0.0812          | 0.8834   | 0.6667 | 0.7308    | 0.6129 |
-| 0.0527        | 2.0   | 190  | 0.0595          | 0.8896   | 0.7    | 0.7241    | 0.6774 |
-| 0.026         | 3.0   | 285  | 0.0712          | 0.8896   | 0.7    | 0.7241    | 0.6774 |
-| 0.0406        | 4.0   | 380  | 0.0708          | 0.8834   | 0.6885 | 0.7       | 0.6774 |
-| 0.0261        | 5.0   | 475  | 0.0739          | 0.8773   | 0.6774 | 0.6774    | 0.6774 |
+| 0.1876        | 1.0   | 95   | 0.1464          | 0.8037   | 0.3043 | 0.4667    | 0.2258 |
+| 0.1365        | 2.0   | 190  | 0.1072          | 0.8773   | 0.6667 | 0.6897    | 0.6452 |
+| 0.112         | 3.0   | 285  | 0.0677          | 0.8957   | 0.7302 | 0.7188    | 0.7419 |
+| 0.0535        | 4.0   | 380  | 0.0465          | 0.9141   | 0.7742 | 0.7742    | 0.7742 |
+| 0.036         | 5.0   | 475  | 0.0335          | 0.8957   | 0.7385 | 0.7059    | 0.7742 |
+| 0.0322        | 6.0   | 570  | 0.0299          | 0.9141   | 0.7879 | 0.7429    | 0.8387 |
+| 0.0239        | 7.0   | 665  | 0.0274          | 0.9202   | 0.8060 | 0.75      | 0.8710 |
+| 0.0275        | 8.0   | 760  | 0.0263          | 0.9202   | 0.8060 | 0.75      | 0.8710 |
+| 0.0289        | 9.0   | 855  | 0.0259          | 0.9202   | 0.8060 | 0.75      | 0.8710 |
+| 0.0206        | 10.0  | 950  | 0.0258          | 0.9202   | 0.8060 | 0.75      | 0.8710 |
 
 
 ### Framework versions

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:36665b0c0058a6cdf6d5161f2a17d18b60b44c7e46a008788c7eb22470fb43d0
+oid sha256:3f6ae44e96c27fb3e0cfebb87ea640b968661c726f7a3676d5b0db410a4bbfcd
 size 443306324

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:f1095230a378f35cd7fde43286f1d3dedc592afdb443e4a5de79a48270b89f4b
+oid sha256:d18f333459043645aa8879f45aef0eadf91e82cd2a6e431bad0fc2ecd578220f
 size 5969