MultiPRIDE-DualEncoder-MainStage-es

README.md

@@ -20,11 +20,11 @@ should probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [cardiffnlp/twitter-xlm-roberta-base-hate-spanish](https://huggingface.co/cardiffnlp/twitter-xlm-roberta-base-hate-spanish) on the None dataset.
 It achieves the following results on the evaluation set:
-- Loss: 0.3704
-- Accuracy: 0.8333
-- F1: 0.56
-- Precision: 0.4667
-- Recall: 0.7
+- Loss: 0.4609
+- Accuracy: 0.8409
+- F1: 0.5532
+- Precision: 0.4815
+- Recall: 0.65
 
 ## Model description
 
@@ -46,7 +46,7 @@ The following hyperparameters were used during training:
 - learning_rate: 2e-05
 - train_batch_size: 8
 - eval_batch_size: 8
-- seed: 42
+- seed: 67
 - optimizer: Use adamw_torch_fused with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
 - lr_scheduler_type: linear
 - num_epochs: 10
@@ -55,12 +55,14 @@ The following hyperparameters were used during training:
 
 | Training Loss | Epoch | Step | Validation Loss | Accuracy | F1     | Precision | Recall |
 |:-------------:|:-----:|:----:|:---------------:|:--------:|:------:|:---------:|:------:|
-| 0.6609        | 1.0   | 77   | 0.5098          | 0.8636   | 0.5714 | 0.5455    | 0.6    |
-| 0.5878        | 2.0   | 154  | 0.4235          | 0.8258   | 0.5818 | 0.4571    | 0.8    |
-| 0.5223        | 3.0   | 231  | 0.3988          | 0.8561   | 0.5957 | 0.5185    | 0.7    |
-| 0.4915        | 4.0   | 308  | 0.3783          | 0.8409   | 0.5714 | 0.4828    | 0.7    |
-| 0.4787        | 5.0   | 385  | 0.3764          | 0.8333   | 0.5926 | 0.4706    | 0.8    |
-| 0.4287        | 6.0   | 462  | 0.3704          | 0.8333   | 0.56   | 0.4667    | 0.7    |
+| 0.6799        | 1.0   | 77   | 0.6352          | 0.7879   | 0.3636 | 0.3333    | 0.4    |
+| 0.5849        | 2.0   | 154  | 0.5760          | 0.8258   | 0.3784 | 0.4118    | 0.35   |
+| 0.5354        | 3.0   | 231  | 0.5289          | 0.8106   | 0.5098 | 0.4194    | 0.65   |
+| 0.4986        | 4.0   | 308  | 0.4998          | 0.7879   | 0.5333 | 0.4       | 0.8    |
+| 0.4482        | 5.0   | 385  | 0.4677          | 0.8333   | 0.56   | 0.4667    | 0.7    |
+| 0.4401        | 6.0   | 462  | 0.4600          | 0.8333   | 0.5417 | 0.4643    | 0.65   |
+| 0.406         | 7.0   | 539  | 0.4643          | 0.8333   | 0.56   | 0.4667    | 0.7    |
+| 0.4508        | 8.0   | 616  | 0.4609          | 0.8409   | 0.5532 | 0.4815    | 0.65   |
 
 
 ### Framework versions

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:7bc18304ab297fc349423cc6112aa48b6fd6644026403b42c019539ad4e50292
+oid sha256:962c51159f23be8b71a35999b2cc72c191400d6477060fe3bf9d5f0242bc8d1c
 size 1115770572

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:9c92072f74663a9427f16d32e7d568fb8fa0f79676330af7ff644fd0d98c5831
+oid sha256:e6bae610ef8f01a1c468077975be8a042c2da63cf5226dab1a21efff92f3d350
 size 5969