Text Classification
Transformers
PyTorch
Arabic
bert
hate-speech
gender-based-violence
arabic
binary-classification
pilot
Eval Results (legacy)
text-embeddings-inference
Instructions to use thejosango/nuha-binary with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use thejosango/nuha-binary with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-classification", model="thejosango/nuha-binary")# Load model directly from transformers import AutoTokenizer, AutoModelForSequenceClassification tokenizer = AutoTokenizer.from_pretrained("thejosango/nuha-binary") model = AutoModelForSequenceClassification.from_pretrained("thejosango/nuha-binary") - Notebooks
- Google Colab
- Kaggle
binary-26
Browse files- README.md +33 -31
- config.toml +2 -2
- pytorch_model.bin +1 -1
- training_args.bin +1 -1
README.md
CHANGED
|
@@ -23,13 +23,13 @@ model-index:
|
|
| 23 |
metrics:
|
| 24 |
- name: F1
|
| 25 |
type: f1
|
| 26 |
-
value: 0.
|
| 27 |
- name: Precision
|
| 28 |
type: precision
|
| 29 |
-
value: 0.
|
| 30 |
- name: Recall
|
| 31 |
type: recall
|
| 32 |
-
value: 0.
|
| 33 |
---
|
| 34 |
|
| 35 |
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
|
|
@@ -39,10 +39,10 @@ should probably proofread and complete it, then remove this comment. -->
|
|
| 39 |
|
| 40 |
This model is a fine-tuned version of [thejosango/nuha-mlm](https://huggingface.co/thejosango/nuha-mlm) on the nuha-dataset dataset.
|
| 41 |
It achieves the following results on the evaluation set:
|
| 42 |
-
- Loss: 0.
|
| 43 |
-
- F1: 0.
|
| 44 |
-
- Precision: 0.
|
| 45 |
-
- Recall: 0.
|
| 46 |
- Support: None
|
| 47 |
|
| 48 |
## Model description
|
|
@@ -78,30 +78,32 @@ The following hyperparameters were used during training:
|
|
| 78 |
|
| 79 |
| Training Loss | Epoch | Step | Validation Loss | F1 | Precision | Recall | Support |
|
| 80 |
|:-------------:|:-----:|:-----:|:---------------:|:------:|:---------:|:------:|:-------:|
|
| 81 |
-
| 1.
|
| 82 |
-
| 0.
|
| 83 |
-
| 0.
|
| 84 |
-
| 0.
|
| 85 |
-
| 0.
|
| 86 |
-
| 0.
|
| 87 |
-
| 0.
|
| 88 |
-
| 0.
|
| 89 |
-
| 0.
|
| 90 |
-
| 0.
|
| 91 |
-
| 0.
|
| 92 |
-
| 0.
|
| 93 |
-
| 0.
|
| 94 |
-
| 0.
|
| 95 |
-
| 0.
|
| 96 |
-
| 0.
|
| 97 |
-
| 0.
|
| 98 |
-
| 0.
|
| 99 |
-
| 0.
|
| 100 |
-
| 0.
|
| 101 |
-
| 0.
|
| 102 |
-
| 0.
|
| 103 |
-
| 0.
|
| 104 |
-
| 0.
|
|
|
|
|
|
|
| 105 |
|
| 106 |
|
| 107 |
### Framework versions
|
|
|
|
| 23 |
metrics:
|
| 24 |
- name: F1
|
| 25 |
type: f1
|
| 26 |
+
value: 0.6709883502442691
|
| 27 |
- name: Precision
|
| 28 |
type: precision
|
| 29 |
+
value: 0.6826610590709233
|
| 30 |
- name: Recall
|
| 31 |
type: recall
|
| 32 |
+
value: 0.6597081101053021
|
| 33 |
---
|
| 34 |
|
| 35 |
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
|
|
|
|
| 39 |
|
| 40 |
This model is a fine-tuned version of [thejosango/nuha-mlm](https://huggingface.co/thejosango/nuha-mlm) on the nuha-dataset dataset.
|
| 41 |
It achieves the following results on the evaluation set:
|
| 42 |
+
- Loss: 0.5203
|
| 43 |
+
- F1: 0.6710
|
| 44 |
+
- Precision: 0.6827
|
| 45 |
+
- Recall: 0.6597
|
| 46 |
- Support: None
|
| 47 |
|
| 48 |
## Model description
|
|
|
|
| 78 |
|
| 79 |
| Training Loss | Epoch | Step | Validation Loss | F1 | Precision | Recall | Support |
|
| 80 |
|:-------------:|:-----:|:-----:|:---------------:|:------:|:---------:|:------:|:-------:|
|
| 81 |
+
| 1.2252 | 0.23 | 500 | 0.6446 | 0.5213 | 0.6006 | 0.4606 | None |
|
| 82 |
+
| 0.8851 | 0.46 | 1000 | 0.5788 | 0.6011 | 0.6123 | 0.5904 | None |
|
| 83 |
+
| 0.7632 | 0.7 | 1500 | 0.5560 | 0.5957 | 0.6485 | 0.5509 | None |
|
| 84 |
+
| 0.684 | 0.93 | 2000 | 0.5481 | 0.6076 | 0.6506 | 0.5699 | None |
|
| 85 |
+
| 0.6334 | 1.16 | 2500 | 0.6265 | 0.6462 | 0.5199 | 0.8535 | None |
|
| 86 |
+
| 0.6137 | 1.39 | 3000 | 0.5378 | 0.5593 | 0.7224 | 0.4563 | None |
|
| 87 |
+
| 0.609 | 1.63 | 3500 | 0.5348 | 0.6486 | 0.6499 | 0.6473 | None |
|
| 88 |
+
| 0.5756 | 1.86 | 4000 | 0.5272 | 0.6182 | 0.6966 | 0.5557 | None |
|
| 89 |
+
| 0.5667 | 2.09 | 4500 | 0.5257 | 0.6035 | 0.7194 | 0.5197 | None |
|
| 90 |
+
| 0.5551 | 2.32 | 5000 | 0.5193 | 0.6456 | 0.6837 | 0.6115 | None |
|
| 91 |
+
| 0.5549 | 2.56 | 5500 | 0.5173 | 0.6236 | 0.7191 | 0.5505 | None |
|
| 92 |
+
| 0.5507 | 2.79 | 6000 | 0.5279 | 0.6675 | 0.6542 | 0.6813 | None |
|
| 93 |
+
| 0.5505 | 3.02 | 6500 | 0.5164 | 0.6534 | 0.6916 | 0.6192 | None |
|
| 94 |
+
| 0.5298 | 3.25 | 7000 | 0.5232 | 0.6687 | 0.6628 | 0.6747 | None |
|
| 95 |
+
| 0.5313 | 3.49 | 7500 | 0.5128 | 0.6603 | 0.6934 | 0.6303 | None |
|
| 96 |
+
| 0.5209 | 3.72 | 8000 | 0.5285 | 0.6800 | 0.6513 | 0.7113 | None |
|
| 97 |
+
| 0.5214 | 3.95 | 8500 | 0.5127 | 0.6443 | 0.7128 | 0.5878 | None |
|
| 98 |
+
| 0.5033 | 4.18 | 9000 | 0.5179 | 0.6341 | 0.7268 | 0.5623 | None |
|
| 99 |
+
| 0.5055 | 4.41 | 9500 | 0.5214 | 0.6239 | 0.7347 | 0.5422 | None |
|
| 100 |
+
| 0.5013 | 4.65 | 10000 | 0.5230 | 0.6794 | 0.6626 | 0.6972 | None |
|
| 101 |
+
| 0.5107 | 4.88 | 10500 | 0.5127 | 0.6656 | 0.7012 | 0.6335 | None |
|
| 102 |
+
| 0.4862 | 5.11 | 11000 | 0.5447 | 0.5848 | 0.7670 | 0.4726 | None |
|
| 103 |
+
| 0.4814 | 5.34 | 11500 | 0.5216 | 0.6217 | 0.7386 | 0.5367 | None |
|
| 104 |
+
| 0.4877 | 5.58 | 12000 | 0.5176 | 0.6375 | 0.7255 | 0.5684 | None |
|
| 105 |
+
| 0.4893 | 5.81 | 12500 | 0.5180 | 0.6463 | 0.7129 | 0.5912 | None |
|
| 106 |
+
| 0.4779 | 6.04 | 13000 | 0.5203 | 0.6710 | 0.6827 | 0.6597 | None |
|
| 107 |
|
| 108 |
|
| 109 |
### Framework versions
|
config.toml
CHANGED
|
@@ -1,5 +1,5 @@
|
|
| 1 |
[experiment]
|
| 2 |
-
name = "binary-
|
| 3 |
type = "binary"
|
| 4 |
|
| 5 |
|
|
@@ -7,7 +7,7 @@ type = "binary"
|
|
| 7 |
path = "thejosango/nuha-dataset"
|
| 8 |
dataset_revision = "main"
|
| 9 |
augment_ratio = 0.25
|
| 10 |
-
undersampling_strategy =
|
| 11 |
|
| 12 |
|
| 13 |
[model]
|
|
|
|
| 1 |
[experiment]
|
| 2 |
+
name = "binary-26"
|
| 3 |
type = "binary"
|
| 4 |
|
| 5 |
|
|
|
|
| 7 |
path = "thejosango/nuha-dataset"
|
| 8 |
dataset_revision = "main"
|
| 9 |
augment_ratio = 0.25
|
| 10 |
+
undersampling_strategy = 0
|
| 11 |
|
| 12 |
|
| 13 |
[model]
|
pytorch_model.bin
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 313992076
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:6274d0bde584699734a00b2cd752b54dcaf69e5a4753cab991977f54ca510145
|
| 3 |
size 313992076
|
training_args.bin
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 4091
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:0cc61a0a4012cb94dd109030c3f0bc5d60b87d98e45eac45d39704943b4e479e
|
| 3 |
size 4091
|