Add SetFit model

README.md

@@ -24,9 +24,8 @@ metrics:
 pipeline_tag: text-classification
 library_name: setfit
 inference: true
-base_model: sentence-transformers/paraphrase-mpnet-base-v2
 model-index:
-- name: SetFit with sentence-transformers/paraphrase-mpnet-base-v2
+- name: SetFit
   results:
   - task:
       type: text-classification
@@ -37,22 +36,22 @@ model-index:
       split: test
     metrics:
     - type: accuracy
-      value: 0.9473684210526315
+      value: 0.9210526315789473
       name: Accuracy
     - type: precision
-      value: 0.962962962962963
+      value: 0.9198717948717949
       name: Precision
     - type: recall
-      value: 0.9230769230769231
+      value: 0.9030769230769231
       name: Recall
     - type: f1
-      value: 0.9391025641025641
+      value: 0.9105882352941177
       name: F1
 ---
 
-# SetFit with sentence-transformers/paraphrase-mpnet-base-v2
+# SetFit
 
-This is a [SetFit](https://github.com/huggingface/setfit) model that can be used for Text Classification. This SetFit model uses [sentence-transformers/paraphrase-mpnet-base-v2](https://huggingface.co/sentence-transformers/paraphrase-mpnet-base-v2) as the Sentence Transformer embedding model. A [LogisticRegression](https://scikit-learn.org/stable/modules/generated/sklearn.linear_model.LogisticRegression.html) instance is used for classification.
+This is a [SetFit](https://github.com/huggingface/setfit) model that can be used for Text Classification. A [LogisticRegression](https://scikit-learn.org/stable/modules/generated/sklearn.linear_model.LogisticRegression.html) instance is used for classification.
 
 The model has been trained using an efficient few-shot learning technique that involves:
 
@@ -63,7 +62,7 @@ The model has been trained using an efficient few-shot learning technique that i
 
 ### Model Description
 - **Model Type:** SetFit
-- **Sentence Transformer body:** [sentence-transformers/paraphrase-mpnet-base-v2](https://huggingface.co/sentence-transformers/paraphrase-mpnet-base-v2)
+<!-- - **Sentence Transformer:** [Unknown](https://huggingface.co/unknown) -->
 - **Classification head:** a [LogisticRegression](https://scikit-learn.org/stable/modules/generated/sklearn.linear_model.LogisticRegression.html) instance
 - **Maximum Sequence Length:** 512 tokens
 - **Number of Classes:** 3 classes
@@ -89,7 +88,7 @@ The model has been trained using an efficient few-shot learning technique that i
 ### Metrics
 | Label   | Accuracy | Precision | Recall | F1     |
 |:--------|:---------|:----------|:-------|:-------|
-| **all** | 0.9474   | 0.9630    | 0.9231 | 0.9391 |
+| **all** | 0.9211   | 0.9199    | 0.9031 | 0.9106 |
 
 ## Uses
 
@@ -176,10 +175,10 @@ preds = model("it made sense because it is tom's opinion that cyberbullying is n
 | 0.2632 | 100  | 0.1707        | -               |
 | 0.3947 | 150  | 0.0839        | -               |
 | 0.5263 | 200  | 0.0335        | -               |
-| 0.6579 | 250  | 0.014         | -               |
-| 0.7895 | 300  | 0.0074        | -               |
-| 0.9211 | 350  | 0.0024        | -               |
-| 1.0526 | 400  | 0.0007        | -               |
+| 0.6579 | 250  | 0.0141        | -               |
+| 0.7895 | 300  | 0.0072        | -               |
+| 0.9211 | 350  | 0.0026        | -               |
+| 1.0526 | 400  | 0.0008        | -               |
 | 1.1842 | 450  | 0.0006        | -               |
 | 1.3158 | 500  | 0.0004        | -               |
 | 1.4474 | 550  | 0.0002        | -               |
@@ -188,7 +187,7 @@ preds = model("it made sense because it is tom's opinion that cyberbullying is n
 | 1.8421 | 700  | 0.0002        | -               |
 | 1.9737 | 750  | 0.0002        | -               |
 | 2.1053 | 800  | 0.0002        | -               |
-| 2.2368 | 850  | 0.0001        | -               |
+| 2.2368 | 850  | 0.0002        | -               |
 | 2.3684 | 900  | 0.0001        | -               |
 | 2.5    | 950  | 0.0001        | -               |
 | 2.6316 | 1000 | 0.0001        | -               |
@@ -202,14 +201,14 @@ preds = model("it made sense because it is tom's opinion that cyberbullying is n
 | 3.6842 | 1400 | 0.0001        | -               |
 | 3.8158 | 1450 | 0.0001        | -               |
 | 3.9474 | 1500 | 0.0001        | -               |
-| 4.0789 | 1550 | 0.0001        | -               |
+| 4.0789 | 1550 | 0.0002        | -               |
 | 4.2105 | 1600 | 0.0001        | -               |
-| 4.3421 | 1650 | 0.0001        | -               |
+| 4.3421 | 1650 | 0.0033        | -               |
 | 4.4737 | 1700 | 0.0001        | -               |
-| 4.6053 | 1750 | 0.0001        | -               |
-| 4.7368 | 1800 | 0.0001        | -               |
-| 4.8684 | 1850 | 0.0001        | -               |
-| 5.0    | 1900 | 0.0001        | -               |
+| 4.6053 | 1750 | 0.0004        | -               |
+| 4.7368 | 1800 | 0.0035        | -               |
+| 4.8684 | 1850 | 0.0002        | -               |
+| 5.0    | 1900 | 0.0003        | -               |
 | 5.1316 | 1950 | 0.0001        | -               |
 | 5.2632 | 2000 | 0.0001        | -               |
 | 5.3947 | 2050 | 0.0001        | -               |
@@ -217,8 +216,8 @@ preds = model("it made sense because it is tom's opinion that cyberbullying is n
 | 5.6579 | 2150 | 0.0001        | -               |
 | 5.7895 | 2200 | 0.0001        | -               |
 | 5.9211 | 2250 | 0.0001        | -               |
-| 6.0526 | 2300 | 0.0003        | -               |
-| 6.1842 | 2350 | 0.0002        | -               |
+| 6.0526 | 2300 | 0.0001        | -               |
+| 6.1842 | 2350 | 0.0001        | -               |
 | 6.3158 | 2400 | 0.0001        | -               |
 | 6.4474 | 2450 | 0.0001        | -               |
 | 6.5789 | 2500 | 0.0001        | -               |

config_setfit.json

@@ -1,8 +1,8 @@
 {
-  "normalize_embeddings": false,
   "labels": [
     "Enrichment / reinterpretation",
     "Lack of understanding / clear misunderstanding",
     "Linguistic (in)felicity"
-  ]
+  ],
+  "normalize_embeddings": false
 }

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:a06af00e5ccdd651bbf4b7f078d9b3125040053a4947e75d6faea33491780df1
+oid sha256:1625837d71bc138f11bf50626777c6a9c2b957a36bff3cd9a1c3aa249cc74f92
 size 437967672

model_head.pkl

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:19cdea9af1224c1ce25726aee559a2df569c92ca51d777d30d47b80dec6494de
-size 19855
+oid sha256:9ef5aeaa81f2f1b263fe1cabd76a630e5a36ee60b89606afb19eef2e09ce148b
+size 10627