Hugging Face's logo

lucienbaumgartner
/
MPexplanations

Text Classification
setfit
Safetensors
sentence-transformers
mpnet
generated_from_setfit_trainer
Eval Results (legacy)
text-embeddings-inference
Model card Files
xet
 Community
lucienbaumgartner commited on
Commit
24c3b54
·
verified ·
1 Parent(s): 33f87e7

Add SetFit model

Browse files
Files changed (4) hide show
  1. README.md +79 -18
  2. config_setfit.json +2 -2
  3. model.safetensors +1 -1
  4. model_head.pkl +1 -1
README.md CHANGED
@@ -34,16 +34,16 @@ model-index:
34
  split: test
35
  metrics:
36
  - type: accuracy
37
- value: 0.8421052631578947
38
  name: Accuracy
39
  - type: precision
40
- value: 0.8238095238095239
41
  name: Precision
42
  - type: recall
43
- value: 0.6436781609195402
44
  name: Recall
45
  - type: f1
46
- value: 0.6768796175575836
47
  name: F1
48
  ---
49
 
@@ -86,7 +86,7 @@ The model has been trained using an efficient few-shot learning technique that i
86
  ### Metrics
87
  | Label | Accuracy | Precision | Recall | F1 |
88
  |:--------|:---------|:----------|:-------|:-------|
89
- | **all** | 0.8421 | 0.8238 | 0.6437 | 0.6769 |
90
 
91
  ## Uses
92
 
@@ -148,7 +148,7 @@ preds = model("it contradicted itself")
148
 
149
  ### Training Hyperparameters
150
  - batch_size: (16, 16)
151
- - num_epochs: (2, 2)
152
  - max_steps: -1
153
  - sampling_strategy: oversampling
154
  - num_iterations: 20
@@ -169,21 +169,82 @@ preds = model("it contradicted itself")
169
  | Epoch | Step | Training Loss | Validation Loss |
170
  |:------:|:----:|:-------------:|:---------------:|
171
  | 0.0026 | 1 | 0.2637 | - |
172
- | 0.1316 | 50 | 0.2039 | - |
173
- | 0.2632 | 100 | 0.0495 | - |
174
- | 0.3947 | 150 | 0.0032 | - |
175
- | 0.5263 | 200 | 0.0022 | - |
176
- | 0.6579 | 250 | 0.0005 | - |
177
- | 0.7895 | 300 | 0.0005 | - |
178
- | 0.9211 | 350 | 0.002 | - |
179
- | 1.0526 | 400 | 0.0003 | - |
180
- | 1.1842 | 450 | 0.0012 | - |
181
- | 1.3158 | 500 | 0.0007 | - |
182
- | 1.4474 | 550 | 0.001 | - |
183
- | 1.5789 | 600 | 0.0004 | - |
184
  | 1.7105 | 650 | 0.0003 | - |
185
  | 1.8421 | 700 | 0.0002 | - |
186
  | 1.9737 | 750 | 0.0002 | - |
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
187
 
188
  ### Framework Versions
189
  - Python: 3.11.9
 
34
  split: test
35
  metrics:
36
  - type: accuracy
37
+ value: 0.8947368421052632
38
  name: Accuracy
39
  - type: precision
40
+ value: 0.9020833333333332
41
  name: Precision
42
  - type: recall
43
+ value: 0.6666666666666666
44
  name: Recall
45
  - type: f1
46
+ value: 0.7260307998012916
47
  name: F1
48
  ---
49
 
 
86
  ### Metrics
87
  | Label | Accuracy | Precision | Recall | F1 |
88
  |:--------|:---------|:----------|:-------|:-------|
89
+ | **all** | 0.8947 | 0.9021 | 0.6667 | 0.7260 |
90
 
91
  ## Uses
92
 
 
148
 
149
  ### Training Hyperparameters
150
  - batch_size: (16, 16)
151
+ - num_epochs: (10, 10)
152
  - max_steps: -1
153
  - sampling_strategy: oversampling
154
  - num_iterations: 20
 
169
  | Epoch | Step | Training Loss | Validation Loss |
170
  |:------:|:----:|:-------------:|:---------------:|
171
  | 0.0026 | 1 | 0.2637 | - |
172
+ | 0.1316 | 50 | 0.2322 | - |
173
+ | 0.2632 | 100 | 0.1836 | - |
174
+ | 0.3947 | 150 | 0.0803 | - |
175
+ | 0.5263 | 200 | 0.016 | - |
176
+ | 0.6579 | 250 | 0.0061 | - |
177
+ | 0.7895 | 300 | 0.0015 | - |
178
+ | 0.9211 | 350 | 0.0028 | - |
179
+ | 1.0526 | 400 | 0.0006 | - |
180
+ | 1.1842 | 450 | 0.002 | - |
181
+ | 1.3158 | 500 | 0.0013 | - |
182
+ | 1.4474 | 550 | 0.0012 | - |
183
+ | 1.5789 | 600 | 0.0003 | - |
184
  | 1.7105 | 650 | 0.0003 | - |
185
  | 1.8421 | 700 | 0.0002 | - |
186
  | 1.9737 | 750 | 0.0002 | - |
187
+ | 2.1053 | 800 | 0.0002 | - |
188
+ | 2.2368 | 850 | 0.0001 | - |
189
+ | 2.3684 | 900 | 0.0001 | - |
190
+ | 2.5 | 950 | 0.0001 | - |
191
+ | 2.6316 | 1000 | 0.0002 | - |
192
+ | 2.7632 | 1050 | 0.0001 | - |
193
+ | 2.8947 | 1100 | 0.0001 | - |
194
+ | 3.0263 | 1150 | 0.0001 | - |
195
+ | 3.1579 | 1200 | 0.0001 | - |
196
+ | 3.2895 | 1250 | 0.0001 | - |
197
+ | 3.4211 | 1300 | 0.0001 | - |
198
+ | 3.5526 | 1350 | 0.0001 | - |
199
+ | 3.6842 | 1400 | 0.0001 | - |
200
+ | 3.8158 | 1450 | 0.0001 | - |
201
+ | 3.9474 | 1500 | 0.0001 | - |
202
+ | 4.0789 | 1550 | 0.0001 | - |
203
+ | 4.2105 | 1600 | 0.0001 | - |
204
+ | 4.3421 | 1650 | 0.0001 | - |
205
+ | 4.4737 | 1700 | 0.0001 | - |
206
+ | 4.6053 | 1750 | 0.0001 | - |
207
+ | 4.7368 | 1800 | 0.0001 | - |
208
+ | 4.8684 | 1850 | 0.0001 | - |
209
+ | 5.0 | 1900 | 0.0001 | - |
210
+ | 5.1316 | 1950 | 0.0001 | - |
211
+ | 5.2632 | 2000 | 0.0001 | - |
212
+ | 5.3947 | 2050 | 0.0001 | - |
213
+ | 5.5263 | 2100 | 0.0001 | - |
214
+ | 5.6579 | 2150 | 0.0001 | - |
215
+ | 5.7895 | 2200 | 0.0001 | - |
216
+ | 5.9211 | 2250 | 0.0001 | - |
217
+ | 6.0526 | 2300 | 0.0001 | - |
218
+ | 6.1842 | 2350 | 0.0001 | - |
219
+ | 6.3158 | 2400 | 0.0001 | - |
220
+ | 6.4474 | 2450 | 0.0001 | - |
221
+ | 6.5789 | 2500 | 0.0001 | - |
222
+ | 6.7105 | 2550 | 0.0001 | - |
223
+ | 6.8421 | 2600 | 0.0004 | - |
224
+ | 6.9737 | 2650 | 0.0013 | - |
225
+ | 7.1053 | 2700 | 0.0001 | - |
226
+ | 7.2368 | 2750 | 0.0001 | - |
227
+ | 7.3684 | 2800 | 0.0001 | - |
228
+ | 7.5 | 2850 | 0.0001 | - |
229
+ | 7.6316 | 2900 | 0.0001 | - |
230
+ | 7.7632 | 2950 | 0.0001 | - |
231
+ | 7.8947 | 3000 | 0.0001 | - |
232
+ | 8.0263 | 3050 | 0.0001 | - |
233
+ | 8.1579 | 3100 | 0.0001 | - |
234
+ | 8.2895 | 3150 | 0.0001 | - |
235
+ | 8.4211 | 3200 | 0.0001 | - |
236
+ | 8.5526 | 3250 | 0.0001 | - |
237
+ | 8.6842 | 3300 | 0.0001 | - |
238
+ | 8.8158 | 3350 | 0.0001 | - |
239
+ | 8.9474 | 3400 | 0.0001 | - |
240
+ | 9.0789 | 3450 | 0.0001 | - |
241
+ | 9.2105 | 3500 | 0.0001 | - |
242
+ | 9.3421 | 3550 | 0.0 | - |
243
+ | 9.4737 | 3600 | 0.0001 | - |
244
+ | 9.6053 | 3650 | 0.0001 | - |
245
+ | 9.7368 | 3700 | 0.0 | - |
246
+ | 9.8684 | 3750 | 0.0 | - |
247
+ | 10.0 | 3800 | 0.0 | - |
248
 
249
  ### Framework Versions
250
  - Python: 3.11.9
config_setfit.json CHANGED
@@ -1,8 +1,8 @@
1
  {
2
- "normalize_embeddings": false,
3
  "labels": [
4
  "Enrichment / reinterpretation",
5
  "Lack of understanding / clear misunderstanding",
6
  "Linguistic (in)felicity"
7
- ]
 
8
  }
 
1
  {
 
2
  "labels": [
3
  "Enrichment / reinterpretation",
4
  "Lack of understanding / clear misunderstanding",
5
  "Linguistic (in)felicity"
6
+ ],
7
+ "normalize_embeddings": false
8
  }
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:4e434945caf6376493fe52ba65083ac22a0357d77d74c343dc08965155598f3c
3
  size 437967672
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8d10167c2f8e2fa6d9be0b7ad6a1ac478bf9f0991692e14c1873719dcd4de1d4
3
  size 437967672
model_head.pkl CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:6275f644da652b1528ce79f4ce30114a7650049e97202bd80acc3a6873c746ef
3
  size 19855
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cb06704b44ebcd040be5d1ddb17060d40357cace73ce6961774020a9d4cd9d53
3
  size 19855