Hugging Face's logo

lucienbaumgartner
/
PAG-annotation

Text Classification
setfit
Safetensors
sentence-transformers
mpnet
generated_from_setfit_trainer
Eval Results (legacy)
Model card Files
xet
Community
lucienbaumgartner commited on
Commit
5566b88
·
verified ·
1 Parent(s): 17a99ae

Add SetFit model

Browse files
Files changed (4) hide show
  1. README.md +25 -38
  2. config.json +1 -1
  3. model.safetensors +1 -1
  4. model_head.pkl +1 -1
README.md CHANGED
@@ -9,11 +9,12 @@ base_model: sentence-transformers/all-MiniLM-L6-v2
9
  metrics:
10
  - accuracy
11
  widget:
12
- - text: It’s amazing how video games can create whole worlds out of nothing.
13
- - text: Watching a skilled skateboarder nail a tough trick is super cool.
14
- - text: Thanks a lot for the coffee.
15
  - text: Hats off to the design team.
16
- - text: It's a relief to know that we live in a country with a great healthcare system.
 
 
 
17
  pipeline_tag: text-classification
18
  inference: false
19
  model-index:
@@ -28,7 +29,7 @@ model-index:
28
  split: test
29
  metrics:
30
  - type: accuracy
31
- value: 0.5
32
  name: Accuracy
33
  ---
34
 
@@ -64,7 +65,7 @@ The model has been trained using an efficient few-shot learning technique that i
64
  ### Metrics
65
  | Label | Accuracy |
66
  |:--------|:---------|
67
- | **all** | 0.5 |
68
 
69
  ## Uses
70
 
@@ -84,7 +85,7 @@ from setfit import SetFitModel
84
  # Download from the 🤗 Hub
85
  model = SetFitModel.from_pretrained("setfit_model_id")
86
  # Run inference
87
- preds = model("Thanks a lot for the coffee.")
88
  ```
89
 
90
  <!--
@@ -116,7 +117,7 @@ preds = model("Thanks a lot for the coffee.")
116
  ### Training Set Metrics
117
  | Training set | Min | Median | Max |
118
  |:-------------|:----|:--------|:----|
119
- | Word count | 6 | 10.8182 | 15 |
120
 
121
  ### Training Hyperparameters
122
  - batch_size: (16, 2)
@@ -136,36 +137,22 @@ preds = model("Thanks a lot for the coffee.")
136
  - load_best_model_at_end: True
137
 
138
  ### Training Results
139
- | Epoch | Step | Training Loss | Validation Loss |
140
- |:-------:|:-------:|:-------------:|:---------------:|
141
- | 0.0556 | 1 | 0.2571 | - |
142
- | 1.0 | 18 | - | 0.1809 |
143
- | 2.0 | 36 | - | 0.1719 |
144
- | 2.7778 | 50 | 0.1491 | - |
145
- | 3.0 | 54 | - | 0.1551 |
146
- | 4.0 | 72 | - | 0.1471 |
147
- | 5.0 | 90 | - | 0.1512 |
148
- | 5.5556 | 100 | 0.0502 | - |
149
- | 6.0 | 108 | - | 0.1461 |
150
- | 7.0 | 126 | - | 0.1441 |
151
- | 8.0 | 144 | - | 0.1384 |
152
- | 8.3333 | 150 | 0.0523 | - |
153
- | **9.0** | **162** | **-** | **0.1265** |
154
- | 10.0 | 180 | - | 0.144 |
155
- | 0.0556 | 1 | 0.0395 | - |
156
- | 1.0 | 18 | - | 0.1235 |
157
- | 2.0 | 36 | - | 0.1493 |
158
- | 2.7778 | 50 | 0.0289 | - |
159
- | 3.0 | 54 | - | 0.1443 |
160
- | 4.0 | 72 | - | 0.1304 |
161
- | 5.0 | 90 | - | 0.148 |
162
- | 5.5556 | 100 | 0.0238 | - |
163
- | 6.0 | 108 | - | 0.1426 |
164
- | 7.0 | 126 | - | 0.1442 |
165
- | 8.0 | 144 | - | 0.1488 |
166
- | 8.3333 | 150 | 0.034 | - |
167
- | **9.0** | **162** | **-** | **0.1184** |
168
- | 10.0 | 180 | - | 0.1575 |
169
 
170
  * The bold row denotes the saved checkpoint.
171
  ### Framework Versions
 
9
  metrics:
10
  - accuracy
11
  widget:
12
+ - text: Warm thanks to the volunteers who dedicated their time this weekend.
 
 
13
  - text: Hats off to the design team.
14
+ - text: Your assistance with the move was invaluable; I couldn’t have managed without
15
+ you.
16
+ - text: How heartwarming it is to see communities come together in times of need.
17
+ - text: Well done on orchestrating such a seamless event!
18
  pipeline_tag: text-classification
19
  inference: false
20
  model-index:
 
29
  split: test
30
  metrics:
31
  - type: accuracy
32
+ value: 0.2857142857142857
33
  name: Accuracy
34
  ---
35
 
 
65
  ### Metrics
66
  | Label | Accuracy |
67
  |:--------|:---------|
68
+ | **all** | 0.2857 |
69
 
70
  ## Uses
71
 
 
85
  # Download from the 🤗 Hub
86
  model = SetFitModel.from_pretrained("setfit_model_id")
87
  # Run inference
88
+ preds = model("Hats off to the design team.")
89
  ```
90
 
91
  <!--
 
117
  ### Training Set Metrics
118
  | Training set | Min | Median | Max |
119
  |:-------------|:----|:--------|:----|
120
+ | Word count | 6 | 10.8571 | 16 |
121
 
122
  ### Training Hyperparameters
123
  - batch_size: (16, 2)
 
137
  - load_best_model_at_end: True
138
 
139
  ### Training Results
140
+ | Epoch | Step | Training Loss | Validation Loss |
141
+ |:-------:|:------:|:-------------:|:---------------:|
142
+ | 0.0556 | 1 | 0.3535 | - |
143
+ | **1.0** | **18** | **-** | **0.1724** |
144
+ | 2.0 | 36 | - | 0.1963 |
145
+ | 2.7778 | 50 | 0.1636 | - |
146
+ | 3.0 | 54 | - | 0.1957 |
147
+ | 4.0 | 72 | - | 0.2116 |
148
+ | 5.0 | 90 | - | 0.2175 |
149
+ | 5.5556 | 100 | 0.053 | - |
150
+ | 6.0 | 108 | - | 0.2282 |
151
+ | 7.0 | 126 | - | 0.2368 |
152
+ | 8.0 | 144 | - | 0.2413 |
153
+ | 8.3333 | 150 | 0.0167 | - |
154
+ | 9.0 | 162 | - | 0.2451 |
155
+ | 10.0 | 180 | - | 0.2462 |
 
 
 
 
 
 
 
 
 
 
 
 
 
 
156
 
157
  * The bold row denotes the saved checkpoint.
158
  ### Framework Versions
config.json CHANGED
@@ -1,5 +1,5 @@
1
  {
2
- "_name_or_path": "checkpoints/step_162",
3
  "architectures": [
4
  "BertModel"
5
  ],
 
1
  {
2
+ "_name_or_path": "checkpoints/step_18",
3
  "architectures": [
4
  "BertModel"
5
  ],
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f47280e874812c656e06ff287893d228354c769985fc003752d786edb464b9b7
3
  size 90864192
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:894e848767bdac3ecbba5b1a640959840698602b7bb511e88f9b538fe4a7f8b7
3
  size 90864192
model_head.pkl CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:9b9b467b3c6d4da8d98a6226f68405f01bbc96af5ce163bb43a5efa41e3f7518
3
  size 11105
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:013ff19d5a490708f234cd692605bcfc026edc7d95fed9983e281b1af4441543
3
  size 11105