Hugging Face's logo

sarahahtee
/
classification-flan-t5-large-enriched

PEFT
TensorBoard
Safetensors
Generated from Trainer
Model card Files
xet
 Metrics Community
Sarah Tariq commited on
Commit
9fcd74e
·
verified ·
1 Parent(s): aa2b314

End of training

Browse files
Files changed (4) hide show
  1. README.md +671 -0
  2. adapter_model.safetensors +1 -1
  3. runs/Feb25_00-53-00_1e8b32681ac6/events.out.tfevents.1708822394.1e8b32681ac6.1379.0 +2 -2
  4. tokenizer.json +1 -6
README.md ADDED
@@ -0,0 +1,671 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ library_name: peft
4
+ tags:
5
+ - generated_from_trainer
6
+ base_model: google/flan-t5-large
7
+ model-index:
8
+ - name: classification-flan-t5-large-enriched
9
+ results: []
10
+ ---
11
+
12
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
13
+ should probably proofread and complete it, then remove this comment. -->
14
+
15
+ # classification-flan-t5-large-enriched
16
+
17
+ This model is a fine-tuned version of [google/flan-t5-large](https://huggingface.co/google/flan-t5-large) on an unknown dataset.
18
+ It achieves the following results on the evaluation set:
19
+ - Loss: 0.3456
20
+ - Classification Report: precision recall f1-score support
21
+
22
+ ALLERGY 1.0000 0.2500 0.4000 4
23
+ ASSESSMENT 0.0000 0.0000 0.0000 4
24
+ CC 0.2000 0.5000 0.2857 4
25
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
26
+ DISPOSITION 0.0000 0.0000 0.0000 2
27
+ EDCOURSE 0.0000 0.0000 0.0000 3
28
+ EVALUATIONS 0.0000 0.0000 0.0000 0
29
+ EXAM 0.0000 0.0000 0.0000 1
30
+ FAM/SOCHX 0.9130 0.9545 0.9333 22
31
+ GENHX 0.5926 0.8000 0.6809 20
32
+ GYNHX 0.0000 0.0000 0.0000 1
33
+ IMAGING 0.0000 0.0000 0.0000 1
34
+ IMMUNIZATIONS 1.0000 1.0000 1.0000 1
35
+ LABS 0.0000 0.0000 0.0000 1
36
+ MEDICATIONS 0.7778 1.0000 0.8750 7
37
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
38
+ PASTMEDICALHX 0.4000 1.0000 0.5714 4
39
+ PASTSURGICAL 1.0000 1.0000 1.0000 8
40
+ PLAN 0.6667 0.6667 0.6667 3
41
+ PROCEDURES 0.0000 0.0000 0.0000 1
42
+ ROS 0.7500 0.2727 0.4000 11
43
+
44
+ accuracy 0.6500 100
45
+ macro avg 0.3476 0.3545 0.3244 100
46
+ weighted avg 0.6303 0.6500 0.6070 100
47
+
48
+
49
+ ## Model description
50
+
51
+ More information needed
52
+
53
+ ## Intended uses & limitations
54
+
55
+ More information needed
56
+
57
+ ## Training and evaluation data
58
+
59
+ More information needed
60
+
61
+ ## Training procedure
62
+
63
+ ### Training hyperparameters
64
+
65
+ The following hyperparameters were used during training:
66
+ - learning_rate: 0.0001
67
+ - train_batch_size: 7
68
+ - eval_batch_size: 7
69
+ - seed: 42
70
+ - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
71
+ - lr_scheduler_type: linear
72
+ - num_epochs: 20
73
+
74
+ ### Training results
75
+
76
+ | Training Loss | Epoch | Step | Validation Loss | Classification Report |
77
+ |:-------------:|:-----:|:----:|:---------------:|:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------:|
78
+ | No log | 1.0 | 172 | 1.2904 | precision recall f1-score support
79
+
80
+ ALLERGY 0.0000 0.0000 0.0000 4
81
+ ASSESSMENT 0.0000 0.0000 0.0000 4
82
+ CC 0.0000 0.0000 0.0000 4
83
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
84
+ DISPOSITION 0.0000 0.0000 0.0000 2
85
+ EDCOURSE 0.0000 0.0000 0.0000 3
86
+ EXAM 0.0000 0.0000 0.0000 1
87
+ FAM/SOCHX 0.5000 0.1818 0.2667 22
88
+ Follow-up 0.0000 0.0000 0.0000 0
89
+ GENHX 0.1948 0.7500 0.3093 20
90
+ GYNHX 0.0000 0.0000 0.0000 1
91
+ HEALTH 0.0000 0.0000 0.0000 0
92
+ HEALTHCARE 0.0000 0.0000 0.0000 0
93
+ HISTORY 0.0000 0.0000 0.0000 0
94
+ IMAGING 0.0000 0.0000 0.0000 1
95
+ IMMUNIZATIONS 0.0000 0.0000 0.0000 1
96
+ LABS 0.0000 0.0000 0.0000 1
97
+ MEDICAL 0.0000 0.0000 0.0000 0
98
+ MEDICATIONS 0.0000 0.0000 0.0000 7
99
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
100
+ PAST-HELEN 0.0000 0.0000 0.0000 0
101
+ PAST-HELSOX 0.0000 0.0000 0.0000 0
102
+ PASTMEDICALHX 0.0000 0.0000 0.0000 4
103
+ PASTSURGICAL 0.0000 0.0000 0.0000 8
104
+ PLAN 0.0000 0.0000 0.0000 3
105
+ PROCEDURES 0.0000 0.0000 0.0000 1
106
+ ROS 0.0000 0.0000 0.0000 11
107
+
108
+ accuracy 0.1900 100
109
+ macro avg 0.0257 0.0345 0.0213 100
110
+ weighted avg 0.1490 0.1900 0.1205 100
111
+ |
112
+ | No log | 2.0 | 344 | 0.8167 | precision recall f1-score support
113
+
114
+ ALLERGY 1.0000 0.2500 0.4000 4
115
+ ASSESSMENT 0.0000 0.0000 0.0000 4
116
+ CC 0.0000 0.0000 0.0000 4
117
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
118
+ DISPOSITION 0.0000 0.0000 0.0000 2
119
+ EDCOURSE 0.0000 0.0000 0.0000 3
120
+ EXAM 0.0000 0.0000 0.0000 1
121
+ FAM/SOCHX 0.7143 0.4545 0.5556 22
122
+ Follow-UP 0.0000 0.0000 0.0000 0
123
+ GENHX 0.2586 0.7500 0.3846 20
124
+ GYNHX 0.0000 0.0000 0.0000 1
125
+ IMAGING 0.0000 0.0000 0.0000 1
126
+ IMMUNIZATIONS 0.0000 0.0000 0.0000 1
127
+ LABS 0.0000 0.0000 0.0000 1
128
+ MEDICAL 0.0000 0.0000 0.0000 0
129
+ MEDICALHX 0.0000 0.0000 0.0000 0
130
+ MEDICATION 0.0000 0.0000 0.0000 0
131
+ MEDICATIONS 0.5000 0.4286 0.4615 7
132
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
133
+ PASTMEDICALHX 0.0000 0.0000 0.0000 4
134
+ PASTSURGICAL 0.5000 0.1250 0.2000 8
135
+ PLAN 0.0000 0.0000 0.0000 3
136
+ PROCEDURES 0.0000 0.0000 0.0000 1
137
+ ROS 0.0000 0.0000 0.0000 11
138
+ SSRI 0.0000 0.0000 0.0000 0
139
+ SURGICAL 0.0000 0.0000 0.0000 0
140
+
141
+ accuracy 0.3000 100
142
+ macro avg 0.1143 0.0772 0.0770 100
143
+ weighted avg 0.3239 0.3000 0.2635 100
144
+ |
145
+ | 1.7766 | 3.0 | 516 | 0.6617 | precision recall f1-score support
146
+
147
+ ALLERGY 1.0000 0.2500 0.4000 4
148
+ ASSESSMENT 0.0000 0.0000 0.0000 4
149
+ CC 0.0000 0.0000 0.0000 4
150
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
151
+ DISPOSITION 0.0000 0.0000 0.0000 2
152
+ EDCOURSE 0.0000 0.0000 0.0000 3
153
+ EXAM 0.0000 0.0000 0.0000 1
154
+ FAM/SOCHX 0.8235 0.6364 0.7179 22
155
+ GENHX 0.3455 0.9500 0.5067 20
156
+ GYNHX 0.0000 0.0000 0.0000 1
157
+ IMAGING 0.0000 0.0000 0.0000 1
158
+ IMMUNIZATIONS 0.0000 0.0000 0.0000 1
159
+ LABS 0.0000 0.0000 0.0000 1
160
+ MEDICALHX 0.0000 0.0000 0.0000 0
161
+ MEDICATIONS 0.4545 0.7143 0.5556 7
162
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
163
+ PASTMEDICALHX 0.0000 0.0000 0.0000 4
164
+ PASTSURGICAL 0.5000 0.2500 0.3333 8
165
+ PLAN 0.0000 0.0000 0.0000 3
166
+ PROCEDURES 0.0000 0.0000 0.0000 1
167
+ ROS 0.0000 0.0000 0.0000 11
168
+ SSRI 0.0000 0.0000 0.0000 0
169
+ SURGICAL 0.0000 0.0000 0.0000 0
170
+
171
+ accuracy 0.4100 100
172
+ macro avg 0.1358 0.1218 0.1093 100
173
+ weighted avg 0.3621 0.4100 0.3408 100
174
+ |
175
+ | 1.7766 | 4.0 | 688 | 0.5475 | precision recall f1-score support
176
+
177
+ ALLERGY 1.0000 0.2500 0.4000 4
178
+ ASSESSMENT 0.0000 0.0000 0.0000 4
179
+ CC 0.0000 0.0000 0.0000 4
180
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
181
+ DISPOSITION 0.0000 0.0000 0.0000 2
182
+ EDCOURSE 0.0000 0.0000 0.0000 3
183
+ EXAM 0.0000 0.0000 0.0000 1
184
+ FAM/SOCHX 0.8235 0.6364 0.7179 22
185
+ GENHX 0.3600 0.9000 0.5143 20
186
+ GYNHX 0.0000 0.0000 0.0000 1
187
+ IMAGING 0.0000 0.0000 0.0000 1
188
+ IMMUNIZATIONS 0.0000 0.0000 0.0000 1
189
+ LABS 0.0000 0.0000 0.0000 1
190
+ MEDICATIONS 0.5455 0.8571 0.6667 7
191
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
192
+ PASTMEDICALHX 0.1250 0.2500 0.1667 4
193
+ PASTSURGICAL 0.5714 0.5000 0.5333 8
194
+ PLAN 0.0000 0.0000 0.0000 3
195
+ PROCEDURES 0.0000 0.0000 0.0000 1
196
+ ROS 0.0000 0.0000 0.0000 11
197
+ SURGICAL 0.0000 0.0000 0.0000 0
198
+
199
+ accuracy 0.4400 100
200
+ macro avg 0.1631 0.1616 0.1428 100
201
+ weighted avg 0.3821 0.4400 0.3728 100
202
+ |
203
+ | 1.7766 | 5.0 | 860 | 0.4635 | precision recall f1-score support
204
+
205
+ ALLERGY 1.0000 0.2500 0.4000 4
206
+ ASSESSMENT 0.0000 0.0000 0.0000 4
207
+ CC 0.0000 0.0000 0.0000 4
208
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
209
+ DISPOSITION 0.0000 0.0000 0.0000 2
210
+ EDCOURSE 0.0000 0.0000 0.0000 3
211
+ EVALUATION 0.0000 0.0000 0.0000 0
212
+ EXAM 0.0000 0.0000 0.0000 1
213
+ FAM/SOCHX 0.9000 0.8182 0.8571 22
214
+ GENHX 0.4186 0.9000 0.5714 20
215
+ GYNHX 0.0000 0.0000 0.0000 1
216
+ HOME 0.0000 0.0000 0.0000 0
217
+ IMAGING 0.0000 0.0000 0.0000 1
218
+ IMMUNIZATIONS 0.0000 0.0000 0.0000 1
219
+ LABS 0.0000 0.0000 0.0000 1
220
+ MEDICATIONS 0.6667 0.8571 0.7500 7
221
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
222
+ PASTMEDICALHX 0.3000 0.7500 0.4286 4
223
+ PASTSURGICAL 0.8889 1.0000 0.9412 8
224
+ PLAN 1.0000 0.3333 0.5000 3
225
+ PROCEDURES 0.0000 0.0000 0.0000 1
226
+ ROS 0.0000 0.0000 0.0000 11
227
+
228
+ accuracy 0.5500 100
229
+ macro avg 0.2352 0.2231 0.2022 100
230
+ weighted avg 0.4815 0.5500 0.4788 100
231
+ |
232
+ | 0.3502 | 6.0 | 1032 | 0.4271 | precision recall f1-score support
233
+
234
+ ALLERGY 1.0000 0.2500 0.4000 4
235
+ ASSESSMENT 0.0000 0.0000 0.0000 4
236
+ CC 0.0000 0.0000 0.0000 4
237
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
238
+ DISPOSITION 0.0000 0.0000 0.0000 2
239
+ EDCOURSE 0.0000 0.0000 0.0000 3
240
+ EVALUATION 0.0000 0.0000 0.0000 0
241
+ EXAM 0.0000 0.0000 0.0000 1
242
+ FAM/SOCHX 1.0000 0.9091 0.9524 22
243
+ GENHX 0.5000 0.8500 0.6296 20
244
+ GYNHX 0.0000 0.0000 0.0000 1
245
+ HOME 0.0000 0.0000 0.0000 0
246
+ IMAGING 0.0000 0.0000 0.0000 1
247
+ IMMUNIZATIONS 0.0000 0.0000 0.0000 1
248
+ LABS 0.0000 0.0000 0.0000 1
249
+ MEDICATIONS 0.5000 1.0000 0.6667 7
250
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
251
+ PASTMEDICALHX 0.4000 1.0000 0.5714 4
252
+ PASTSURGICAL 0.8000 1.0000 0.8889 8
253
+ PLAN 1.0000 0.3333 0.5000 3
254
+ PROCEDURES 0.0000 0.0000 0.0000 1
255
+ ROS 1.0000 0.0909 0.1667 11
256
+
257
+ accuracy 0.5900 100
258
+ macro avg 0.2818 0.2470 0.2171 100
259
+ weighted avg 0.6150 0.5900 0.5254 100
260
+ |
261
+ | 0.3502 | 7.0 | 1204 | 0.4207 | precision recall f1-score support
262
+
263
+ ALLERGY 1.0000 0.2500 0.4000 4
264
+ ASSESSMENT 0.0000 0.0000 0.0000 4
265
+ CC 0.0000 0.0000 0.0000 4
266
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
267
+ DISPOSITION 0.0000 0.0000 0.0000 2
268
+ EDCOURSE 0.0000 0.0000 0.0000 3
269
+ EVALUATION 0.0000 0.0000 0.0000 0
270
+ EXAM 0.0000 0.0000 0.0000 1
271
+ FAM/SOCHX 1.0000 0.8182 0.9000 22
272
+ GENHX 0.5517 0.8000 0.6531 20
273
+ GYNHX 0.0000 0.0000 0.0000 1
274
+ HOME 0.0000 0.0000 0.0000 0
275
+ IMAGING 0.0000 0.0000 0.0000 1
276
+ IMMUNIZATIONS 1.0000 1.0000 1.0000 1
277
+ LABS 0.0000 0.0000 0.0000 1
278
+ MEDICATIONS 0.5385 1.0000 0.7000 7
279
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
280
+ PASTMEDICALHX 0.1818 1.0000 0.3077 4
281
+ PASTSURGICAL 0.8889 1.0000 0.9412 8
282
+ PLAN 1.0000 0.3333 0.5000 3
283
+ PROCEDURES 0.0000 0.0000 0.0000 1
284
+ ROS 1.0000 0.1818 0.3077 11
285
+
286
+ accuracy 0.5800 100
287
+ macro avg 0.3255 0.2902 0.2595 100
288
+ weighted avg 0.6364 0.5800 0.5401 100
289
+ |
290
+ | 0.3502 | 8.0 | 1376 | 0.4131 | precision recall f1-score support
291
+
292
+ ALLERGY 1.0000 0.2500 0.4000 4
293
+ ASSESSMENT 0.0000 0.0000 0.0000 4
294
+ CC 0.0000 0.0000 0.0000 4
295
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
296
+ DISPOSITION 0.0000 0.0000 0.0000 2
297
+ EDCOURSE 0.0000 0.0000 0.0000 3
298
+ EVALUATION 0.0000 0.0000 0.0000 0
299
+ EXAM 0.0000 0.0000 0.0000 1
300
+ FAM/SOCHX 0.9524 0.9091 0.9302 22
301
+ GENHX 0.4857 0.8500 0.6182 20
302
+ GYNHX 0.0000 0.0000 0.0000 1
303
+ HOME 0.0000 0.0000 0.0000 0
304
+ IMAGING 0.0000 0.0000 0.0000 1
305
+ IMMUNIZATIONS 1.0000 1.0000 1.0000 1
306
+ LABS 0.0000 0.0000 0.0000 1
307
+ MEDICATIONS 0.5385 1.0000 0.7000 7
308
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
309
+ PASTMEDICALHX 0.5000 1.0000 0.6667 4
310
+ PASTSURGICAL 1.0000 1.0000 1.0000 8
311
+ PLAN 0.5000 0.3333 0.4000 3
312
+ PROCEDURES 0.0000 0.0000 0.0000 1
313
+ ROS 0.6667 0.1818 0.2857 11
314
+
315
+ accuracy 0.6100 100
316
+ macro avg 0.3020 0.2966 0.2728 100
317
+ weighted avg 0.5827 0.6100 0.5534 100
318
+ |
319
+ | 0.2592 | 9.0 | 1548 | 0.3828 | precision recall f1-score support
320
+
321
+ ALLERGY 1.0000 0.2500 0.4000 4
322
+ ASSESSMENT 0.0000 0.0000 0.0000 4
323
+ CC 0.2000 0.2500 0.2222 4
324
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
325
+ DISPOSITION 0.0000 0.0000 0.0000 2
326
+ EDCOURSE 0.0000 0.0000 0.0000 3
327
+ EVALUATION 0.0000 0.0000 0.0000 0
328
+ EXAM 0.0000 0.0000 0.0000 1
329
+ FAM/SOCHX 0.9524 0.9091 0.9302 22
330
+ GENHX 0.5152 0.8500 0.6415 20
331
+ GYNHX 0.0000 0.0000 0.0000 1
332
+ HOME 0.0000 0.0000 0.0000 0
333
+ IMAGING 0.0000 0.0000 0.0000 1
334
+ IMMUNIZATIONS 1.0000 1.0000 1.0000 1
335
+ LABS 0.0000 0.0000 0.0000 1
336
+ MEDICATIONS 0.5833 1.0000 0.7368 7
337
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
338
+ PASTMEDICALHX 0.4444 1.0000 0.6154 4
339
+ PASTSURGICAL 0.8889 1.0000 0.9412 8
340
+ PLAN 0.5000 0.3333 0.4000 3
341
+ PROCEDURES 0.0000 0.0000 0.0000 1
342
+ ROS 0.6667 0.1818 0.2857 11
343
+
344
+ accuracy 0.6200 100
345
+ macro avg 0.3069 0.3079 0.2806 100
346
+ weighted avg 0.5886 0.6200 0.5628 100
347
+ |
348
+ | 0.2592 | 10.0 | 1720 | 0.3815 | precision recall f1-score support
349
+
350
+ ALLERGY 1.0000 0.2500 0.4000 4
351
+ ASSESSMENT 0.0000 0.0000 0.0000 4
352
+ CC 0.1667 0.2500 0.2000 4
353
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
354
+ DISPOSITION 0.0000 0.0000 0.0000 2
355
+ EDCOURSE 0.0000 0.0000 0.0000 3
356
+ EVALUATION 0.0000 0.0000 0.0000 0
357
+ EXAM 0.0000 0.0000 0.0000 1
358
+ FAM/SOCHX 0.9524 0.9091 0.9302 22
359
+ GENHX 0.5312 0.8500 0.6538 20
360
+ GYNHX 0.0000 0.0000 0.0000 1
361
+ HOME 0.0000 0.0000 0.0000 0
362
+ IMAGING 0.0000 0.0000 0.0000 1
363
+ IMMUNIZATIONS 1.0000 1.0000 1.0000 1
364
+ LABS 0.0000 0.0000 0.0000 1
365
+ MEDICATIONS 0.6364 1.0000 0.7778 7
366
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
367
+ PASTMEDICALHX 0.4444 1.0000 0.6154 4
368
+ PASTSURGICAL 0.8889 1.0000 0.9412 8
369
+ PLAN 0.5000 0.3333 0.4000 3
370
+ PROCEDURES 0.0000 0.0000 0.0000 1
371
+ ROS 0.6667 0.1818 0.2857 11
372
+
373
+ accuracy 0.6200 100
374
+ macro avg 0.3085 0.3079 0.2820 100
375
+ weighted avg 0.5942 0.6200 0.5672 100
376
+ |
377
+ | 0.2592 | 11.0 | 1892 | 0.3728 | precision recall f1-score support
378
+
379
+ ALLERGY 1.0000 0.2500 0.4000 4
380
+ ASSESSMENT 0.0000 0.0000 0.0000 4
381
+ CC 0.2222 0.5000 0.3077 4
382
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
383
+ DISPOSITION 0.0000 0.0000 0.0000 2
384
+ EDCOURSE 0.0000 0.0000 0.0000 3
385
+ EVALUATION 0.0000 0.0000 0.0000 0
386
+ EXAM 0.0000 0.0000 0.0000 1
387
+ FAM/SOCHX 0.9524 0.9091 0.9302 22
388
+ GENHX 0.5714 0.8000 0.6667 20
389
+ GYNHX 0.0000 0.0000 0.0000 1
390
+ HOME 0.0000 0.0000 0.0000 0
391
+ IMAGING 0.0000 0.0000 0.0000 1
392
+ IMMUNIZATIONS 1.0000 1.0000 1.0000 1
393
+ LABS 0.0000 0.0000 0.0000 1
394
+ MEDICATIONS 0.6364 1.0000 0.7778 7
395
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
396
+ PASTMEDICALHX 0.4444 1.0000 0.6154 4
397
+ PASTSURGICAL 0.8889 1.0000 0.9412 8
398
+ PLAN 0.6667 0.6667 0.6667 3
399
+ PROCEDURES 0.0000 0.0000 0.0000 1
400
+ ROS 0.6667 0.1818 0.2857 11
401
+
402
+ accuracy 0.6300 100
403
+ macro avg 0.3204 0.3322 0.2996 100
404
+ weighted avg 0.6095 0.6300 0.5821 100
405
+ |
406
+ | 0.2124 | 12.0 | 2064 | 0.3739 | precision recall f1-score support
407
+
408
+ ALLERGY 1.0000 0.2500 0.4000 4
409
+ ASSESSMENT 0.0000 0.0000 0.0000 4
410
+ CC 0.2222 0.5000 0.3077 4
411
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
412
+ DISPOSITION 0.0000 0.0000 0.0000 2
413
+ EDCOURSE 0.0000 0.0000 0.0000 3
414
+ EXAM 0.0000 0.0000 0.0000 1
415
+ FAM/SOCHX 0.9524 0.9091 0.9302 22
416
+ GENHX 0.5714 0.8000 0.6667 20
417
+ GYNHX 0.0000 0.0000 0.0000 1
418
+ HOME 0.0000 0.0000 0.0000 0
419
+ IMAGING 0.0000 0.0000 0.0000 1
420
+ IMMUNIZATIONS 1.0000 1.0000 1.0000 1
421
+ LABS 0.0000 0.0000 0.0000 1
422
+ MEDICATIONS 0.6364 1.0000 0.7778 7
423
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
424
+ PASTMEDICALHX 0.4000 1.0000 0.5714 4
425
+ PASTSURGICAL 1.0000 1.0000 1.0000 8
426
+ PLAN 0.6667 0.6667 0.6667 3
427
+ PROCEDURES 0.0000 0.0000 0.0000 1
428
+ ROS 0.6667 0.1818 0.2857 11
429
+
430
+ accuracy 0.6300 100
431
+ macro avg 0.3388 0.3480 0.3146 100
432
+ weighted avg 0.6166 0.6300 0.5850 100
433
+ |
434
+ | 0.2124 | 13.0 | 2236 | 0.3561 | precision recall f1-score support
435
+
436
+ ALLERGY 1.0000 0.2500 0.4000 4
437
+ ASSESSMENT 0.0000 0.0000 0.0000 4
438
+ CC 0.2222 0.5000 0.3077 4
439
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
440
+ DISPOSITION 0.0000 0.0000 0.0000 2
441
+ EDCOURSE 0.0000 0.0000 0.0000 3
442
+ EVALUATION 0.0000 0.0000 0.0000 0
443
+ EXAM 0.0000 0.0000 0.0000 1
444
+ FAM/SOCHX 0.9524 0.9091 0.9302 22
445
+ GENHX 0.5714 0.8000 0.6667 20
446
+ GYNHX 0.0000 0.0000 0.0000 1
447
+ HOME 0.0000 0.0000 0.0000 0
448
+ IMAGING 0.0000 0.0000 0.0000 1
449
+ IMMUNIZATIONS 1.0000 1.0000 1.0000 1
450
+ LABS 0.0000 0.0000 0.0000 1
451
+ MEDICATIONS 0.6364 1.0000 0.7778 7
452
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
453
+ PASTMEDICALHX 0.4444 1.0000 0.6154 4
454
+ PASTSURGICAL 0.8889 1.0000 0.9412 8
455
+ PLAN 0.6667 0.6667 0.6667 3
456
+ PROCEDURES 0.0000 0.0000 0.0000 1
457
+ ROS 0.6667 0.1818 0.2857 11
458
+
459
+ accuracy 0.6300 100
460
+ macro avg 0.3204 0.3322 0.2996 100
461
+ weighted avg 0.6095 0.6300 0.5821 100
462
+ |
463
+ | 0.2124 | 14.0 | 2408 | 0.3784 | precision recall f1-score support
464
+
465
+ ALLERGY 1.0000 0.2500 0.4000 4
466
+ ASSESSMENT 0.0000 0.0000 0.0000 4
467
+ CC 0.2000 0.5000 0.2857 4
468
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
469
+ DISPOSITION 0.0000 0.0000 0.0000 2
470
+ EDCOURSE 0.0000 0.0000 0.0000 3
471
+ EVALUATION 0.0000 0.0000 0.0000 0
472
+ EXAM 0.0000 0.0000 0.0000 1
473
+ FAM/SOCHX 0.9524 0.9091 0.9302 22
474
+ GENHX 0.5862 0.8500 0.6939 20
475
+ GYNHX 0.0000 0.0000 0.0000 1
476
+ HOME 0.0000 0.0000 0.0000 0
477
+ IMAGING 0.0000 0.0000 0.0000 1
478
+ IMMUNIZATIONS 1.0000 1.0000 1.0000 1
479
+ LABS 0.0000 0.0000 0.0000 1
480
+ MEDICATIONS 0.7778 1.0000 0.8750 7
481
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
482
+ PASTMEDICALHX 0.4000 1.0000 0.5714 4
483
+ PASTSURGICAL 1.0000 1.0000 1.0000 8
484
+ PLAN 0.6667 0.6667 0.6667 3
485
+ PROCEDURES 0.0000 0.0000 0.0000 1
486
+ ROS 0.6667 0.1818 0.2857 11
487
+
488
+ accuracy 0.6400 100
489
+ macro avg 0.3295 0.3344 0.3049 100
490
+ weighted avg 0.6285 0.6400 0.5964 100
491
+ |
492
+ | 0.1926 | 15.0 | 2580 | 0.3545 | precision recall f1-score support
493
+
494
+ ALLERGY 1.0000 0.2500 0.4000 4
495
+ ASSESSMENT 0.0000 0.0000 0.0000 4
496
+ CC 0.2222 0.5000 0.3077 4
497
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
498
+ DISPOSITION 0.0000 0.0000 0.0000 2
499
+ EDCOURSE 0.0000 0.0000 0.0000 3
500
+ EVALUATION 0.0000 0.0000 0.0000 0
501
+ EXAM 0.0000 0.0000 0.0000 1
502
+ FAM/SOCHX 0.9545 0.9545 0.9545 22
503
+ GENHX 0.5862 0.8500 0.6939 20
504
+ GYNHX 0.0000 0.0000 0.0000 1
505
+ HOME 0.0000 0.0000 0.0000 0
506
+ IMAGING 0.0000 0.0000 0.0000 1
507
+ IMMUNIZATIONS 1.0000 1.0000 1.0000 1
508
+ LABS 0.0000 0.0000 0.0000 1
509
+ MEDICATIONS 0.7000 1.0000 0.8235 7
510
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
511
+ PASTMEDICALHX 0.5000 1.0000 0.6667 4
512
+ PASTSURGICAL 0.8889 1.0000 0.9412 8
513
+ PLAN 0.6667 0.6667 0.6667 3
514
+ PROCEDURES 0.0000 0.0000 0.0000 1
515
+ ROS 0.6667 0.1818 0.2857 11
516
+
517
+ accuracy 0.6500 100
518
+ macro avg 0.3266 0.3365 0.3064 100
519
+ weighted avg 0.6196 0.6500 0.5981 100
520
+ |
521
+ | 0.1926 | 16.0 | 2752 | 0.3393 | precision recall f1-score support
522
+
523
+ ALLERGY 1.0000 0.2500 0.4000 4
524
+ ASSESSMENT 0.0000 0.0000 0.0000 4
525
+ CC 0.1818 0.5000 0.2667 4
526
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
527
+ DISPOSITION 0.0000 0.0000 0.0000 2
528
+ EDCOURSE 0.0000 0.0000 0.0000 3
529
+ EVALUATION 0.0000 0.0000 0.0000 0
530
+ EXAM 0.0000 0.0000 0.0000 1
531
+ FAM/SOCHX 0.9524 0.9091 0.9302 22
532
+ GENHX 0.6250 0.7500 0.6818 20
533
+ GYNHX 0.0000 0.0000 0.0000 1
534
+ HOME 0.0000 0.0000 0.0000 0
535
+ IMAGING 0.0000 0.0000 0.0000 1
536
+ IMMUNIZATIONS 1.0000 1.0000 1.0000 1
537
+ LABS 0.0000 0.0000 0.0000 1
538
+ MEDICATIONS 0.7778 1.0000 0.8750 7
539
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
540
+ PASTMEDICALHX 0.3333 1.0000 0.5000 4
541
+ PASTSURGICAL 0.8889 1.0000 0.9412 8
542
+ PLAN 0.6667 0.6667 0.6667 3
543
+ PROCEDURES 0.0000 0.0000 0.0000 1
544
+ ROS 0.7500 0.2727 0.4000 11
545
+
546
+ accuracy 0.6300 100
547
+ macro avg 0.3262 0.3340 0.3028 100
548
+ weighted avg 0.6332 0.6300 0.5982 100
549
+ |
550
+ | 0.1926 | 17.0 | 2924 | 0.3464 | precision recall f1-score support
551
+
552
+ ALLERGY 1.0000 0.2500 0.4000 4
553
+ ASSESSMENT 0.0000 0.0000 0.0000 4
554
+ CC 0.2222 0.5000 0.3077 4
555
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
556
+ DISPOSITION 0.0000 0.0000 0.0000 2
557
+ EDCOURSE 0.0000 0.0000 0.0000 3
558
+ EVALUATIONS 0.0000 0.0000 0.0000 0
559
+ EXAM 0.0000 0.0000 0.0000 1
560
+ FAM/SOCHX 0.9545 0.9545 0.9545 22
561
+ GENHX 0.5769 0.7500 0.6522 20
562
+ GYNHX 0.0000 0.0000 0.0000 1
563
+ HOME 0.0000 0.0000 0.0000 0
564
+ IMAGING 0.0000 0.0000 0.0000 1
565
+ IMMUNIZATIONS 1.0000 1.0000 1.0000 1
566
+ LABS 0.0000 0.0000 0.0000 1
567
+ MEDICATIONS 0.7778 1.0000 0.8750 7
568
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
569
+ PASTMEDICALHX 0.4000 1.0000 0.5714 4
570
+ PASTSURGICAL 0.8889 1.0000 0.9412 8
571
+ PLAN 0.6667 0.6667 0.6667 3
572
+ PROCEDURES 0.0000 0.0000 0.0000 1
573
+ ROS 0.8000 0.3636 0.5000 11
574
+
575
+ accuracy 0.6500 100
576
+ macro avg 0.3312 0.3402 0.3122 100
577
+ weighted avg 0.6338 0.6500 0.6131 100
578
+ |
579
+ | 0.1771 | 18.0 | 3096 | 0.3489 | precision recall f1-score support
580
+
581
+ ALLERGY 1.0000 0.2500 0.4000 4
582
+ ASSESSMENT 0.0000 0.0000 0.0000 4
583
+ CC 0.2000 0.5000 0.2857 4
584
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
585
+ DISPOSITION 0.0000 0.0000 0.0000 2
586
+ EDCOURSE 0.0000 0.0000 0.0000 3
587
+ EVALUATIONS 0.0000 0.0000 0.0000 0
588
+ EXAM 0.0000 0.0000 0.0000 1
589
+ FAM/SOCHX 0.9130 0.9545 0.9333 22
590
+ GENHX 0.5926 0.8000 0.6809 20
591
+ GYNHX 0.0000 0.0000 0.0000 1
592
+ IMAGING 0.0000 0.0000 0.0000 1
593
+ IMMUNIZATIONS 1.0000 1.0000 1.0000 1
594
+ LABS 0.0000 0.0000 0.0000 1
595
+ MEDICATIONS 0.7778 1.0000 0.8750 7
596
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
597
+ PASTMEDICALHX 0.4000 1.0000 0.5714 4
598
+ PASTSURGICAL 1.0000 1.0000 1.0000 8
599
+ PLAN 0.6667 0.6667 0.6667 3
600
+ PROCEDURES 0.0000 0.0000 0.0000 1
601
+ ROS 0.7500 0.2727 0.4000 11
602
+
603
+ accuracy 0.6500 100
604
+ macro avg 0.3476 0.3545 0.3244 100
605
+ weighted avg 0.6303 0.6500 0.6070 100
606
+ |
607
+ | 0.1771 | 19.0 | 3268 | 0.3489 | precision recall f1-score support
608
+
609
+ ALLERGY 1.0000 0.2500 0.4000 4
610
+ ASSESSMENT 0.0000 0.0000 0.0000 4
611
+ CC 0.2000 0.5000 0.2857 4
612
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
613
+ DISPOSITION 0.0000 0.0000 0.0000 2
614
+ EDCOURSE 0.0000 0.0000 0.0000 3
615
+ EVALUATIONS 0.0000 0.0000 0.0000 0
616
+ EXAM 0.0000 0.0000 0.0000 1
617
+ FAM/SOCHX 0.9130 0.9545 0.9333 22
618
+ GENHX 0.5926 0.8000 0.6809 20
619
+ GYNHX 0.0000 0.0000 0.0000 1
620
+ IMAGING 0.0000 0.0000 0.0000 1
621
+ IMMUNIZATIONS 1.0000 1.0000 1.0000 1
622
+ LABS 0.0000 0.0000 0.0000 1
623
+ MEDICATIONS 0.7778 1.0000 0.8750 7
624
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
625
+ PASTMEDICALHX 0.4000 1.0000 0.5714 4
626
+ PASTSURGICAL 1.0000 1.0000 1.0000 8
627
+ PLAN 0.6667 0.6667 0.6667 3
628
+ PROCEDURES 0.0000 0.0000 0.0000 1
629
+ ROS 0.7500 0.2727 0.4000 11
630
+
631
+ accuracy 0.6500 100
632
+ macro avg 0.3476 0.3545 0.3244 100
633
+ weighted avg 0.6303 0.6500 0.6070 100
634
+ |
635
+ | 0.1771 | 20.0 | 3440 | 0.3456 | precision recall f1-score support
636
+
637
+ ALLERGY 1.0000 0.2500 0.4000 4
638
+ ASSESSMENT 0.0000 0.0000 0.0000 4
639
+ CC 0.2000 0.5000 0.2857 4
640
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
641
+ DISPOSITION 0.0000 0.0000 0.0000 2
642
+ EDCOURSE 0.0000 0.0000 0.0000 3
643
+ EVALUATIONS 0.0000 0.0000 0.0000 0
644
+ EXAM 0.0000 0.0000 0.0000 1
645
+ FAM/SOCHX 0.9130 0.9545 0.9333 22
646
+ GENHX 0.5926 0.8000 0.6809 20
647
+ GYNHX 0.0000 0.0000 0.0000 1
648
+ IMAGING 0.0000 0.0000 0.0000 1
649
+ IMMUNIZATIONS 1.0000 1.0000 1.0000 1
650
+ LABS 0.0000 0.0000 0.0000 1
651
+ MEDICATIONS 0.7778 1.0000 0.8750 7
652
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
653
+ PASTMEDICALHX 0.4000 1.0000 0.5714 4
654
+ PASTSURGICAL 1.0000 1.0000 1.0000 8
655
+ PLAN 0.6667 0.6667 0.6667 3
656
+ PROCEDURES 0.0000 0.0000 0.0000 1
657
+ ROS 0.7500 0.2727 0.4000 11
658
+
659
+ accuracy 0.6500 100
660
+ macro avg 0.3476 0.3545 0.3244 100
661
+ weighted avg 0.6303 0.6500 0.6070 100
662
+ |
663
+
664
+
665
+ ### Framework versions
666
+
667
+ - PEFT 0.8.2
668
+ - Transformers 4.37.2
669
+ - Pytorch 2.1.0+cu121
670
+ - Datasets 2.17.1
671
+ - Tokenizers 0.15.2
adapter_model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:438ec2a355a4c272b2ec4c3c04938822fd7c57b9436c7d8de9f0c355f8336b32
3
  size 4758888
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bacb8bb4b7f68be583431da229ec42392d713ebbaea28f96b65c6c81656f6ca9
3
  size 4758888
runs/Feb25_00-53-00_1e8b32681ac6/events.out.tfevents.1708822394.1e8b32681ac6.1379.0 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:8503fd52c1a21d0e294a060c36d7cfe846f9b6c7bbbdbcb2f8110fc9e54acb3e
3
- size 10260
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b6ed87e20c77c9e147142b15bfbc04876c6819b134d4475ab2b2e8c01a8500ff
3
+ size 11427
tokenizer.json CHANGED
@@ -1,11 +1,6 @@
1
  {
2
  "version": "1.0",
3
- "truncation": {
4
- "direction": "Right",
5
- "max_length": 50,
6
- "strategy": "LongestFirst",
7
- "stride": 0
8
- },
9
  "padding": null,
10
  "added_tokens": [
11
  {
 
1
  {
2
  "version": "1.0",
3
+ "truncation": null,
 
 
 
 
 
4
  "padding": null,
5
  "added_tokens": [
6
  {