Hugging Face's logo

sarahahtee
/
t5-dialogue-classification-5

Transformers
TensorBoard
Safetensors
t5
text2text-generation
Generated from Trainer
text-generation-inference
Model card Files
xet
 Metrics Community
Sarah Tariq commited on
Commit
36f0c00
·
verified ·
1 Parent(s): b7d5519

End of training

Browse files
Files changed (4) hide show
  1. README.md +625 -0
  2. generation_config.json +6 -0
  3. model.safetensors +1 -1
  4. runs/Jan14_22-35-33_06d97e0935bf/events.out.tfevents.1705271741.06d97e0935bf.977.1 +2 -2
README.md ADDED
@@ -0,0 +1,625 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ base_model: google/flan-t5-base
4
+ tags:
5
+ - generated_from_trainer
6
+ model-index:
7
+ - name: t5-dialogue-classification-5
8
+ results: []
9
+ ---
10
+
11
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
12
+ should probably proofread and complete it, then remove this comment. -->
13
+
14
+ # t5-dialogue-classification-5
15
+
16
+ This model is a fine-tuned version of [google/flan-t5-base](https://huggingface.co/google/flan-t5-base) on an unknown dataset.
17
+ It achieves the following results on the evaluation set:
18
+ - Loss: 0.6560
19
+ - Classification Report: precision recall f1-score support
20
+
21
+ ALLERGY 1.0000 0.5000 0.6667 4
22
+ ASSESSMENT 0.6667 0.5000 0.5714 4
23
+ CC 0.3750 0.7500 0.5000 4
24
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
25
+ DISPOSITION 0.5000 0.5000 0.5000 2
26
+ EDCOURSE 0.0000 0.0000 0.0000 3
27
+ EXAM 1.0000 1.0000 1.0000 1
28
+ FAM/SOCHX 0.8800 1.0000 0.9362 22
29
+ GENHX 0.8571 0.9000 0.8780 20
30
+ GYNHX 0.0000 0.0000 0.0000 1
31
+ IMAGING 0.0000 0.0000 0.0000 1
32
+ IMMUNIZATIONS 1.0000 1.0000 1.0000 1
33
+ LABS 0.0000 0.0000 0.0000 1
34
+ MEDICATIONS 0.8750 1.0000 0.9333 7
35
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
36
+ PASTMEDICALHX 0.5000 1.0000 0.6667 4
37
+ PASTSURGICAL 1.0000 1.0000 1.0000 8
38
+ PLAN 0.5000 0.3333 0.4000 3
39
+ PROCEDURES 0.0000 0.0000 0.0000 1
40
+ ROS 0.8571 0.5455 0.6667 11
41
+
42
+ accuracy 0.7600 100
43
+ macro avg 0.5005 0.5014 0.4859 100
44
+ weighted avg 0.7472 0.7600 0.7384 100
45
+
46
+
47
+ ## Model description
48
+
49
+ More information needed
50
+
51
+ ## Intended uses & limitations
52
+
53
+ More information needed
54
+
55
+ ## Training and evaluation data
56
+
57
+ More information needed
58
+
59
+ ## Training procedure
60
+
61
+ ### Training hyperparameters
62
+
63
+ The following hyperparameters were used during training:
64
+ - learning_rate: 0.0001
65
+ - train_batch_size: 7
66
+ - eval_batch_size: 7
67
+ - seed: 42
68
+ - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
69
+ - lr_scheduler_type: linear
70
+ - num_epochs: 20
71
+
72
+ ### Training results
73
+
74
+ | Training Loss | Epoch | Step | Validation Loss | Classification Report |
75
+ |:-------------:|:-----:|:----:|:---------------:|:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------:|
76
+ | No log | 1.0 | 172 | 0.4439 | precision recall f1-score support
77
+
78
+ ALLERGY 1.0000 0.2500 0.4000 4
79
+ ASSESSMENT 1.0000 0.2500 0.4000 4
80
+ CC 0.0000 0.0000 0.0000 4
81
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
82
+ DISPOSITION 0.0000 0.0000 0.0000 2
83
+ EDCOURSE 0.0000 0.0000 0.0000 3
84
+ EXAM 0.0000 0.0000 0.0000 1
85
+ FAM/SOCHX 0.8400 0.9545 0.8936 22
86
+ GENHX 0.4082 1.0000 0.5797 20
87
+ GYNHX 0.0000 0.0000 0.0000 1
88
+ IMAGING 0.0000 0.0000 0.0000 1
89
+ IMMUNIZATIONS 0.0000 0.0000 0.0000 1
90
+ LABS 0.0000 0.0000 0.0000 1
91
+ MEDICATIONS 0.6667 0.5714 0.6154 7
92
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
93
+ PASTMEDICALHX 0.5000 1.0000 0.6667 4
94
+ PASTSURGICAL 1.0000 1.0000 1.0000 8
95
+ PLAN 0.0000 0.0000 0.0000 3
96
+ PROCEDURES 0.0000 0.0000 0.0000 1
97
+ ROS 0.0000 0.0000 0.0000 11
98
+ SYSTEMS 0.0000 0.0000 0.0000 0
99
+
100
+ accuracy 0.5900 100
101
+ macro avg 0.2578 0.2393 0.2169 100
102
+ weighted avg 0.4931 0.5900 0.4943 100
103
+ |
104
+ | No log | 2.0 | 344 | 0.3352 | precision recall f1-score support
105
+
106
+ ALLERGY 1.0000 0.2500 0.4000 4
107
+ ASSESSMENT 1.0000 0.2500 0.4000 4
108
+ CC 0.0000 0.0000 0.0000 4
109
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
110
+ DISPOSITION 0.0000 0.0000 0.0000 2
111
+ EDCOURSE 0.0000 0.0000 0.0000 3
112
+ EXAM 0.0000 0.0000 0.0000 1
113
+ FAM/SOCHX 0.9167 1.0000 0.9565 22
114
+ GENHX 0.4444 1.0000 0.6154 20
115
+ GYNHX 0.0000 0.0000 0.0000 1
116
+ IMAGING 0.0000 0.0000 0.0000 1
117
+ IMMUNIZATIONS 0.5000 1.0000 0.6667 1
118
+ LABS 0.0000 0.0000 0.0000 1
119
+ MEDICATIONS 0.7500 0.8571 0.8000 7
120
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
121
+ PASTMEDICALHX 0.5714 1.0000 0.7273 4
122
+ PASTSURGICAL 1.0000 1.0000 1.0000 8
123
+ PLAN 0.0000 0.0000 0.0000 3
124
+ PROCEDURES 0.0000 0.0000 0.0000 1
125
+ ROS 1.0000 0.1818 0.3077 11
126
+
127
+ accuracy 0.6500 100
128
+ macro avg 0.3591 0.3269 0.2937 100
129
+ weighted avg 0.6409 0.6500 0.5711 100
130
+ |
131
+ | 0.3193 | 3.0 | 516 | 0.3951 | precision recall f1-score support
132
+
133
+ ALLERGY 1.0000 0.2500 0.4000 4
134
+ ASSESSMENT 1.0000 0.2500 0.4000 4
135
+ CC 0.5000 0.7500 0.6000 4
136
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
137
+ DISPOSITION 0.0000 0.0000 0.0000 2
138
+ EDCOURSE 0.0000 0.0000 0.0000 3
139
+ EK G 0.0000 0.0000 0.0000 0
140
+ EXAM 0.0000 0.0000 0.0000 1
141
+ FAM/SOCHX 0.8800 1.0000 0.9362 22
142
+ GENHX 0.6333 0.9500 0.7600 20
143
+ GYNHX 0.0000 0.0000 0.0000 1
144
+ IMAGING 0.0000 0.0000 0.0000 1
145
+ IMMUNIZATIONS 1.0000 1.0000 1.0000 1
146
+ LABS 0.0000 0.0000 0.0000 1
147
+ MEDICATIONS 0.7500 0.8571 0.8000 7
148
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
149
+ PASTMEDICALHX 0.4444 1.0000 0.6154 4
150
+ PASTSURGICAL 1.0000 1.0000 1.0000 8
151
+ PLAN 0.0000 0.0000 0.0000 3
152
+ PROCEDURES 0.0000 0.0000 0.0000 1
153
+ ROS 0.6667 0.1818 0.2857 11
154
+
155
+ accuracy 0.6700 100
156
+ macro avg 0.3750 0.3447 0.3237 100
157
+ weighted avg 0.6539 0.6700 0.6160 100
158
+ |
159
+ | 0.3193 | 4.0 | 688 | 0.3707 | precision recall f1-score support
160
+
161
+ ALLERGY 1.0000 0.5000 0.6667 4
162
+ ASSESSMENT 1.0000 0.2500 0.4000 4
163
+ CC 0.2727 0.7500 0.4000 4
164
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
165
+ DISPOSITION 0.0000 0.0000 0.0000 2
166
+ EDCOURSE 0.0000 0.0000 0.0000 3
167
+ EXAM 0.3333 1.0000 0.5000 1
168
+ FAM/SOCHX 0.8800 1.0000 0.9362 22
169
+ GENHX 0.8571 0.9000 0.8780 20
170
+ GYNHX 0.0000 0.0000 0.0000 1
171
+ IMAGING 0.0000 0.0000 0.0000 1
172
+ IMMUNIZATIONS 1.0000 1.0000 1.0000 1
173
+ LABS 0.0000 0.0000 0.0000 1
174
+ MEDICATIONS 0.8750 1.0000 0.9333 7
175
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
176
+ PASTMEDICALHX 0.3750 0.7500 0.5000 4
177
+ PASTSURGICAL 1.0000 1.0000 1.0000 8
178
+ PLAN 0.6667 0.6667 0.6667 3
179
+ PROCEDURES 0.0000 0.0000 0.0000 1
180
+ ROS 0.8571 0.5455 0.6667 11
181
+
182
+ accuracy 0.7400 100
183
+ macro avg 0.4559 0.4681 0.4274 100
184
+ weighted avg 0.7398 0.7400 0.7139 100
185
+ |
186
+ | 0.3193 | 5.0 | 860 | 0.3895 | precision recall f1-score support
187
+
188
+ ALLERGY 1.0000 0.2500 0.4000 4
189
+ ASSESSMENT 0.5000 0.2500 0.3333 4
190
+ CC 0.3750 0.7500 0.5000 4
191
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
192
+ DISPOSITION 0.0000 0.0000 0.0000 2
193
+ EDCOURSE 0.0000 0.0000 0.0000 3
194
+ EXAM 1.0000 1.0000 1.0000 1
195
+ FAM/SOCHX 0.8462 1.0000 0.9167 22
196
+ GENHX 0.9000 0.9000 0.9000 20
197
+ GYNHX 0.0000 0.0000 0.0000 1
198
+ IMAGING 0.0000 0.0000 0.0000 1
199
+ IMMUNIZATIONS 1.0000 1.0000 1.0000 1
200
+ LABS 0.0000 0.0000 0.0000 1
201
+ MEDICATIONS 0.7778 1.0000 0.8750 7
202
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
203
+ PASTMEDICALHX 0.5000 1.0000 0.6667 4
204
+ PASTSURGICAL 1.0000 1.0000 1.0000 8
205
+ PLAN 1.0000 0.6667 0.8000 3
206
+ PROCEDURES 0.0000 0.0000 0.0000 1
207
+ ROS 0.8750 0.6364 0.7368 11
208
+
209
+ accuracy 0.7500 100
210
+ macro avg 0.4887 0.4727 0.4564 100
211
+ weighted avg 0.7418 0.7500 0.7240 100
212
+ |
213
+ | 0.0885 | 6.0 | 1032 | 0.4334 | precision recall f1-score support
214
+
215
+ ALLERGY 1.0000 0.2500 0.4000 4
216
+ ASSESSMENT 1.0000 0.2500 0.4000 4
217
+ CC 0.4286 0.7500 0.5455 4
218
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
219
+ DISPOSITION 0.3333 0.5000 0.4000 2
220
+ EDCOURSE 0.0000 0.0000 0.0000 3
221
+ EXAM 0.5000 1.0000 0.6667 1
222
+ FAM/SOCHX 0.9565 1.0000 0.9778 22
223
+ GENHX 0.8182 0.9000 0.8571 20
224
+ GYNHX 0.0000 0.0000 0.0000 1
225
+ IMAGING 0.0000 0.0000 0.0000 1
226
+ IMMUNIZATIONS 1.0000 1.0000 1.0000 1
227
+ LABS 0.0000 0.0000 0.0000 1
228
+ MEDICATIONS 0.7778 1.0000 0.8750 7
229
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
230
+ PASTMEDICALHX 0.4000 1.0000 0.5714 4
231
+ PASTSURGICAL 1.0000 1.0000 1.0000 8
232
+ PLAN 0.6667 0.6667 0.6667 3
233
+ PROCEDURES 0.0000 0.0000 0.0000 1
234
+ ROS 0.8000 0.3636 0.5000 11
235
+
236
+ accuracy 0.7300 100
237
+ macro avg 0.4841 0.4840 0.4430 100
238
+ weighted avg 0.7513 0.7300 0.7041 100
239
+ |
240
+ | 0.0885 | 7.0 | 1204 | 0.4889 | precision recall f1-score support
241
+
242
+ ALLERGY 1.0000 0.2500 0.4000 4
243
+ ASSESSMENT 0.0000 0.0000 0.0000 4
244
+ CC 0.3333 0.7500 0.4615 4
245
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
246
+ DISPOSITION 0.3333 0.5000 0.4000 2
247
+ EDCOURSE 0.0000 0.0000 0.0000 3
248
+ EXAM 0.5000 1.0000 0.6667 1
249
+ FAM/SOCHX 0.8800 1.0000 0.9362 22
250
+ GENHX 0.8500 0.8500 0.8500 20
251
+ GYNHX 0.0000 0.0000 0.0000 1
252
+ IMAGING 0.5000 1.0000 0.6667 1
253
+ IMMUNIZATIONS 1.0000 1.0000 1.0000 1
254
+ LABS 0.0000 0.0000 0.0000 1
255
+ MEDICATIONS 0.6667 0.8571 0.7500 7
256
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
257
+ PASTMEDICALHX 0.5714 1.0000 0.7273 4
258
+ PASTSURGICAL 1.0000 1.0000 1.0000 8
259
+ PLAN 0.5000 0.6667 0.5714 3
260
+ PROCEDURES 0.0000 0.0000 0.0000 1
261
+ ROS 0.8571 0.5455 0.6667 11
262
+
263
+ accuracy 0.7300 100
264
+ macro avg 0.4496 0.5210 0.4548 100
265
+ weighted avg 0.7024 0.7300 0.6938 100
266
+ |
267
+ | 0.0885 | 8.0 | 1376 | 0.5543 | precision recall f1-score support
268
+
269
+ ALLERGY 1.0000 0.2500 0.4000 4
270
+ ASSESSMENT 1.0000 0.2500 0.4000 4
271
+ CC 0.4286 0.7500 0.5455 4
272
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
273
+ DISPOSITION 0.5000 0.5000 0.5000 2
274
+ EDCOURSE 0.0000 0.0000 0.0000 3
275
+ EXAM 0.2500 1.0000 0.4000 1
276
+ FAM/SOCHX 0.8800 1.0000 0.9362 22
277
+ GENHX 0.7200 0.9000 0.8000 20
278
+ GYNHX 0.0000 0.0000 0.0000 1
279
+ IMAGING 0.0000 0.0000 0.0000 1
280
+ IMMUNIZATIONS 1.0000 1.0000 1.0000 1
281
+ LABS 0.0000 0.0000 0.0000 1
282
+ MEDICATIONS 0.7000 1.0000 0.8235 7
283
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
284
+ PASTMEDICALHX 0.6000 0.7500 0.6667 4
285
+ PASTSURGICAL 1.0000 1.0000 1.0000 8
286
+ PLAN 0.5000 0.3333 0.4000 3
287
+ PROCEDURES 0.0000 0.0000 0.0000 1
288
+ ROS 0.8571 0.5455 0.6667 11
289
+
290
+ accuracy 0.7300 100
291
+ macro avg 0.4718 0.4639 0.4269 100
292
+ weighted avg 0.7195 0.7300 0.6934 100
293
+ |
294
+ | 0.0361 | 9.0 | 1548 | 0.5914 | precision recall f1-score support
295
+
296
+ ALLERGY 1.0000 0.5000 0.6667 4
297
+ ASSESSMENT 1.0000 0.5000 0.6667 4
298
+ CC 0.5000 0.7500 0.6000 4
299
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
300
+ DISPOSITION 0.0000 0.0000 0.0000 2
301
+ EDCOURSE 0.0000 0.0000 0.0000 3
302
+ EXAM 0.3333 1.0000 0.5000 1
303
+ FAM/SOCHX 0.8800 1.0000 0.9362 22
304
+ GENHX 0.8095 0.8500 0.8293 20
305
+ GYNHX 0.0000 0.0000 0.0000 1
306
+ IMAGING 0.5000 1.0000 0.6667 1
307
+ IMMUNIZATIONS 1.0000 1.0000 1.0000 1
308
+ LABS 0.0000 0.0000 0.0000 1
309
+ MEDICATIONS 0.7778 1.0000 0.8750 7
310
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
311
+ PASTMEDICALHX 0.5714 1.0000 0.7273 4
312
+ PASTSURGICAL 0.8889 1.0000 0.9412 8
313
+ PLAN 0.3333 0.3333 0.3333 3
314
+ PROCEDURES 0.0000 0.0000 0.0000 1
315
+ ROS 0.8571 0.5455 0.6667 11
316
+
317
+ accuracy 0.7500 100
318
+ macro avg 0.4726 0.5239 0.4704 100
319
+ weighted avg 0.7265 0.7500 0.7198 100
320
+ |
321
+ | 0.0361 | 10.0 | 1720 | 0.6607 | precision recall f1-score support
322
+
323
+ ALLERGY 1.0000 0.5000 0.6667 4
324
+ ASSESSMENT 0.5000 0.2500 0.3333 4
325
+ CC 0.3333 0.5000 0.4000 4
326
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
327
+ DISPOSITION 0.2500 0.5000 0.3333 2
328
+ EDCOURSE 0.0000 0.0000 0.0000 3
329
+ EXAM 1.0000 1.0000 1.0000 1
330
+ FAM/SOCHX 0.9565 1.0000 0.9778 22
331
+ GENHX 0.7037 0.9500 0.8085 20
332
+ GYNHX 0.0000 0.0000 0.0000 1
333
+ IMAGING 0.0000 0.0000 0.0000 1
334
+ IMMUNIZATIONS 1.0000 1.0000 1.0000 1
335
+ LABS 0.0000 0.0000 0.0000 1
336
+ MEDICATIONS 0.8750 1.0000 0.9333 7
337
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
338
+ PASTMEDICALHX 0.5000 0.7500 0.6000 4
339
+ PASTSURGICAL 1.0000 1.0000 1.0000 8
340
+ PLAN 0.6667 0.6667 0.6667 3
341
+ PROCEDURES 0.0000 0.0000 0.0000 1
342
+ ROS 0.8571 0.5455 0.6667 11
343
+
344
+ accuracy 0.7500 100
345
+ macro avg 0.4821 0.4831 0.4693 100
346
+ weighted avg 0.7250 0.7500 0.7221 100
347
+ |
348
+ | 0.0361 | 11.0 | 1892 | 0.6002 | precision recall f1-score support
349
+
350
+ ALLERGY 1.0000 0.5000 0.6667 4
351
+ ASSESSMENT 0.5000 0.2500 0.3333 4
352
+ CC 0.4286 0.7500 0.5455 4
353
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
354
+ DISPOSITION 0.3333 0.5000 0.4000 2
355
+ EDCOURSE 0.0000 0.0000 0.0000 3
356
+ EXAM 0.5000 1.0000 0.6667 1
357
+ FAM/SOCHX 0.9167 1.0000 0.9565 22
358
+ GENHX 0.7826 0.9000 0.8372 20
359
+ GYNHX 0.0000 0.0000 0.0000 1
360
+ IMAGING 0.0000 0.0000 0.0000 1
361
+ IMMUNIZATIONS 1.0000 1.0000 1.0000 1
362
+ LABS 0.0000 0.0000 0.0000 1
363
+ MEDICATIONS 0.8750 1.0000 0.9333 7
364
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
365
+ PASTMEDICALHX 0.5000 1.0000 0.6667 4
366
+ PASTSURGICAL 1.0000 1.0000 1.0000 8
367
+ PLAN 0.5000 0.3333 0.4000 3
368
+ PROCEDURES 0.0000 0.0000 0.0000 1
369
+ ROS 0.8571 0.5455 0.6667 11
370
+
371
+ accuracy 0.7500 100
372
+ macro avg 0.4597 0.4889 0.4536 100
373
+ weighted avg 0.7275 0.7500 0.7217 100
374
+ |
375
+ | 0.0134 | 12.0 | 2064 | 0.6110 | precision recall f1-score support
376
+
377
+ ALLERGY 1.0000 0.5000 0.6667 4
378
+ ASSESSMENT 0.6667 0.5000 0.5714 4
379
+ CC 0.5000 0.2500 0.3333 4
380
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
381
+ DISPOSITION 0.5000 0.5000 0.5000 2
382
+ EDCOURSE 0.0000 0.0000 0.0000 3
383
+ EXAM 0.5000 1.0000 0.6667 1
384
+ FAM/SOCHX 0.9167 1.0000 0.9565 22
385
+ GENHX 0.7308 0.9500 0.8261 20
386
+ GYNHX 0.0000 0.0000 0.0000 1
387
+ IMAGING 0.0000 0.0000 0.0000 1
388
+ IMMUNIZATIONS 1.0000 1.0000 1.0000 1
389
+ LABS 0.0000 0.0000 0.0000 1
390
+ MEDICATIONS 0.7778 1.0000 0.8750 7
391
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
392
+ PASTMEDICALHX 0.4444 1.0000 0.6154 4
393
+ PASTSURGICAL 1.0000 1.0000 1.0000 8
394
+ PLAN 1.0000 0.3333 0.5000 3
395
+ PROCEDURES 0.0000 0.0000 0.0000 1
396
+ ROS 0.8571 0.5455 0.6667 11
397
+
398
+ accuracy 0.7500 100
399
+ macro avg 0.4947 0.4789 0.4589 100
400
+ weighted avg 0.7360 0.7500 0.7194 100
401
+ |
402
+ | 0.0134 | 13.0 | 2236 | 0.6458 | precision recall f1-score support
403
+
404
+ ALLERGY 1.0000 0.5000 0.6667 4
405
+ ASSESSMENT 1.0000 0.5000 0.6667 4
406
+ CC 0.5000 0.5000 0.5000 4
407
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
408
+ DISPOSITION 0.5000 0.5000 0.5000 2
409
+ EDCOURSE 0.0000 0.0000 0.0000 3
410
+ EXAM 0.3333 1.0000 0.5000 1
411
+ FAM/SOCHX 0.9167 1.0000 0.9565 22
412
+ GENHX 0.7917 0.9500 0.8636 20
413
+ GYNHX 0.0000 0.0000 0.0000 1
414
+ IMAGING 0.3333 1.0000 0.5000 1
415
+ IMMUNIZATIONS 1.0000 1.0000 1.0000 1
416
+ LABS 0.0000 0.0000 0.0000 1
417
+ MEDICATIONS 0.7778 1.0000 0.8750 7
418
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
419
+ PASTMEDICALHX 0.6667 1.0000 0.8000 4
420
+ PASTSURGICAL 0.8000 1.0000 0.8889 8
421
+ PLAN 1.0000 0.3333 0.5000 3
422
+ PROCEDURES 0.0000 0.0000 0.0000 1
423
+ ROS 0.8571 0.5455 0.6667 11
424
+
425
+ accuracy 0.7700 100
426
+ macro avg 0.5238 0.5414 0.4942 100
427
+ weighted avg 0.7561 0.7700 0.7392 100
428
+ |
429
+ | 0.0134 | 14.0 | 2408 | 0.6814 | precision recall f1-score support
430
+
431
+ ALLERGY 1.0000 0.5000 0.6667 4
432
+ ASSESSMENT 0.5000 0.2500 0.3333 4
433
+ CC 0.5000 0.5000 0.5000 4
434
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
435
+ DISPOSITION 0.5000 0.5000 0.5000 2
436
+ EDCOURSE 0.0000 0.0000 0.0000 3
437
+ EXAM 1.0000 1.0000 1.0000 1
438
+ FAM/SOCHX 0.9130 0.9545 0.9333 22
439
+ GENHX 0.7917 0.9500 0.8636 20
440
+ GYNHX 0.0000 0.0000 0.0000 1
441
+ IMAGING 0.0000 0.0000 0.0000 1
442
+ IMMUNIZATIONS 1.0000 1.0000 1.0000 1
443
+ LABS 0.0000 0.0000 0.0000 1
444
+ MEDICATIONS 0.7000 1.0000 0.8235 7
445
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
446
+ PASTMEDICALHX 0.5000 1.0000 0.6667 4
447
+ PASTSURGICAL 0.8000 1.0000 0.8889 8
448
+ PLAN 1.0000 0.3333 0.5000 3
449
+ PROCEDURES 0.0000 0.0000 0.0000 1
450
+ ROS 0.8571 0.5455 0.6667 11
451
+
452
+ accuracy 0.7400 100
453
+ macro avg 0.5031 0.4767 0.4671 100
454
+ weighted avg 0.7265 0.7400 0.7118 100
455
+ |
456
+ | 0.0071 | 15.0 | 2580 | 0.6663 | precision recall f1-score support
457
+
458
+ ALLERGY 1.0000 0.5000 0.6667 4
459
+ ASSESSMENT 0.6667 0.5000 0.5714 4
460
+ CC 0.3750 0.7500 0.5000 4
461
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
462
+ DISPOSITION 0.3333 0.5000 0.4000 2
463
+ EDCOURSE 0.0000 0.0000 0.0000 3
464
+ EXAM 1.0000 1.0000 1.0000 1
465
+ FAM/SOCHX 0.9167 1.0000 0.9565 22
466
+ GENHX 0.8182 0.9000 0.8571 20
467
+ GYNHX 0.0000 0.0000 0.0000 1
468
+ IMAGING 0.0000 0.0000 0.0000 1
469
+ IMMUNIZATIONS 1.0000 1.0000 1.0000 1
470
+ LABS 0.0000 0.0000 0.0000 1
471
+ MEDICATIONS 0.8750 1.0000 0.9333 7
472
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
473
+ PASTMEDICALHX 0.5000 1.0000 0.6667 4
474
+ PASTSURGICAL 0.8889 1.0000 0.9412 8
475
+ PLAN 1.0000 0.3333 0.5000 3
476
+ PROCEDURES 0.0000 0.0000 0.0000 1
477
+ ROS 0.8571 0.5455 0.6667 11
478
+
479
+ accuracy 0.7600 100
480
+ macro avg 0.5115 0.5014 0.4830 100
481
+ weighted avg 0.7503 0.7600 0.7350 100
482
+ |
483
+ | 0.0071 | 16.0 | 2752 | 0.6422 | precision recall f1-score support
484
+
485
+ ALLERGY 1.0000 0.5000 0.6667 4
486
+ ASSESSMENT 0.6667 0.5000 0.5714 4
487
+ CC 0.5000 0.7500 0.6000 4
488
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
489
+ DISPOSITION 0.3333 0.5000 0.4000 2
490
+ EDCOURSE 0.0000 0.0000 0.0000 3
491
+ EXAM 1.0000 1.0000 1.0000 1
492
+ FAM/SOCHX 0.9167 1.0000 0.9565 22
493
+ GENHX 0.8182 0.9000 0.8571 20
494
+ GYNHX 0.0000 0.0000 0.0000 1
495
+ IMAGING 0.0000 0.0000 0.0000 1
496
+ IMMUNIZATIONS 1.0000 1.0000 1.0000 1
497
+ LABS 0.0000 0.0000 0.0000 1
498
+ MEDICATIONS 0.7778 1.0000 0.8750 7
499
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
500
+ PASTMEDICALHX 0.5000 1.0000 0.6667 4
501
+ PASTSURGICAL 0.8889 1.0000 0.9412 8
502
+ PLAN 1.0000 0.3333 0.5000 3
503
+ PROCEDURES 0.0000 0.0000 0.0000 1
504
+ ROS 0.8571 0.5455 0.6667 11
505
+
506
+ accuracy 0.7600 100
507
+ macro avg 0.5129 0.5014 0.4851 100
508
+ weighted avg 0.7485 0.7600 0.7349 100
509
+ |
510
+ | 0.0071 | 17.0 | 2924 | 0.6535 | precision recall f1-score support
511
+
512
+ ALLERGY 1.0000 0.5000 0.6667 4
513
+ ASSESSMENT 0.5000 0.5000 0.5000 4
514
+ CC 0.4286 0.7500 0.5455 4
515
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
516
+ DISPOSITION 0.3333 0.5000 0.4000 2
517
+ EDCOURSE 0.0000 0.0000 0.0000 3
518
+ EXAM 1.0000 1.0000 1.0000 1
519
+ FAM/SOCHX 0.9167 1.0000 0.9565 22
520
+ GENHX 0.8571 0.9000 0.8780 20
521
+ GYNHX 0.0000 0.0000 0.0000 1
522
+ IMAGING 0.0000 0.0000 0.0000 1
523
+ IMMUNIZATIONS 1.0000 1.0000 1.0000 1
524
+ LABS 0.0000 0.0000 0.0000 1
525
+ MEDICATIONS 0.8750 1.0000 0.9333 7
526
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
527
+ PASTMEDICALHX 0.4444 1.0000 0.6154 4
528
+ PASTSURGICAL 0.8889 1.0000 0.9412 8
529
+ PLAN 1.0000 0.3333 0.5000 3
530
+ PROCEDURES 0.0000 0.0000 0.0000 1
531
+ ROS 0.8571 0.5455 0.6667 11
532
+
533
+ accuracy 0.7600 100
534
+ macro avg 0.5051 0.5014 0.4802 100
535
+ weighted avg 0.7513 0.7600 0.7361 100
536
+ |
537
+ | 0.0035 | 18.0 | 3096 | 0.6340 | precision recall f1-score support
538
+
539
+ ALLERGY 1.0000 0.5000 0.6667 4
540
+ ASSESSMENT 0.6667 0.5000 0.5714 4
541
+ CC 0.4286 0.7500 0.5455 4
542
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
543
+ DISPOSITION 0.5000 0.5000 0.5000 2
544
+ EDCOURSE 0.0000 0.0000 0.0000 3
545
+ EXAM 1.0000 1.0000 1.0000 1
546
+ FAM/SOCHX 0.9167 1.0000 0.9565 22
547
+ GENHX 0.8571 0.9000 0.8780 20
548
+ GYNHX 0.0000 0.0000 0.0000 1
549
+ IMAGING 0.0000 0.0000 0.0000 1
550
+ IMMUNIZATIONS 1.0000 1.0000 1.0000 1
551
+ LABS 0.0000 0.0000 0.0000 1
552
+ MEDICATIONS 0.7778 1.0000 0.8750 7
553
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
554
+ PASTMEDICALHX 0.4444 1.0000 0.6154 4
555
+ PASTSURGICAL 1.0000 1.0000 1.0000 8
556
+ PLAN 0.5000 0.3333 0.4000 3
557
+ PROCEDURES 0.0000 0.0000 0.0000 1
558
+ ROS 0.8571 0.5455 0.6667 11
559
+
560
+ accuracy 0.7600 100
561
+ macro avg 0.4974 0.5014 0.4838 100
562
+ weighted avg 0.7484 0.7600 0.7386 100
563
+ |
564
+ | 0.0035 | 19.0 | 3268 | 0.6542 | precision recall f1-score support
565
+
566
+ ALLERGY 1.0000 0.5000 0.6667 4
567
+ ASSESSMENT 1.0000 0.5000 0.6667 4
568
+ CC 0.3750 0.7500 0.5000 4
569
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
570
+ DISPOSITION 0.5000 0.5000 0.5000 2
571
+ EDCOURSE 0.0000 0.0000 0.0000 3
572
+ EXAM 0.5000 1.0000 0.6667 1
573
+ FAM/SOCHX 0.9167 1.0000 0.9565 22
574
+ GENHX 0.8571 0.9000 0.8780 20
575
+ GYNHX 0.0000 0.0000 0.0000 1
576
+ IMAGING 0.0000 0.0000 0.0000 1
577
+ IMMUNIZATIONS 1.0000 1.0000 1.0000 1
578
+ LABS 0.0000 0.0000 0.0000 1
579
+ MEDICATIONS 0.8750 1.0000 0.9333 7
580
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
581
+ PASTMEDICALHX 0.4444 1.0000 0.6154 4
582
+ PASTSURGICAL 1.0000 1.0000 1.0000 8
583
+ PLAN 0.5000 0.3333 0.4000 3
584
+ PROCEDURES 0.0000 0.0000 0.0000 1
585
+ ROS 0.8571 0.5455 0.6667 11
586
+
587
+ accuracy 0.7600 100
588
+ macro avg 0.4913 0.5014 0.4725 100
589
+ weighted avg 0.7614 0.7600 0.7413 100
590
+ |
591
+ | 0.0035 | 20.0 | 3440 | 0.6560 | precision recall f1-score support
592
+
593
+ ALLERGY 1.0000 0.5000 0.6667 4
594
+ ASSESSMENT 0.6667 0.5000 0.5714 4
595
+ CC 0.3750 0.7500 0.5000 4
596
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
597
+ DISPOSITION 0.5000 0.5000 0.5000 2
598
+ EDCOURSE 0.0000 0.0000 0.0000 3
599
+ EXAM 1.0000 1.0000 1.0000 1
600
+ FAM/SOCHX 0.8800 1.0000 0.9362 22
601
+ GENHX 0.8571 0.9000 0.8780 20
602
+ GYNHX 0.0000 0.0000 0.0000 1
603
+ IMAGING 0.0000 0.0000 0.0000 1
604
+ IMMUNIZATIONS 1.0000 1.0000 1.0000 1
605
+ LABS 0.0000 0.0000 0.0000 1
606
+ MEDICATIONS 0.8750 1.0000 0.9333 7
607
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
608
+ PASTMEDICALHX 0.5000 1.0000 0.6667 4
609
+ PASTSURGICAL 1.0000 1.0000 1.0000 8
610
+ PLAN 0.5000 0.3333 0.4000 3
611
+ PROCEDURES 0.0000 0.0000 0.0000 1
612
+ ROS 0.8571 0.5455 0.6667 11
613
+
614
+ accuracy 0.7600 100
615
+ macro avg 0.5005 0.5014 0.4859 100
616
+ weighted avg 0.7472 0.7600 0.7384 100
617
+ |
618
+
619
+
620
+ ### Framework versions
621
+
622
+ - Transformers 4.35.2
623
+ - Pytorch 2.1.0+cu121
624
+ - Datasets 2.16.1
625
+ - Tokenizers 0.15.0
generation_config.json ADDED
@@ -0,0 +1,6 @@
 
 
 
 
 
 
 
1
+ {
2
+ "decoder_start_token_id": 0,
3
+ "eos_token_id": 1,
4
+ "pad_token_id": 0,
5
+ "transformers_version": "4.35.2"
6
+ }
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:d361e2501cae3f63e9cd93f356b31b83495132eb93888eba2454394d9bfbb975
3
  size 990345064
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0c4a590dcdf5c70f637c407ca9b89e7226e2e9f6c385ef4f1cfe13eecc92a18c
3
  size 990345064
runs/Jan14_22-35-33_06d97e0935bf/events.out.tfevents.1705271741.06d97e0935bf.977.1 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:2dcfbe9d8c6f970413610b51311d267033c42a90458094c80388ab20921950dc
3
- size 10833
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bd20713c5964270c6f014a299e255ad9e8057ad3b88bbdb338a06e692b69ce1f
3
+ size 12000