Create README
Browse files
README.md
ADDED
|
@@ -0,0 +1,61 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# HCAHPS survey comments multilabel classification
|
| 2 |
+
|
| 3 |
+
This model is a fine-tuned version of [Bio_ClinicalBERT](https://huggingface.co/emilyalsentzer/Bio_ClinicalBERT) on a dataset of HCAHPS survey comments.
|
| 4 |
+
|
| 5 |
+
It achieves the following results on the evaluation set:
|
| 6 |
+
|
| 7 |
+
precision recall f1-score support
|
| 8 |
+
|
| 9 |
+
medical 0.87 0.81 0.84 83
|
| 10 |
+
environmental 0.77 0.91 0.84 93
|
| 11 |
+
administration 0.58 0.32 0.41 22
|
| 12 |
+
communication 0.85 0.82 0.84 50
|
| 13 |
+
condition 0.42 0.52 0.46 29
|
| 14 |
+
treatment 0.90 0.78 0.83 68
|
| 15 |
+
food 0.92 0.94 0.93 36
|
| 16 |
+
clean 0.65 0.83 0.73 18
|
| 17 |
+
bathroom 0.64 0.64 0.64 14
|
| 18 |
+
discharge 0.83 0.83 0.83 24
|
| 19 |
+
wait 0.96 1.00 0.98 24
|
| 20 |
+
financial 0.44 1.00 0.62 4
|
| 21 |
+
extra_nice 0.20 0.13 0.16 23
|
| 22 |
+
rude 1.00 0.64 0.78 11
|
| 23 |
+
nurse 0.92 0.98 0.95 110
|
| 24 |
+
doctor 0.96 0.84 0.90 57
|
| 25 |
+
|
| 26 |
+
micro avg 0.81 0.81 0.81 666
|
| 27 |
+
macro avg 0.75 0.75 0.73 666
|
| 28 |
+
weighted avg 0.82 0.81 0.81 666
|
| 29 |
+
samples avg 0.64 0.64 0.62 666
|
| 30 |
+
|
| 31 |
+
## Model description
|
| 32 |
+
|
| 33 |
+
The model classifies free-text comments into the following labels
|
| 34 |
+
|
| 35 |
+
* Medical
|
| 36 |
+
* Environmental
|
| 37 |
+
* Administration
|
| 38 |
+
* Communication
|
| 39 |
+
* Condition
|
| 40 |
+
* Treatment
|
| 41 |
+
* Food
|
| 42 |
+
* Clean
|
| 43 |
+
* Bathroom
|
| 44 |
+
* Discharge
|
| 45 |
+
* Wait
|
| 46 |
+
* Financial
|
| 47 |
+
* Extra_nice
|
| 48 |
+
* Rude
|
| 49 |
+
* Nurse
|
| 50 |
+
* Doctor
|
| 51 |
+
|
| 52 |
+
## How to use
|
| 53 |
+
|
| 54 |
+
You can now use the models directly through the transformers library. Check out the [model's page](https://huggingface.co/joniponi/multilabel_inpatient_comments_16labels) for instructions on how to use the models within the Transformers library.
|
| 55 |
+
|
| 56 |
+
Load the model via the transformers library:
|
| 57 |
+
```
|
| 58 |
+
from transformers import AutoTokenizer, AutoModel
|
| 59 |
+
tokenizer = AutoTokenizer.from_pretrained("joniponi/multilabel_inpatient_comments_16labels")
|
| 60 |
+
model = AutoModel.from_pretrained("joniponi/multilabel_inpatient_comments_16labels")
|
| 61 |
+
```
|