bioner_nlmchem / performance_report.md
jakelever's picture
Upload folder using huggingface_hub
dbfe4a2 verified

Performance on Training Set

Span Level

Label Precision Recall F1-score Support
Chemical 0.984 0.961 0.972 20200
macro avg 0.984 0.961 0.972 20200
weighted avg 0.984 0.961 0.972 20200

Token Level

Label Precision Recall F1-score Support
O 1.000 1.000 1.000 533624
B-Chemical 0.993 0.997 0.995 20993
I-Chemical 0.996 0.998 0.997 32083
macro avg 0.996 0.998 0.997 586700
weighted avg 0.999 0.999 0.999 586700

Performance on Validation Set

Span Level

Label Precision Recall F1-score Support
Chemical 0.887 0.801 0.842 5092
macro avg 0.887 0.801 0.842 5092
weighted avg 0.887 0.801 0.842 5092

Token Level

Label Precision Recall F1-score Support
O 0.994 0.995 0.995 131745
B-Chemical 0.938 0.892 0.914 5213
I-Chemical 0.929 0.955 0.942 6131
macro avg 0.954 0.947 0.950 143089
weighted avg 0.989 0.990 0.989 143089

Performance on Testing Set

Span Level

Label Precision Recall F1-score Support
Chemical 0.842 0.846 0.844 11139
macro avg 0.842 0.846 0.844 11139
weighted avg 0.842 0.846 0.844 11139

Token Level

Label Precision Recall F1-score Support
O 0.996 0.992 0.994 303848
B-Chemical 0.892 0.945 0.918 11571
I-Chemical 0.909 0.944 0.926 15600
macro avg 0.932 0.960 0.946 331019
weighted avg 0.988 0.988 0.988 331019