bioner_gnormplus / performance_report.md
jakelever's picture
Upload folder using huggingface_hub
272cb7c verified

Performance on Training Set

Span Level

Label Precision Recall F1-score Support
DomainMotif 0.907 0.888 0.897 197
FamilyName 0.976 0.980 0.978 815
Gene 0.988 0.976 0.982 2243
macro avg 0.957 0.948 0.953 3255
weighted avg 0.980 0.972 0.976 3255

Token Level

Label Precision Recall F1-score Support
O 0.999 1.000 0.999 45948
B-DomainMotif 0.974 0.949 0.961 195
I-DomainMotif 0.996 0.989 0.993 536
B-FamilyName 0.993 0.990 0.991 816
I-FamilyName 0.994 0.997 0.996 1829
B-Gene 0.996 0.992 0.994 2239
I-Gene 0.999 0.998 0.998 4411
macro avg 0.993 0.988 0.990 55974
weighted avg 0.999 0.999 0.999 55974

Performance on Validation Set

Span Level

Label Precision Recall F1-score Support
DomainMotif 0.613 0.568 0.590 81
FamilyName 0.539 0.513 0.526 298
Gene 0.849 0.913 0.880 768
macro avg 0.667 0.665 0.665 1147
weighted avg 0.752 0.785 0.767 1147

Token Level

Label Precision Recall F1-score Support
O 0.982 0.983 0.982 15288
B-DomainMotif 0.754 0.642 0.693 81
I-DomainMotif 0.846 0.715 0.775 207
B-FamilyName 0.682 0.609 0.643 299
I-FamilyName 0.757 0.666 0.708 637
B-Gene 0.872 0.938 0.904 763
I-Gene 0.886 0.938 0.912 1446
macro avg 0.826 0.784 0.803 18721
weighted avg 0.955 0.956 0.956 18721

Performance on Testing Set

Span Level

Label Precision Recall F1-score Support
DomainMotif 0.602 0.670 0.634 361
FamilyName 0.497 0.569 0.530 1250
Gene 0.856 0.923 0.888 3225
macro avg 0.651 0.721 0.684 4836
weighted avg 0.744 0.812 0.777 4836

Token Level

Label Precision Recall F1-score Support
O 0.987 0.973 0.980 57537
B-DomainMotif 0.737 0.761 0.749 360
I-DomainMotif 0.847 0.815 0.831 979
B-FamilyName 0.619 0.674 0.645 1250
I-FamilyName 0.625 0.706 0.663 2481
B-Gene 0.887 0.934 0.910 3231
I-Gene 0.895 0.928 0.911 6028
macro avg 0.799 0.827 0.813 71866
weighted avg 0.953 0.950 0.951 71866