Hugging Face's logo

Sennodipoi
/
LayoutLMv3-kleisterNDA

Token Classification
Transformers
PyTorch
layoutlmv3
Model card Files
xet
 Community
3

Add Kleister NDA performance metrics

#2
by mbuet2ner - opened
Discussion
mbuet2ner

Hey Allesandro ☺️,

very cool thesis project and thanks for making all the code publically available!
It would be great, if you could make the performance metrics available, e.g., by putting it in the model card like Niels did.

That would be awesome!
Sennodipoi
 Owner

Hi Malte, glad to know that people are interested in this :)

You're definitely right, I should put more info in the model cards. I'm planning to update them all after my thesis defense.

In the meanwhile, if you are interested in LayoutLMv3 for Kleister-NDA, I was able to reach a f1 score of 0,94 using the same segmentation strategy used by the original authors for FUNSD i.e. using labels to create segments. However, in the case of Kleister-NDA I believe that this strategy significantly helps the model and thus it severely impacts the evaluation of the model.
Sennodipoi
 Owner

Hi, I added the resultsfor all the LayoutLM models.

Cheers,
Alessandro
Sennodipoi changed discussion status to closed

Sign up or log in to comment