File size: 1,677 Bytes
fae9a16 19b77c1 fae9a16 19b77c1 fae9a16 19b77c1 fae9a16 19b77c1 fae9a16 5ab3f83 fae9a16 5ab3f83 fae9a16 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 |
### Model Description
DocModel is a document understanding model built on the RoBERTa architecture. It captures both textual content and 2D spatial relationships, making it ideal for tasks that require processing complex document layouts, such as forms, tables, and scanned documents.
Developed by: Oluwatobi Adefami, Madison May
Model type: Document Understanding (Information Extraction)
License: Apache-2.0
Model Sources
Repository: https://github.com/Tobiadefami/docmodel
### Uses
DocModel can be directly used for document processing, form understanding, and entity extraction from structured and semi-structured documents.
### Out-of-Scope Use
Not recommended for tasks that involve purely textual data without layout components or heavily distorted document scans.
### Bias, Risks, and Limitations
DocModel’s performance may degrade on highly noisy or poorly structured documents, such as extreme distortions or low-resolution scans.
### Recommendations
Users should be mindful of the model’s limitations, particularly in handling documents with severe layout inconsistencies.
How to Get Started with the Model
``` python
from transformers import AutoTokenizer, AutoModel
tokenizer = AutoTokenizer.from_pretrained("tobiadefami/docmodel-base")
model = AutoModel.from_pretrained("tobiadefami/docmodel-base")
# Example usage
inputs = tokenizer("Your document text here...", return_tensors="pt")
outputs = model(**inputs)
```
### Evaluation
##### Metrics
Eval Loss: 1.36752
F1-Score: 0.84126
### Results
DocModel has been evaluated on the FUNSD dataset for information extraction tasks, demonstrating competitive performance in both loss and F1-score. |