README.md

---
license: mit
datasets:
- de-Rodrigo/merit
language:
- en
- es
base_model:
- HuggingFaceM4/idefics2-8b
pipeline_tag: image-text-to-text
---

# IDEFICS2 Merit

<a href="https://x.com/nearcyan/status/1706914605262684394">
  <div style="text-align: center;">
    <picture>
      <source media="(prefers-color-scheme: dark)" srcset="https://huggingface.co/de-Rodrigo/donut-merit/resolve/main/assets/dragon_huggingface.png">
      <source media="(prefers-color-scheme: light)" srcset="https://huggingface.co/de-Rodrigo/donut-merit/resolve/main/assets/dragon_huggingface.png">
      <img alt="DragonHuggingFace" src="https://huggingface.co/de-Rodrigo/donut-merit/resolve/main/assets/dragon_huggingface.png" style="width: 200px;">
    </picture>
  </div>
</a>


## Model Architecture
**This model is based on the Donut architecture and fine-tuned on the Merit dataset for form understanding tasks.**

- Backbone: [Idefics2](https://huggingface.co/HuggingFaceM4/idefics2-8b)
- Training Data: [Merit](https://huggingface.co/datasets/de-Rodrigo/merit)

## Example Usage

```python
from transformers import AutoModel

model = AutoModel.from_pretrained("de-Rodrigo/idefics2-merit")
```
**WIP** 🛠️