Instructions to use veason/ViTLP-medium with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use veason/ViTLP-medium with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoModelForPreTraining model = AutoModelForPreTraining.from_pretrained("veason/ViTLP-medium", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Commit History
-
Update README.md
Verified signaturec1551fa -
Update README.md
Verified signature--- tags: - Multimodal - Pre-trained Document Model --- # Visually Guided Generative Text-Layout Pre-training for Document Intelligence The ViTLP model was proposed in [Visually Guided Generative Text-Layout Pre-training for Document Intelligence](https://arxiv.org/abs/2403.16516), which is a generative foundation model for document intelligence. We provide the pre-trained checkpoint *ViTLP-medium* (380M). The pre-trained ViTLP model can natively perform OCR text localization and recognition. ## Demo on Document Text Recognition & Localization The code of ViTLP inference and demo is assisible at [https://github.com/Veason-silverbullet/ViTLP](https://github.com/Veason-silverbullet/ViTLP).   # Preset FAQ - Why is ViTLP-medium (380M)? …a588357
-
update
b154c5d -
initial commit
Verified signaturee7358ee