Instructions to use google/pix2struct-screen2words-base with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use google/pix2struct-screen2words-base with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("visual-question-answering", model="google/pix2struct-screen2words-base")# Load model directly from transformers import AutoProcessor, AutoModelForImageTextToText processor = AutoProcessor.from_pretrained("google/pix2struct-screen2words-base") model = AutoModelForImageTextToText.from_pretrained("google/pix2struct-screen2words-base") - Notebooks
- Google Colab
- Kaggle
Update README.md
Browse files
README.md
CHANGED
|
@@ -12,7 +12,7 @@ license: apache-2.0
|
|
| 12 |
---
|
| 13 |
|
| 14 |
|
| 15 |
-
# Model card for Pix2Struct - Finetuned on
|
| 16 |
|
| 17 |

|
| 18 |
|
|
|
|
| 12 |
---
|
| 13 |
|
| 14 |
|
| 15 |
+
# Model card for Pix2Struct - Finetuned on Screen2Words (Captioning a UI screen to describe functionality)
|
| 16 |
|
| 17 |

|
| 18 |
|