Update README.md

README.md

@@ -51,6 +51,26 @@ model.push_to_hub("USERNAME/MODEL_NAME")
 processor.push_to_hub("USERNAME/MODEL_NAME")
 ```
 
+## Get predictions from the model
+
+You should ask specific questions to the model in order to get consistent generations. Here we are asking the model whether the sum of values that are in a chart are greater than the largest value.
+
+```python
+from transformers import Pix2StructForConditionalGeneration, Pix2StructProcessor
+import requests
+from PIL import Image
+
+model = Pix2StructForConditionalGeneration.from_pretrained('ybelkada/matcha-chartqa').to(0)
+processor = Pix2StructProcessor.from_pretrained('ybelkada/matcha-chartqa')
+url = "https://raw.githubusercontent.com/vis-nlp/ChartQA/main/ChartQA%20Dataset/val/png/20294671002019.png"
+image = Image.open(requests.get(url, stream=True).raw)
+
+inputs = processor(images=image, text="Is the sum of all 4 places greater than Laos?", return_tensors="pt").to(0)
+predictions = model.generate(**inputs, max_new_tokens=512)
+print(processor.decode(predictions[0], skip_special_tokens=True))
+>>> No
+```
+
 # Contribution
 
 This model was originally contributed by Fangyu Liu, Francesco Piccinno et al. and added to the Hugging Face ecosystem by [Younes Belkada](https://huggingface.co/ybelkada).