Instructions to use google/deplot with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use google/deplot with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("visual-question-answering", model="google/deplot")# Load model directly from transformers import AutoProcessor, AutoModelForImageTextToText processor = AutoProcessor.from_pretrained("google/deplot") model = AutoModelForImageTextToText.from_pretrained("google/deplot") - Notebooks
- Google Colab
- Kaggle
how can i train with korean based chart image?
#12
by jpjp9292 - opened
I was trying to fine tune DePlot model from huggingface(https://huggingface.co/google/deplot). It was able to load model and test with chart image to convert into table.
Question is how can i use the result of decoded table to LLM model. if possible i wanna i wanna use with T5model for text summation and question answering.
jpjp9292 changed discussion status to closed