Instructions to use dhansmair/flamingo-mini with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use dhansmair/flamingo-mini with Transformers:
# Use a pipeline as a high-level helper # Warning: Pipeline type "image-to-text" is no longer supported in transformers v5. # You must load the model directly (see below) or downgrade to v4.x with: # 'pip install "transformers<5.0.0' from transformers import pipeline pipe = pipeline("image-to-text", model="dhansmair/flamingo-mini")# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("dhansmair/flamingo-mini", dtype="auto") - Notebooks
- Google Colab
- Kaggle
Fine-Tuning on Flamingo mini for Image Captioning
#1
by DonaldDaz - opened
Could you provide the code to execute fine tuning of the model on a custom dataset?
Hi there, sorry for the late reply.
I uploaded a training script on a separate branch in the repo: https://github.com/dhansmair/flamingo-mini/tree/training. You could adapt that to your needs.
However it is rather basic and also only works with one GPU.
I would love to set up a script using HuggingFace trainer, but unfortunately I don't have time at the moment.
This comment has been hidden