Instructions to use andito/Florence-2-large-ft with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use andito/Florence-2-large-ft with Transformers:
# Use a pipeline as a high-level helper # Warning: Pipeline type "image-to-text" is no longer supported in transformers v5. # You must load the model directly (see below) or downgrade to v4.x with: # 'pip install "transformers<5.0.0' from transformers import pipeline pipe = pipeline("image-to-text", model="andito/Florence-2-large-ft", trust_remote_code=True)# Load model directly from transformers import AutoProcessor, AutoModelForImageTextToText processor = AutoProcessor.from_pretrained("andito/Florence-2-large-ft", trust_remote_code=True) model = AutoModelForImageTextToText.from_pretrained("andito/Florence-2-large-ft", trust_remote_code=True) - Notebooks
- Google Colab
- Kaggle
Microsoft PR's have been merged?
#2
by dylanhogg - opened
Hi @andito ,
Firstly, thanks for putting together a great blogpost and code repo for fine-tuning florence2! It's very helpful.
Looking at the microsoft/Florence-2-large-ft model (and the other 3 variations), it looks like the referenced bugfix PRs have now been merged? https://huggingface.co/microsoft/Florence-2-large-ft/commits/main
Is that your understanding as well?
Yes! that seems to be the case :)