Image-Text-to-Text
Transformers.js
ONNX
florence2
vision
text-generation
text2text-generation
image-to-text
Instructions to use onnx-community/Florence-2-base-ft with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers.js
How to use onnx-community/Florence-2-base-ft with Transformers.js:
// npm i @huggingface/transformers import { pipeline } from '@huggingface/transformers'; // Allocate pipeline const pipe = await pipeline('image-text-to-text', 'onnx-community/Florence-2-base-ft');
Error: Unsupported model type: florence2\n at Function.from_pretrained
#2
by alimoezzi - opened
I have tried to load this model. In transformer.js it gives error Error: Unsupported model type: florence2\n at Function.from_pretrained.
Before there's a warning Feature extractor type "CLIPImageProcessor" not found, assuming ImageFeatureExtractor due to size parameter in config.
Hi there! This model is currently still in a work-in-progress. Check out this thread for more information. The model card will be updated when we've got it working :)