Instructions to use Salesforce/blip-image-captioning-large with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Salesforce/blip-image-captioning-large with Transformers:
# Use a pipeline as a high-level helper # Warning: Pipeline type "image-to-text" is no longer supported in transformers v5. # You must load the model directly (see below) or downgrade to v4.x with: # 'pip install "transformers<5.0.0' from transformers import pipeline pipe = pipeline("image-to-text", model="Salesforce/blip-image-captioning-large")# Load model directly from transformers import AutoProcessor, AutoModelForImageTextToText processor = AutoProcessor.from_pretrained("Salesforce/blip-image-captioning-large") model = AutoModelForImageTextToText.from_pretrained("Salesforce/blip-image-captioning-large") - Notebooks
- Google Colab
- Kaggle
Image captioning using image url only without blob?
#23
by nappystock - opened
Hi!, how can I use image captioning when I only have image url? the constraint is:
- no need to open/read an image (ie. no
with open("/content/demo.jpg", "rb") as image_file...) - and using curl.
here's what I did (this works because it's an image blob):
curl https://api-inference.huggingface.co/models/Salesforce/blip-image-captioning-large \
-X POST \
--data-binary '@pilates.jpg' \
-H "Authorization: Bearer ${HF_API_TOKEN}"
# [{"generated_text": "there is a man doing a handstand on a rock in the woods"}]
But, is there any way to do a request where I only have image url?