Instructions to use noamrot/FuseCap_Image_Captioning with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use noamrot/FuseCap_Image_Captioning with Transformers:
# Use a pipeline as a high-level helper # Warning: Pipeline type "image-to-text" is no longer supported in transformers v5. # You must load the model directly (see below) or downgrade to v4.x with: # 'pip install "transformers<5.0.0' from transformers import pipeline pipe = pipeline("image-to-text", model="noamrot/FuseCap_Image_Captioning")# Load model directly from transformers import AutoProcessor, AutoModelForImageTextToText processor = AutoProcessor.from_pretrained("noamrot/FuseCap_Image_Captioning") model = AutoModelForImageTextToText.from_pretrained("noamrot/FuseCap_Image_Captioning") - Notebooks
- Google Colab
- Kaggle
Update README.md
Browse files
README.md
CHANGED
|
@@ -5,7 +5,7 @@ pipeline_tag: image-to-text
|
|
| 5 |
tags:
|
| 6 |
- image-captioning
|
| 7 |
---
|
| 8 |
-
# FuseCap: Leveraging Large Language Models
|
| 9 |
|
| 10 |
A framework designed to generate semantically rich image captions.
|
| 11 |
|
|
@@ -53,7 +53,7 @@ The official codebase, datasets and trained models for this project will be rele
|
|
| 53 |
|
| 54 |
``` Citation
|
| 55 |
@article{rotstein2023fusecap,
|
| 56 |
-
title={FuseCap:
|
| 57 |
author={Rotstein, Noam and Bensaid, David and Brody, Shaked and Ganz, Roy and Kimmel, Ron},
|
| 58 |
journal={arXiv preprint arXiv:2305.17718},
|
| 59 |
year={2023}
|
|
|
|
| 5 |
tags:
|
| 6 |
- image-captioning
|
| 7 |
---
|
| 8 |
+
# FuseCap: Leveraging Large Language Models for Enriched Fused Image Captions
|
| 9 |
|
| 10 |
A framework designed to generate semantically rich image captions.
|
| 11 |
|
|
|
|
| 53 |
|
| 54 |
``` Citation
|
| 55 |
@article{rotstein2023fusecap,
|
| 56 |
+
title={FuseCap: a framework designed to generate semantically rich image captions.},
|
| 57 |
author={Rotstein, Noam and Bensaid, David and Brody, Shaked and Ganz, Roy and Kimmel, Ron},
|
| 58 |
journal={arXiv preprint arXiv:2305.17718},
|
| 59 |
year={2023}
|