Instructions to use noamrot/FuseCap_Image_Captioning with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use noamrot/FuseCap_Image_Captioning with Transformers:
# Use a pipeline as a high-level helper # Warning: Pipeline type "image-to-text" is no longer supported in transformers v5. # You must load the model directly (see below) or downgrade to v4.x with: # 'pip install "transformers<5.0.0' from transformers import pipeline pipe = pipeline("image-to-text", model="noamrot/FuseCap_Image_Captioning")# Load model directly from transformers import AutoProcessor, AutoModelForImageTextToText processor = AutoProcessor.from_pretrained("noamrot/FuseCap_Image_Captioning") model = AutoModelForImageTextToText.from_pretrained("noamrot/FuseCap_Image_Captioning") - Notebooks
- Google Colab
- Kaggle
Update README.md
Browse files
README.md
CHANGED
|
@@ -52,12 +52,11 @@ The official codebase, datasets and trained models for this project will be rele
|
|
| 52 |
## BibTeX
|
| 53 |
|
| 54 |
``` Citation
|
| 55 |
-
@
|
| 56 |
-
|
| 57 |
-
|
| 58 |
-
|
| 59 |
-
|
| 60 |
-
|
| 61 |
-
primaryClass={cs.CV}
|
| 62 |
}
|
| 63 |
```
|
|
|
|
| 52 |
## BibTeX
|
| 53 |
|
| 54 |
``` Citation
|
| 55 |
+
@inproceedings{rotstein2024fusecap,
|
| 56 |
+
title={Fusecap: Leveraging large language models for enriched fused image captions},
|
| 57 |
+
author={Rotstein, Noam and Bensa{\"\i}d, David and Brody, Shaked and Ganz, Roy and Kimmel, Ron},
|
| 58 |
+
booktitle={Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision},
|
| 59 |
+
pages={5689--5700},
|
| 60 |
+
year={2024}
|
|
|
|
| 61 |
}
|
| 62 |
```
|