How to use aehrc/medicap with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("feature-extraction", model="aehrc/medicap", trust_remote_code=True)
# Load model directly from transformers import AutoTokenizer, AutoModel tokenizer = AutoTokenizer.from_pretrained("aehrc/medicap", trust_remote_code=True) model = AutoModel.from_pretrained("aehrc/medicap", trust_remote_code=True)
MedICap is a medical image captioning encoder-to-decoder model that placed first in the ImageCLEFmedical Caption 2023 challenge: https://www.imageclef.org/2023/medical/caption (team CSIRO).
Files info