tanganke/resisc45
Viewer • Updated • 69.3k • 17.6k • 2
How to use tanganke/clip-vit-large-patch14_resisc45 with Transformers:
# Use a pipeline as a high-level helper
from transformers import pipeline
pipe = pipeline("feature-extraction", model="tanganke/clip-vit-large-patch14_resisc45") # Load model directly
from transformers import AutoTokenizer, AutoModel
tokenizer = AutoTokenizer.from_pretrained("tanganke/clip-vit-large-patch14_resisc45")
model = AutoModel.from_pretrained("tanganke/clip-vit-large-patch14_resisc45")Adam Optimizer with a constant learning rate 1e-5 for 4000 steps training (batch_size=32). Only the vision encoder is fine-tuned.
Base model
openai/clip-vit-large-patch14