Instructions to use vsearch/vdr-cross-modal with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use vsearch/vdr-cross-modal with Transformers:
# Load model directly from transformers import Retriever model = Retriever.from_pretrained("vsearch/vdr-cross-modal", dtype="auto") - Notebooks
- Google Colab
- Kaggle
Details about this model
#1
by sushmapiraka - opened
What does this model do?
Like just image and text crossmodal search or does it include audio and video too?
Hi, @sushmapiraka . Thanks for your interest.
This checkpoint only supprt text-image search. However, our methodology [1] can learn text-audio or text-video search if sufficient data and computational resources available.
[1] Retrieval-based Disentangled Representation Learning with Natural Language Supervision