Instructions to use UCSC-VLAA/openvision2-vit-large-patch14-224-vision-only with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- OpenCLIP
How to use UCSC-VLAA/openvision2-vit-large-patch14-224-vision-only with OpenCLIP:
import open_clip model, preprocess_train, preprocess_val = open_clip.create_model_and_transforms('hf-hub:UCSC-VLAA/openvision2-vit-large-patch14-224-vision-only') tokenizer = open_clip.get_tokenizer('hf-hub:UCSC-VLAA/openvision2-vit-large-patch14-224-vision-only') - Notebooks
- Google Colab
- Kaggle
Add model card for OpenVision 2
#1
by nielsr HF Staff - opened
This PR adds a comprehensive model card for the OpenVision 2 model.
It links to the official paper: OpenVision 2: A Family of Generative Pretrained Visual Encoders for Multimodal Learning, its project page: https://ucsc-vlaa.github.io/OpenVision2/, and its GitHub repository: https://github.com/UCSC-VLAA/OpenVision/blob/main/src/main_openvision2.py.
Additionally, it includes the pipeline_tag: image-text-to-text in the metadata, making the model discoverable under the "Image-to-Text" pipeline at https://huggingface.co/models?pipeline_tag=image-text-to-text.