Instructions to use Veritone/siglip2-base-patch16-224 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Veritone/siglip2-base-patch16-224 with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("zero-shot-image-classification", model="Veritone/siglip2-base-patch16-224") pipe( "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/hub/parrots.png", candidate_labels=["animals", "humans", "landscape"], )# pip install -U transformers accelerate # Load model directly from transformers import AutoProcessor, AutoModelForZeroShotImageClassification processor = AutoProcessor.from_pretrained("Veritone/siglip2-base-patch16-224") model = AutoModelForZeroShotImageClassification.from_pretrained("Veritone/siglip2-base-patch16-224", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Commit History
-
Fix model.safetensors: restore missing vision tower (was text-only)
Verified signature## What `model.safetensors` in this repo was missing the entire vision tower (all 208 `vision_model.*` tensors): - **full mirrors**: the file was byte-identical to `text_model.safetensors` (200 tensors: `text_model.*` + `logit_scale`/`logit_bias`; 1.13 GB) — the text-only blob had been uploaded under both names. The complete upstream checkpoint is 1.50 GB / 408 tensors. - **vision splits**: the file contained only `logit_scale`/`logit_bias` (144 bytes). ## Impact Anything loading the repo gets a **silently random-initialized vision tower** (`from_pretrained` warns about missing keys and continues). Concretely: the aiWARE `siglip2-chunk` engine bakes this checkpoint into its Docker image at build time; every image/video embedding it has produced is deterministic but meaningless noise. Verified empirically: engine-stored vectors vs true SigLIP2 embeddings of the exact same video frames give cosine ~0.06 (receipts: `services/playground/notebooks/siglip2_vector_verification.ipy…8fbe91b
-
Mirror google/siglip2-base-patch16-224
Verified signature7b764f9 -
initial commit
Verified signaturea7e8508