Feature Extraction
Transformers
Safetensors
sentence-transformers
multilingual
embedding_gemma2
embedding
multimodal-embedding
multimodal
vision
audio
video
image-feature-extraction
audio-feature-extraction
video-feature-extraction
sentence-similarity
Instructions to use google/embeddinggemma-2 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use google/embeddinggemma-2 with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("feature-extraction", model="google/embeddinggemma-2")# pip install -U transformers accelerate # Load model directly from transformers import AutoProcessor, AutoModel processor = AutoProcessor.from_pretrained("google/embeddinggemma-2") model = AutoModel.from_pretrained("google/embeddinggemma-2", device_map="auto") - sentence-transformers
How to use google/embeddinggemma-2 with sentence-transformers:
from sentence_transformers import SentenceTransformer model = SentenceTransformer("google/embeddinggemma-2") sentences = [ "The weather is lovely today.", "It's so sunny outside!", "He drove to the stadium." ] embeddings = model.encode(sentences) similarities = model.similarity(embeddings, embeddings) print(similarities.shape) # [3, 3] - Notebooks
- Google Colab
- Kaggle
Update README.md
#3
by hschechter - opened
README.md
CHANGED
|
@@ -28,7 +28,6 @@ library_name: transformers
|
|
| 28 |
<a href="https://github.com/google-gemma" target="_blank">GitHub</a> |
|
| 29 |
<a href="https://blog.google/innovation-and-ai/technology/developers-tools/embeddinggemma-2" target="_blank">Launch Blog</a> |
|
| 30 |
<a href="https://ai.google.dev/gemma/docs/embeddinggemma" target="_blank">Documentation</a> |
|
| 31 |
-
<a href="https://arxiv.org/abs/2610.37364" target="_blank">Technical Report</a>
|
| 32 |
<br>
|
| 33 |
<b>License</b>: <a href="https://ai.google.dev/gemma/docs/gemma_4_license" target="_blank">Apache 2.0</a> | <b>Authors</b>: <a href="https://deepmind.google/models/gemma/" target="_blank">Google DeepMind</a>
|
| 34 |
</p>
|
|
@@ -48,9 +47,8 @@ EmbeddingGemma 2 builds upon the architectural and capability advancements of Ge
|
|
| 48 |
|
| 49 |
### Model Overview
|
| 50 |
|
| 51 |
-
| | | |
|
| 52 |
-
|---|---|---|
|
| 53 |
-
| **Parameters** | **Total** | 740M |
|
| 54 |
| | **Backbone** | 130M |
|
| 55 |
| | **Embedder** | 140M |
|
| 56 |
| | **Modality Encoders** | *Vision:* 170M *Audio:* 300M |
|
|
@@ -81,12 +79,12 @@ EmbeddingGemma 2 was evaluated across text, code, vision, visual document, video
|
|
| 81 |
| :---- | :---- | :---- | :---- | :---- |
|
| 82 |
| *Text* | Massive Text Embedding Benchmark (MTEB, multilingual, v2) | Mean(Task), Multiple | 61.36 | 61.15 |
|
| 83 |
| | Massive Text Embedding Benchmark (MTEB, code, v1) | Mean(Task), NDCG@10 | 78.68 | 68.76 |
|
| 84 |
-
| *Image* | Massive Image Embedding Benchmark (MIEB, lite) | Mean(TaskType), Multiple |
|
| 85 |
| | Massive Multimodal Embedding Benchmark (MMEB v2 \- Image) | Mean(Task), Hit@1 | 57.28 | \- |
|
| 86 |
| | Massive Multimodal Embedding Benchmark (MMEB v2 \- VisDoc) | Mean(Task), NDCG@5 | 67.84 | \- |
|
| 87 |
| *Video* | Massive Multimodal Embedding Benchmark (MMEB v2 \- Video) | Mean(Task), Hit@1 | 50.67 | \- |
|
| 88 |
| *Audio* | Massive Sound Embedding Benchmark (MSEB, Retrieval) | Mean(Task), MRR@10 | 69.54 | \- |
|
| 89 |
-
| | Massive Audio Embedding Benchmark (MAEB) *Hugging Face* | Mean(Task), Multiple | 49.
|
| 90 |
|
| 91 |
### Evaluation Results with Vector Truncation
|
| 92 |
|
|
@@ -95,10 +93,10 @@ With this, model users can reduce storage requirements, with minimal quality imp
|
|
| 95 |
|
| 96 |
| Output Dimension | Compression Ratio | MTEB *(multilingual, v2) Mean(Task)* | MTEB *(eng, v2) Mean(Task)* | MTEB *(code, v1) Mean(Task)* | MIEB *(lite) Mean(TaskType)* | MMEB (v2) *Overall* | MSEB *(Retrieval) Mean(Task)* | MAEB *Mean(Task)* |
|
| 97 |
| :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: |
|
| 98 |
-
| 768d (Full) | 1:1 | 61.36 | 68.46 | 78.68 |
|
| 99 |
-
| 512d | 1:1.5 | 61.17 | 68.41 | 77.24 |
|
| 100 |
-
| 256d | 1:3 | 60.41 | 67.78 | 76.18 |
|
| 101 |
-
| 128d | 1:6 | 57.89 | 65.68 | 71.41 | 59.
|
| 102 |
|
| 103 |
## **Quick Start**
|
| 104 |
|
|
@@ -319,10 +317,7 @@ In creating an open embedding model, we have carefully considered the following:
|
|
| 319 |
* Training data used for EmbeddingGemma 2 underwent safety filtering to mitigate the risk of these biases.
|
| 320 |
* **Misinformation and Misuse**
|
| 321 |
* Embedding representations can be misused to retrieve, classify, or otherwise organize embedded content in false, misleading or harmful ways.
|
| 322 |
-
* Guidelines are provided for responsible use with the model, see the [Responsible
|
| 323 |
-
* **Transparency and Accountability**
|
| 324 |
-
* This model card summarizes details on the model's architecture, capabilities, limitations, and evaluation processes.
|
| 325 |
-
* A responsibly developed open model offers the opportunity to share innovation by making Vision-Language Model (VLM) technology accessible to developers and researchers across the AI ecosystem.
|
| 326 |
|
| 327 |
### Risks Identified and Mitigations
|
| 328 |
|
|
@@ -335,19 +330,3 @@ In creating an open embedding model, we have carefully considered the following:
|
|
| 335 |
EmbeddingGemma 2 is among the strongest multimodal embedding models under 1B parameters. We’re excited to see how developers will use and adapt this model for on-device or edge AI applications.
|
| 336 |
|
| 337 |
The model is designed from the ground up for responsible AI development, like other Gemma-family models.
|
| 338 |
-
|
| 339 |
-
## **Citation**
|
| 340 |
-
|
| 341 |
-
If you find our work helpful, please consider citing it:
|
| 342 |
-
|
| 343 |
-
```bibtex
|
| 344 |
-
@misc{embeddinggemma2_2026,
|
| 345 |
-
title={EmbeddingGemma 2: Unified and Efficient Multimodal Representations},
|
| 346 |
-
author={Schechter Vera, Henrique and Dua, Sahil and Team, EmbeddingGemma},
|
| 347 |
-
year={2026},
|
| 348 |
-
eprint={2610.37364},
|
| 349 |
-
archivePrefix={arXiv},
|
| 350 |
-
primaryClass={cs.LG},
|
| 351 |
-
url={https://arxiv.org/abs/2610.37364}
|
| 352 |
-
}
|
| 353 |
-
```
|
|
|
|
| 28 |
<a href="https://github.com/google-gemma" target="_blank">GitHub</a> |
|
| 29 |
<a href="https://blog.google/innovation-and-ai/technology/developers-tools/embeddinggemma-2" target="_blank">Launch Blog</a> |
|
| 30 |
<a href="https://ai.google.dev/gemma/docs/embeddinggemma" target="_blank">Documentation</a> |
|
|
|
|
| 31 |
<br>
|
| 32 |
<b>License</b>: <a href="https://ai.google.dev/gemma/docs/gemma_4_license" target="_blank">Apache 2.0</a> | <b>Authors</b>: <a href="https://deepmind.google/models/gemma/" target="_blank">Google DeepMind</a>
|
| 33 |
</p>
|
|
|
|
| 47 |
|
| 48 |
### Model Overview
|
| 49 |
|
| 50 |
+
| Parameters | Total | 740M |
|
| 51 |
+
| :---- | :---- | :---- |
|
|
|
|
| 52 |
| | **Backbone** | 130M |
|
| 53 |
| | **Embedder** | 140M |
|
| 54 |
| | **Modality Encoders** | *Vision:* 170M *Audio:* 300M |
|
|
|
|
| 79 |
| :---- | :---- | :---- | :---- | :---- |
|
| 80 |
| *Text* | Massive Text Embedding Benchmark (MTEB, multilingual, v2) | Mean(Task), Multiple | 61.36 | 61.15 |
|
| 81 |
| | Massive Text Embedding Benchmark (MTEB, code, v1) | Mean(Task), NDCG@10 | 78.68 | 68.76 |
|
| 82 |
+
| *Image* | Massive Image Embedding Benchmark (MIEB, lite) | Mean(TaskType), Multiple | 64.64 | \- |
|
| 83 |
| | Massive Multimodal Embedding Benchmark (MMEB v2 \- Image) | Mean(Task), Hit@1 | 57.28 | \- |
|
| 84 |
| | Massive Multimodal Embedding Benchmark (MMEB v2 \- VisDoc) | Mean(Task), NDCG@5 | 67.84 | \- |
|
| 85 |
| *Video* | Massive Multimodal Embedding Benchmark (MMEB v2 \- Video) | Mean(Task), Hit@1 | 50.67 | \- |
|
| 86 |
| *Audio* | Massive Sound Embedding Benchmark (MSEB, Retrieval) | Mean(Task), MRR@10 | 69.54 | \- |
|
| 87 |
+
| | Massive Audio Embedding Benchmark (MAEB) *Hugging Face* | Mean(Task), Multiple | 49.39 | \- |
|
| 88 |
|
| 89 |
### Evaluation Results with Vector Truncation
|
| 90 |
|
|
|
|
| 93 |
|
| 94 |
| Output Dimension | Compression Ratio | MTEB *(multilingual, v2) Mean(Task)* | MTEB *(eng, v2) Mean(Task)* | MTEB *(code, v1) Mean(Task)* | MIEB *(lite) Mean(TaskType)* | MMEB (v2) *Overall* | MSEB *(Retrieval) Mean(Task)* | MAEB *Mean(Task)* |
|
| 95 |
| :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: |
|
| 96 |
+
| 768d (Full) | 1:1 | 61.36 | 68.46 | 78.68 | 64.64 | 59.01 | 69.54 | 49.39 |
|
| 97 |
+
| 512d | 1:1.5 | 61.17 | 68.41 | 77.24 | 64.32 | 58.38 | 69.18 | 49.21 |
|
| 98 |
+
| 256d | 1:3 | 60.41 | 67.78 | 76.18 | 63.13 | 56.24 | 66.76 | 48.91 |
|
| 99 |
+
| 128d | 1:6 | 57.89 | 65.68 | 71.41 | 59.06 | 45.65 | 56.71 | 46.92 |
|
| 100 |
|
| 101 |
## **Quick Start**
|
| 102 |
|
|
|
|
| 317 |
* Training data used for EmbeddingGemma 2 underwent safety filtering to mitigate the risk of these biases.
|
| 318 |
* **Misinformation and Misuse**
|
| 319 |
* Embedding representations can be misused to retrieve, classify, or otherwise organize embedded content in false, misleading or harmful ways.
|
| 320 |
+
* Guidelines are provided for responsible use with the model, see the [Responsible
|
|
|
|
|
|
|
|
|
|
| 321 |
|
| 322 |
### Risks Identified and Mitigations
|
| 323 |
|
|
|
|
| 330 |
EmbeddingGemma 2 is among the strongest multimodal embedding models under 1B parameters. We’re excited to see how developers will use and adapt this model for on-device or edge AI applications.
|
| 331 |
|
| 332 |
The model is designed from the ground up for responsible AI development, like other Gemma-family models.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|