Update README.md

#2
by hschechter - opened
Files changed (1) hide show
  1. README.md +13 -31
README.md CHANGED
@@ -28,7 +28,6 @@ library_name: transformers
28
  <a href="https://github.com/google-gemma" target="_blank">GitHub</a> |
29
  <a href="https://blog.google/innovation-and-ai/technology/developers-tools/embeddinggemma-2" target="_blank">Launch Blog</a> |
30
  <a href="https://ai.google.dev/gemma/docs/embeddinggemma" target="_blank">Documentation</a> |
31
- <a href="https://arxiv.org/abs/2610.37364" target="_blank">Technical Report</a>
32
  <br>
33
  <b>License</b>: <a href="https://ai.google.dev/gemma/docs/gemma_4_license" target="_blank">Apache 2.0</a> | <b>Authors</b>: <a href="https://deepmind.google/models/gemma/" target="_blank">Google DeepMind</a>
34
  </p>
@@ -37,6 +36,9 @@ library_name: transformers
37
 
38
  Designed to run on consumer hardware such as mobile devices and laptops, EmbeddingGemma 2 delivers low-latency semantic representations for on-device applications, like search, retrieval-augmented generation (RAG), classification, and clustering.
39
 
 
 
 
40
  EmbeddingGemma 2 builds upon the architectural and capability advancements of Gemma 4, offering several core features:&nbsp;
41
 
42
  * **Native multimodality:** Native multimodality: Unifies 4 modalities (text, images, video, and audio) in a single shared 768-dimensional embedding space.
@@ -46,11 +48,10 @@ EmbeddingGemma 2 builds upon the architectural and capability advancements of Ge
46
  * **Context length:** 8K token context window, capable of processing minutes of audio or video.
47
  * **Task-steered representations:** Uses lightweight text instruction prefixes to optimize embeddings for different tasks (search, classification, clustering, semantic similarity, etc.).
48
 
49
- ### Model Overview
50
 
51
- | | | |
52
- |---|---|---|
53
- | **Parameters** | **Total** | 740M |
54
  | | **Backbone** | 130M |
55
  | | **Embedder** | 140M |
56
  | | **Modality Encoders** | *Vision:* 170M *Audio:* 300M |
@@ -81,12 +82,12 @@ EmbeddingGemma 2 was evaluated across text, code, vision, visual document, video
81
  | :---- | :---- | :---- | :---- | :---- |
82
  | *Text* | Massive Text Embedding Benchmark (MTEB, multilingual, v2) | Mean(Task), Multiple | 61.36 | 61.15 |
83
  | | Massive Text Embedding Benchmark (MTEB, code, v1) | Mean(Task), NDCG@10 | 78.68 | 68.76 |
84
- | *Image* | Massive Image Embedding Benchmark (MIEB, lite) | Mean(TaskType), Multiple | 65.67 | \- |
85
  | | Massive Multimodal Embedding Benchmark (MMEB v2 \- Image) | Mean(Task), Hit@1 | 57.28 | \- |
86
  | | Massive Multimodal Embedding Benchmark (MMEB v2 \- VisDoc) | Mean(Task), NDCG@5 | 67.84 | \- |
87
  | *Video* | Massive Multimodal Embedding Benchmark (MMEB v2 \- Video) | Mean(Task), Hit@1 | 50.67 | \- |
88
  | *Audio* | Massive Sound Embedding Benchmark (MSEB, Retrieval) | Mean(Task), MRR@10 | 69.54 | \- |
89
- | | Massive Audio Embedding Benchmark (MAEB) *Hugging Face*&nbsp; | Mean(Task), Multiple | 49.87 | \- |
90
 
91
  ### Evaluation Results with Vector Truncation
92
 
@@ -95,10 +96,10 @@ With this, model users can reduce storage requirements, with minimal quality imp
95
 
96
  | Output Dimension | Compression Ratio | MTEB *(multilingual, v2) Mean(Task)* | MTEB *(eng, v2) Mean(Task)* | MTEB *(code, v1) Mean(Task)* | MIEB *(lite) Mean(TaskType)* | MMEB (v2) *Overall* | MSEB *(Retrieval) Mean(Task)* | MAEB *Mean(Task)* |
97
  | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: |
98
- | 768d (Full) | 1:1 | 61.36 | 68.46 | 78.68 | 65.67 | 59.01 | 69.54 | 49.87 |
99
- | 512d | 1:1.5 | 61.17 | 68.41 | 77.24 | 65.34 | 58.38 | 69.18 | 49.76 |
100
- | 256d | 1:3 | 60.41 | 67.78 | 76.18 | 64.16 | 56.24 | 66.76 | 49.13 |
101
- | 128d | 1:6 | 57.89 | 65.68 | 71.41 | 59.97 | 45.65 | 56.71 | 47.28 |
102
 
103
  ## **Quick Start**
104
 
@@ -319,10 +320,7 @@ In creating an open embedding model, we have carefully considered the following:
319
  * Training data used for EmbeddingGemma 2 underwent safety filtering to mitigate the risk of these biases.
320
  * **Misinformation and Misuse**
321
  * Embedding representations can be misused to retrieve, classify, or otherwise organize embedded content in false, misleading or harmful ways.&nbsp;
322
- * Guidelines are provided for responsible use with the model, see the [Responsible Generative AI Toolkit](https://ai.google.dev/responsible).
323
- * **Transparency and Accountability**
324
- * This model card summarizes details on the model's architecture, capabilities, limitations, and evaluation processes.
325
- * A responsibly developed open model offers the opportunity to share innovation by making Vision-Language Model (VLM) technology accessible to developers and researchers across the AI ecosystem.
326
 
327
  ### Risks Identified and Mitigations
328
 
@@ -335,19 +333,3 @@ In creating an open embedding model, we have carefully considered the following:
335
  EmbeddingGemma 2 is among the strongest multimodal embedding models under 1B parameters. We’re excited to see how developers will use and adapt this model for on-device or edge AI applications.&nbsp;
336
 
337
  The model is designed from the ground up for responsible AI development, like other Gemma-family models.
338
-
339
- ## **Citation**
340
-
341
- If you find our work helpful, please consider citing it:
342
-
343
- ```bibtex
344
- @misc{embeddinggemma2_2026,
345
- title={EmbeddingGemma 2: Unified and Efficient Multimodal Representations},
346
- author={Schechter Vera, Henrique and Dua, Sahil and Team, EmbeddingGemma},
347
- year={2026},
348
- eprint={2610.37364},
349
- archivePrefix={arXiv},
350
- primaryClass={cs.LG},
351
- url={https://arxiv.org/abs/2610.37364}
352
- }
353
- ```
 
28
  <a href="https://github.com/google-gemma" target="_blank">GitHub</a> |
29
  <a href="https://blog.google/innovation-and-ai/technology/developers-tools/embeddinggemma-2" target="_blank">Launch Blog</a> |
30
  <a href="https://ai.google.dev/gemma/docs/embeddinggemma" target="_blank">Documentation</a> |
 
31
  <br>
32
  <b>License</b>: <a href="https://ai.google.dev/gemma/docs/gemma_4_license" target="_blank">Apache 2.0</a> | <b>Authors</b>: <a href="https://deepmind.google/models/gemma/" target="_blank">Google DeepMind</a>
33
  </p>
 
36
 
37
  Designed to run on consumer hardware such as mobile devices and laptops, EmbeddingGemma 2 delivers low-latency semantic representations for on-device applications, like search, retrieval-augmented generation (RAG), classification, and clustering.
38
 
39
+
40
+ ## **Model Overview**
41
+
42
  EmbeddingGemma 2 builds upon the architectural and capability advancements of Gemma 4, offering several core features:&nbsp;
43
 
44
  * **Native multimodality:** Native multimodality: Unifies 4 modalities (text, images, video, and audio) in a single shared 768-dimensional embedding space.
 
48
  * **Context length:** 8K token context window, capable of processing minutes of audio or video.
49
  * **Task-steered representations:** Uses lightweight text instruction prefixes to optimize embeddings for different tasks (search, classification, clustering, semantic similarity, etc.).
50
 
51
+ ### EmbeddingGemma 2
52
 
53
+ | Parameters | Total | 740M |
54
+ | :---- | :---- | :---- |
 
55
  | | **Backbone** | 130M |
56
  | | **Embedder** | 140M |
57
  | | **Modality Encoders** | *Vision:* 170M *Audio:* 300M |
 
82
  | :---- | :---- | :---- | :---- | :---- |
83
  | *Text* | Massive Text Embedding Benchmark (MTEB, multilingual, v2) | Mean(Task), Multiple | 61.36 | 61.15 |
84
  | | Massive Text Embedding Benchmark (MTEB, code, v1) | Mean(Task), NDCG@10 | 78.68 | 68.76 |
85
+ | *Image* | Massive Image Embedding Benchmark (MIEB, lite) | Mean(TaskType), Multiple | 64.64 | \- |
86
  | | Massive Multimodal Embedding Benchmark (MMEB v2 \- Image) | Mean(Task), Hit@1 | 57.28 | \- |
87
  | | Massive Multimodal Embedding Benchmark (MMEB v2 \- VisDoc) | Mean(Task), NDCG@5 | 67.84 | \- |
88
  | *Video* | Massive Multimodal Embedding Benchmark (MMEB v2 \- Video) | Mean(Task), Hit@1 | 50.67 | \- |
89
  | *Audio* | Massive Sound Embedding Benchmark (MSEB, Retrieval) | Mean(Task), MRR@10 | 69.54 | \- |
90
+ | | Massive Audio Embedding Benchmark (MAEB) *Hugging Face*&nbsp; | Mean(Task), Multiple | 49.39 | \- |
91
 
92
  ### Evaluation Results with Vector Truncation
93
 
 
96
 
97
  | Output Dimension | Compression Ratio | MTEB *(multilingual, v2) Mean(Task)* | MTEB *(eng, v2) Mean(Task)* | MTEB *(code, v1) Mean(Task)* | MIEB *(lite) Mean(TaskType)* | MMEB (v2) *Overall* | MSEB *(Retrieval) Mean(Task)* | MAEB *Mean(Task)* |
98
  | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: |
99
+ | 768d (Full) | 1:1 | 61.36 | 68.46 | 78.68 | 64.64 | 59.01 | 69.54 | 49.39 |
100
+ | 512d | 1:1.5 | 61.17 | 68.41 | 77.24 | 64.32 | 58.38 | 69.18 | 49.21 |
101
+ | 256d | 1:3 | 60.41 | 67.78 | 76.18 | 63.13 | 56.24 | 66.76 | 48.91 |
102
+ | 128d | 1:6 | 57.89 | 65.68 | 71.41 | 59.06 | 45.65 | 56.71 | 46.92 |
103
 
104
  ## **Quick Start**
105
 
 
320
  * Training data used for EmbeddingGemma 2 underwent safety filtering to mitigate the risk of these biases.
321
  * **Misinformation and Misuse**
322
  * Embedding representations can be misused to retrieve, classify, or otherwise organize embedded content in false, misleading or harmful ways.&nbsp;
323
+ * Guidelines are provided for responsible use with the model, see the [Responsible
 
 
 
324
 
325
  ### Risks Identified and Mitigations
326
 
 
333
  EmbeddingGemma 2 is among the strongest multimodal embedding models under 1B parameters. We’re excited to see how developers will use and adapt this model for on-device or edge AI applications.&nbsp;
334
 
335
  The model is designed from the ground up for responsible AI development, like other Gemma-family models.