Sync model card from GitHub 85309ca
Browse files
README.md
CHANGED
|
@@ -32,8 +32,9 @@ Not affiliated with or endorsed by Google.
|
|
| 32 |
## Quick start
|
| 33 |
|
| 34 |
```bash
|
| 35 |
-
# 1. the runtime: a binary from this repo's `releases/`
|
| 36 |
-
|
|
|
|
| 37 |
# 2. the weights
|
| 38 |
hf download google/embeddinggemma-2 --local-dir models/embeddinggemma-2
|
| 39 |
# 3. embed (the model directory defaults to models/embeddinggemma-2)
|
|
@@ -56,8 +57,8 @@ Requests use the OpenAI embeddings format plus multimodal inputs and prompts, fo
|
|
| 56 |
`{"input": ["a query", {"image": "page1.png"}, {"text": "Figure 3:", "image": "fig3.png"}], "prompt_name": "SearchQuery"}`.
|
| 57 |
Images can be paths, data URLs or raw RGB pixels; concurrent requests are merged into shared GPU
|
| 58 |
passes. OpenAI-style clients (the `openai` SDK, LangChain, LlamaIndex) work against the HTTP server,
|
| 59 |
-
and a dependency-free Python client for the stdio server
|
| 60 |
-
|
| 61 |
Through it a short query takes 2.6 ms round trip. Details:
|
| 62 |
[Server mode](https://github.com/Dalailalama/embeddinggemma2-rust#server-mode-keep-the-model-loaded).
|
| 63 |
|
|
|
|
| 32 |
## Quick start
|
| 33 |
|
| 34 |
```bash
|
| 35 |
+
# 1. the runtime: `pip install egemma2` (binary + Python client), a binary from this repo's `releases/`
|
| 36 |
+
# folder or GitHub Releases, or build it
|
| 37 |
+
pip install egemma2
|
| 38 |
# 2. the weights
|
| 39 |
hf download google/embeddinggemma-2 --local-dir models/embeddinggemma-2
|
| 40 |
# 3. embed (the model directory defaults to models/embeddinggemma-2)
|
|
|
|
| 57 |
`{"input": ["a query", {"image": "page1.png"}, {"text": "Figure 3:", "image": "fig3.png"}], "prompt_name": "SearchQuery"}`.
|
| 58 |
Images can be paths, data URLs or raw RGB pixels; concurrent requests are merged into shared GPU
|
| 59 |
passes. OpenAI-style clients (the `openai` SDK, LangChain, LlamaIndex) work against the HTTP server,
|
| 60 |
+
and `pip install egemma2` brings a dependency-free Python client for the stdio server
|
| 61 |
+
(`from egemma2 import Egemma2`).
|
| 62 |
Through it a short query takes 2.6 ms round trip. Details:
|
| 63 |
[Server mode](https://github.com/Dalailalama/embeddinggemma2-rust#server-mode-keep-the-model-loaded).
|
| 64 |
|