Feature Extraction
MLX
Safetensors
multilingual
embedding_gemma2
embedding
sentence-similarity
4-bit precision
Instructions to use tarantila/embeddinggemma-2-text-4bit-mlx with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use tarantila/embeddinggemma-2-text-4bit-mlx with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] hf download tarantila/embeddinggemma-2-text-4bit-mlx --local-dir embeddinggemma-2-text-4bit-mlx
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Atomic Chat
EmbeddingGemma 2, text part only, MLX 4-bit
The text encoder of Google EmbeddingGemma 2, cut out of
mlx-community/embeddinggemma-2-4bit
(source revision 914f7f89142e33e77833254d9c9b90c3cef7303b). The picture, sound and video towers are
not included: this copy turns text into a 768-number sentence vector and nothing else.
- Weights: only the
language_model.*tensors of the 4-bit conversion, unchanged (about 153 MB instead of 1.1 GB). config.jsonis the original one; a loader that builds only the text model ignores itsvision_configandaudio_config.- Text vectors are identical to those of the full 4-bit conversion.
Prompts, as in the original model: a request is prefixed with task: search result | query: , a
document with title: none | text: . Mean pooling over the tokens, then L2 normalisation.
Made for on-device search in the VoiceWork app (iPhone, MLX Swift).
Licence: Apache 2.0, as the original model. Attribution: Google.
- Downloads last month
- 63
Model size
0.3B params
Tensor type
U32
ยท
BF16 ยท
Hardware compatibility
Log In to add your hardware
4-bit
Model tree for tarantila/embeddinggemma-2-text-4bit-mlx
Base model
google/embeddinggemma-2