Instructions to use AutomatosX/AX-EmbeddingGemma-2-MLX-AXQ-6bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use AutomatosX/AX-EmbeddingGemma-2-MLX-AXQ-6bit with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] hf download AutomatosX/AX-EmbeddingGemma-2-MLX-AXQ-6bit --local-dir AX-EmbeddingGemma-2-MLX-AXQ-6bit
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Atomic Chat
Download axquant_compatibility.json from AutomatosX/AX-EmbeddingGemma-2-MLX-AXQ-6bit: direct link, hf CLI and curl.
- Browser
- Download file 1.18 kB
-
https://huggingface.co/AutomatosX/AX-EmbeddingGemma-2-MLX-AXQ-6bit/resolve/main/axquant_compatibility.json
- Command line
-
hf download hf://AutomatosX/AX-EmbeddingGemma-2-MLX-AXQ-6bit/axquant_compatibility.json
-
curl -L -o axquant_compatibility.json https://huggingface.co/AutomatosX/AX-EmbeddingGemma-2-MLX-AXQ-6bit/resolve/main/axquant_compatibility.json
1.18 kB
| { | |
| "binding": { | |
| "config.json": "1d6b6b7907ca20f3bef3c4acfcdbe885fd462de04c7b05b2826722e808d3ddc4", | |
| "model.safetensors.index.json": "e9a450cd1b83d3fb17d3a08293b92b9cdb3056263a540443ceb05fb4bd9c1e00", | |
| "tensor_headers_sha256": "38d84f6e07a9021e4711f905ed176258e234d9473d13272a89839fbdc16e94d3" | |
| }, | |
| "model_type": "embedding_gemma2", | |
| "quality_certified": false, | |
| "schema_version": "axquant.runtime-compatibility.v1", | |
| "targets": { | |
| "mtplx": { | |
| "blockers": [ | |
| "No audited mtplx export profile for model_type 'embedding_gemma2'" | |
| ], | |
| "launch_environment": {}, | |
| "modality_constraints": [], | |
| "model_settings": {}, | |
| "mtp_verified": false, | |
| "profile": null, | |
| "required_actions": [], | |
| "runtime_verified": false, | |
| "status": "unsupported" | |
| }, | |
| "omlx": { | |
| "blockers": [ | |
| "No audited omlx export profile for model_type 'embedding_gemma2'" | |
| ], | |
| "launch_environment": {}, | |
| "modality_constraints": [], | |
| "model_settings": {}, | |
| "mtp_verified": false, | |
| "profile": null, | |
| "required_actions": [], | |
| "runtime_verified": false, | |
| "status": "unsupported" | |
| } | |
| } | |
| } | |