Image-Text-to-Text
MLX
Safetensors
inkling_mm_model
inkling
Mixture of Experts
multimodal
text-generation
conversational
Instructions to use mlx-community/Inkling-mlx-2bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use mlx-community/Inkling-mlx-2bit with MLX:
# Make sure mlx-vlm is installed # pip install --upgrade mlx-vlm from mlx_vlm import load, generate from mlx_vlm.prompt_utils import apply_chat_template from mlx_vlm.utils import load_config # Load the model model, processor = load("mlx-community/Inkling-mlx-2bit") config = load_config("mlx-community/Inkling-mlx-2bit") # Prepare input image = ["http://images.cocodataset.org/val2017/000000039769.jpg"] prompt = "Describe this image." # Apply chat template formatted_prompt = apply_chat_template( processor, config, prompt, num_images=1 ) # Generate output output = generate(model, processor, formatted_prompt, image) print(output) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Pi
How to use mlx-community/Inkling-mlx-2bit with Pi:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "mlx-community/Inkling-mlx-2bit"
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "mlx-lm": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "mlx-community/Inkling-mlx-2bit" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Hermes Agent
How to use mlx-community/Inkling-mlx-2bit with Hermes Agent:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "mlx-community/Inkling-mlx-2bit"
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default mlx-community/Inkling-mlx-2bit
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use mlx-community/Inkling-mlx-2bit with OpenClaw:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "mlx-community/Inkling-mlx-2bit"
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "mlx-community/Inkling-mlx-2bit" \ --custom-provider-id mlx-lm \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
Add files using upload-large-folder tool
Browse files- model-00001-of-00058.safetensors +3 -0
- model-00004-of-00058.safetensors +3 -0
- model-00005-of-00058.safetensors +3 -0
- model-00007-of-00058.safetensors +3 -0
- model-00010-of-00058.safetensors +3 -0
- model-00011-of-00058.safetensors +3 -0
- model-00013-of-00058.safetensors +3 -0
- model-00014-of-00058.safetensors +3 -0
- model-00015-of-00058.safetensors +3 -0
- model-00016-of-00058.safetensors +3 -0
- model-00017-of-00058.safetensors +3 -0
- model-00019-of-00058.safetensors +3 -0
- model-00021-of-00058.safetensors +3 -0
- model-00022-of-00058.safetensors +3 -0
- model-00025-of-00058.safetensors +3 -0
- model-00026-of-00058.safetensors +3 -0
- model-00029-of-00058.safetensors +3 -0
- model-00030-of-00058.safetensors +3 -0
- model-00033-of-00058.safetensors +3 -0
- model-00034-of-00058.safetensors +3 -0
- model-00035-of-00058.safetensors +3 -0
- model-00037-of-00058.safetensors +3 -0
- model-00038-of-00058.safetensors +3 -0
- model-00039-of-00058.safetensors +3 -0
- model-00044-of-00058.safetensors +3 -0
- model-00045-of-00058.safetensors +3 -0
- model-00046-of-00058.safetensors +3 -0
- model-00047-of-00058.safetensors +3 -0
- model-00049-of-00058.safetensors +3 -0
- model-00051-of-00058.safetensors +3 -0
- model-00052-of-00058.safetensors +3 -0
- model-00055-of-00058.safetensors +3 -0
- model-00056-of-00058.safetensors +3 -0
- tiktoken/tokenizer.model +3 -0
model-00001-of-00058.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:111a833974a7fbd805ed203760866bf00187832a6fecff00a14ee59be1797d21
|
| 3 |
+
size 5079282798
|
model-00004-of-00058.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:31f1fdf5d280c99b1f33cb13543154f7031e1ff4174ab2136d5c5163c6c01ef4
|
| 3 |
+
size 5962939955
|
model-00005-of-00058.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:4b3ec28c4c578b3df7191debe204a00565a3542dad866e39906c74ef4b6662ac
|
| 3 |
+
size 5085423736
|
model-00007-of-00058.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:6e5e49ab03f089a56aafc92ac1ae096f8b3f742f3027eb914ab846c4f23210aa
|
| 3 |
+
size 5800921871
|
model-00010-of-00058.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:be9465eac45e1ff057b667f509deb3813919d77c6f4dd7fdde52ac199279cebf
|
| 3 |
+
size 5052231997
|
model-00011-of-00058.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:138a438995470d98b925902573ddec4c231bbbd8785d44dd94b3f479c1d8023a
|
| 3 |
+
size 5065701084
|
model-00013-of-00058.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:fba492501b3137de7f7789f38040418199f6e649712a5f5d0aabf51e022374d4
|
| 3 |
+
size 5020699983
|
model-00014-of-00058.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:39f04706e5f57b2a72af5533062a8bc361e396136709bad055986ba138c3595b
|
| 3 |
+
size 5108998458
|
model-00015-of-00058.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:04198d63ed8b5c9db1987dae24ee51fe6fea38fd49c2ec3b629b53419b5a9b0e
|
| 3 |
+
size 6161032646
|
model-00016-of-00058.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:ddb7fea95ebeb5a51cb7bb27f604481878545feea285696c2d1ebda4e906798d
|
| 3 |
+
size 6052460514
|
model-00017-of-00058.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:656f7aa22345f2f13944d3284c73b40b4fdda0d9bf3f246e8d5ce87cd551d30c
|
| 3 |
+
size 5335744476
|
model-00019-of-00058.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:bf1af5742a491558c6f1a08c7bb3cf3c586b13d75e67e829fca62993abdaf013
|
| 3 |
+
size 6120289760
|
model-00021-of-00058.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:76885046b5f9e7ddaf40b26b9e780d4dd7ece375bfb4bff55ba0c73447a34a9c
|
| 3 |
+
size 6063616845
|
model-00022-of-00058.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:c4de2e627c8a9688300e00a0c709305dfde2c232b423fafd781712a2eeb8e93c
|
| 3 |
+
size 5096329498
|
model-00025-of-00058.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:a8248d8c1b36f2ffdb5af89dc99d32b63058d75d784006f0b17082dcb425c79c
|
| 3 |
+
size 5139544798
|
model-00026-of-00058.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:adf3ea6894ac04e96b941c7bce4d36f258d4e30292fd3517e62b6025c7abf7e1
|
| 3 |
+
size 5337828167
|
model-00029-of-00058.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:7e48f11acd50b044e00958a33c29e1b60ba9fc38d934290bfdfa09425144a889
|
| 3 |
+
size 5231100390
|
model-00030-of-00058.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:98d2ee85587195f82bab731631dc3ab08a1f3c78fc57702f3724e50b2b3ee2d5
|
| 3 |
+
size 5129340493
|
model-00033-of-00058.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:22461f7845c9a92822605cf90437c0e4f794d5949a0878ff8008def28841fc82
|
| 3 |
+
size 6017853759
|
model-00034-of-00058.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:6fb346ac76f10868c5e13194f02bdb09a4d88c86b60f55c154043c0f6143deef
|
| 3 |
+
size 5028914106
|
model-00035-of-00058.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:a58581f7dfbcc212263e8773c1ecb6b6d269105a0552474e62756608dc989c45
|
| 3 |
+
size 5954906071
|
model-00037-of-00058.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:37470357d3856daf90a2b418f7953a43f69232f42d1ef2f25bc7c74c292d0a72
|
| 3 |
+
size 5005805640
|
model-00038-of-00058.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:b2d450e4ff4f95fca4001094251c9041842c70fc348fb54701614cafbd330b8a
|
| 3 |
+
size 5019304840
|
model-00039-of-00058.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:725996f513055396eab1aef6655b89bfc3305be48243865c18d419dfd68afe80
|
| 3 |
+
size 5085384801
|
model-00044-of-00058.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:ab7157862ad18255b99b1d5e5ccad6f2b1ebd03809eedaf60a44c80de24b1a30
|
| 3 |
+
size 5008288237
|
model-00045-of-00058.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:c369afe14f1424d5a2803fd7b6878f58e4ea668f6a154d550a3dc8ad9a5f9cc2
|
| 3 |
+
size 5852123019
|
model-00046-of-00058.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:78e98d00bc59def35fb27e424aa5340c629bbd0f28ea9de8b13bbdb38b5070d4
|
| 3 |
+
size 6172069124
|
model-00047-of-00058.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:c7b8c4c893528fc1102ff15cf2749b35a414f56cd7a8a4a0d1e9aa3a50fc543e
|
| 3 |
+
size 6159418950
|
model-00049-of-00058.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:a014d28ebeaa08b8ae0cac7fab838ae20a951bdddc77295ffa6751186533757e
|
| 3 |
+
size 5913236748
|
model-00051-of-00058.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:84bd9dce35320095ba4351c2caaafed2912c2fc38f5a8b430e15ca699b0cd378
|
| 3 |
+
size 5071081901
|
model-00052-of-00058.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:4f9abbaf23b248c9451c28ef3b97752b054a130cf82788cc075efca296882b79
|
| 3 |
+
size 6093500411
|
model-00055-of-00058.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:bbc737c29a595da556bd863fafb865882dcadea8af9a23ba8a75efee53299583
|
| 3 |
+
size 5054639523
|
model-00056-of-00058.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:c31f471019a99218391db09b58497f5df1693ec85a98daea59f04060b35ead78
|
| 3 |
+
size 6114103647
|
tiktoken/tokenizer.model
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:bc253fd2b702f7a6da7105eaa8f3463b2f1247e83614f23e5323b921088bed2a
|
| 3 |
+
size 3615874
|