Instructions to use spicyneuron/GLM-5.1-MLX-4.5bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use spicyneuron/GLM-5.1-MLX-4.5bit with MLX:

# Make sure mlx-lm is installed
# pip install --upgrade mlx-lm

# Generate text with mlx-lm
from mlx_lm import load, generate

model, tokenizer = load("spicyneuron/GLM-5.1-MLX-4.5bit")

prompt = "Write a story about Einstein"
messages = [{"role": "user", "content": prompt}]
prompt = tokenizer.apply_chat_template(
    messages, add_generation_prompt=True
)

text = generate(model, tokenizer, prompt=prompt, verbose=True)

Notebooks
Google Colab
Kaggle
Local Apps Settings
LM Studio

How to use spicyneuron/GLM-5.1-MLX-4.5bit with Pi:

Start the MLX server

# Install MLX LM:
uv tool install mlx-lm
# Start a local OpenAI-compatible server:
mlx_lm.server --model "spicyneuron/GLM-5.1-MLX-4.5bit"

Configure the model in Pi

# Install Pi:
npm install -g @mariozechner/pi-coding-agent
# Add to ~/.pi/agent/models.json:
{
  "providers": {
    "mlx-lm": {
      "baseUrl": "http://localhost:8080/v1",
      "api": "openai-completions",
      "apiKey": "none",
      "models": [
        {
          "id": "spicyneuron/GLM-5.1-MLX-4.5bit"
        }
      ]
    }
  }
}

Run Pi

# Start Pi in your project directory:
pi

Hermes Agent new

How to use spicyneuron/GLM-5.1-MLX-4.5bit with Hermes Agent:

Start the MLX server

# Install MLX LM:
uv tool install mlx-lm
# Start a local OpenAI-compatible server:
mlx_lm.server --model "spicyneuron/GLM-5.1-MLX-4.5bit"

Configure Hermes

# Install Hermes:
curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash
hermes setup
# Point Hermes at the local server:
hermes config set model.provider custom
hermes config set model.base_url http://127.0.0.1:8080/v1
hermes config set model.default spicyneuron/GLM-5.1-MLX-4.5bit

Run Hermes

hermes

OpenClaw new

How to use spicyneuron/GLM-5.1-MLX-4.5bit with OpenClaw:

Start the MLX server

# Install MLX LM:
uv tool install mlx-lm
# Start a local OpenAI-compatible server:
mlx_lm.server --model "spicyneuron/GLM-5.1-MLX-4.5bit"

Configure OpenClaw

# Install OpenClaw:
npm install -g openclaw@latest
# Register the local server and set it as the default model:
openclaw onboard --non-interactive --mode local \
  --auth-choice custom-api-key \
  --custom-base-url http://127.0.0.1:8080/v1 \
  --custom-model-id "spicyneuron/GLM-5.1-MLX-4.5bit" \
  --custom-provider-id mlx-lm \
  --custom-compatibility openai \
  --custom-text-input \
  --accept-risk \
  --skip-health

Run OpenClaw

openclaw agent --local --agent main --message "Hello from Hugging Face"

MLX LM

How to use spicyneuron/GLM-5.1-MLX-4.5bit with MLX LM:

Generate or start a chat session

# Install MLX LM
uv tool install mlx-lm
# Interactive chat REPL
mlx_lm.chat --model "spicyneuron/GLM-5.1-MLX-4.5bit"

Run an OpenAI-compatible server

# Install MLX LM
uv tool install mlx-lm
# Start the server
mlx_lm.server --model "spicyneuron/GLM-5.1-MLX-4.5bit"
# Calling the OpenAI-compatible server with curl
curl -X POST "http://localhost:8000/v1/chat/completions" \
   -H "Content-Type: application/json" \
   --data '{
     "model": "spicyneuron/GLM-5.1-MLX-4.5bit",
     "messages": [
       {"role": "user", "content": "Hello"}
     ]
   }'

spicyneuron commited on Jun 2

Commit

4e42204

verified ·

1 Parent(s): 3fc1246

Add files using upload-large-folder tool

Browse files

This view is limited to 50 files because it contains too many changes. See raw diff

Files changed (50) hide show

.gitattributes +1 -0
model-00003-of-00101.safetensors +3 -0
model-00005-of-00101.safetensors +3 -0
model-00006-of-00101.safetensors +3 -0
model-00009-of-00101.safetensors +3 -0
model-00012-of-00101.safetensors +3 -0
model-00014-of-00101.safetensors +3 -0
model-00017-of-00101.safetensors +3 -0
model-00018-of-00101.safetensors +3 -0
model-00020-of-00101.safetensors +3 -0
model-00023-of-00101.safetensors +3 -0
model-00025-of-00101.safetensors +3 -0
model-00026-of-00101.safetensors +3 -0
model-00031-of-00101.safetensors +3 -0
model-00032-of-00101.safetensors +3 -0
model-00033-of-00101.safetensors +3 -0
model-00034-of-00101.safetensors +3 -0
model-00036-of-00101.safetensors +3 -0
model-00037-of-00101.safetensors +3 -0
model-00038-of-00101.safetensors +3 -0
model-00039-of-00101.safetensors +3 -0
model-00040-of-00101.safetensors +3 -0
model-00041-of-00101.safetensors +3 -0
model-00042-of-00101.safetensors +3 -0
model-00044-of-00101.safetensors +3 -0
model-00045-of-00101.safetensors +3 -0
model-00047-of-00101.safetensors +3 -0
model-00048-of-00101.safetensors +3 -0
model-00053-of-00101.safetensors +3 -0
model-00055-of-00101.safetensors +3 -0
model-00056-of-00101.safetensors +3 -0
model-00057-of-00101.safetensors +3 -0
model-00059-of-00101.safetensors +3 -0
model-00061-of-00101.safetensors +3 -0
model-00062-of-00101.safetensors +3 -0
model-00064-of-00101.safetensors +3 -0
model-00067-of-00101.safetensors +3 -0
model-00070-of-00101.safetensors +3 -0
model-00072-of-00101.safetensors +3 -0
model-00073-of-00101.safetensors +3 -0
model-00075-of-00101.safetensors +3 -0
model-00076-of-00101.safetensors +3 -0
model-00077-of-00101.safetensors +3 -0
model-00078-of-00101.safetensors +3 -0
model-00079-of-00101.safetensors +3 -0
model-00080-of-00101.safetensors +3 -0
model-00081-of-00101.safetensors +3 -0
model-00083-of-00101.safetensors +3 -0
model-00084-of-00101.safetensors +3 -0
model-00085-of-00101.safetensors +3 -0

.gitattributes CHANGED Viewed

@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text

 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+tokenizer.json filter=lfs diff=lfs merge=lfs -text

model-00003-of-00101.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:2e00ac7902f95ec1ace82b68cf90165fbbeed38292ffe8d2a99d1dd7da83b732
+size 3777147007

model-00005-of-00101.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:dfc37348d32ac0d66c562161c6cf28e50a0a64721accced0573e19750873fe2a
+size 3877810512

model-00006-of-00101.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:b5d53c472f8e8b5e908e11252fa7b4b473affa9f0de1cdc1a5704906a4820548
+size 3777147103

model-00009-of-00101.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:9d9facedef303cd81b48e1aca8b4126d90ee8252b65363c10df8500372e00d31
+size 3877810516

model-00012-of-00101.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:6a33fcefbd10c2248fdcb40b6e73afe561cefc23460dc12db81b12f85d87b65b
+size 5335155736

model-00014-of-00101.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:188fc65c2ee941ec78f838112a164c95c75493db723a7ccf17c346ca567e8e6e
+size 3777147089

model-00017-of-00101.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:5bbd3123848318b54407854b822d312cb9f61aaaec78515819bb6505d35cdb3a
+size 3877810567

model-00018-of-00101.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:13623ce36d08af1c1a7901d6213ecf4a36238c21d3821e73af2bf9046f2eaed1
+size 3777147151

model-00020-of-00101.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:94a6173e265e6b1543c15c14bd2e8b200e3cbaa4d1b7f8eb9ba9275968d21246
+size 5335155738

model-00023-of-00101.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:6fc742f4ef348ebd5228c2bc81a7a4365e442c12c5056cac5c7ce8a30412869b
+size 3777147139

model-00025-of-00101.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:89f6a32e66a6590e46f95bdff99027a04f873e4c61fb117a6b880f02f2408deb
+size 3877810521

model-00026-of-00101.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:f6918e9413c099f42c126045e7ec71f3276b6d35b57269cea592941acea885fd
+size 3777147153

model-00031-of-00101.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:3295552adc9ff0332c5c7a12a744672defa01b220196db3d4cb8473ec45dba31
+size 3777147021

model-00032-of-00101.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:3946b70df6aa11ed4d5f392c602acbacd1bcb88210a1177a553634b3895eff6a
+size 5335155738

model-00033-of-00101.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:830ccf8fd6e6c05ba41bfe8771f3ac547e96de64c9ccdf6179a7120e2f1260c5
+size 3877810567

model-00034-of-00101.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:4af721b294bfcf918755eb181d77198e141deaef84903f97382b0b105d2f8660
+size 3777147153

model-00036-of-00101.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:d90461e0265d17fba4783f8046ff7c9e2d9326b1a0874f426a6a1d230d6695f7
+size 5335155738

model-00037-of-00101.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:6cbed5b4691f2b757a9ea447ed4e4ff74d20dd502a07c126acd6d0de8d6dea80
+size 3877810543

model-00038-of-00101.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:ee8ac19dc28e2ec5cce6de64b0ffdaf77e81fff7c0844be3685826af2cf89968
+size 3777147151

model-00039-of-00101.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:51c43fa1b063fe67d8ecbd4195acfaeac49bb20e48eaf0d8bc93a1a5f72edd81
+size 3777147033

model-00040-of-00101.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:22b402b1394fd36c5098046d83ac07efd790215fc047f26abeaf549483e112b0
+size 5335155734

model-00041-of-00101.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:4b79564ee188e724ca9983b447a9cc5141fe0b982c97ce85212780cb6d631cca
+size 3877810565

model-00042-of-00101.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:dac9b4b3c676936c584378b1892e3963d5e44b27853b5415d0c6895d34d83fbe
+size 3777147081

model-00044-of-00101.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:b8d89b97f93a123b97426cdf156d6ee07fcb0a09af4ebb7f97e70106aee08733
+size 5335155736

model-00045-of-00101.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:4cd9f54d4ab889e58ac443642a210bf2a302c327d0b3266e27c995b92d1141ad
+size 3877810565

model-00047-of-00101.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:e302c544c3c940570fa51df452d8bea92b02c4c5100fcc3e8dfee03bc37f4a3c
+size 3777147033

model-00048-of-00101.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:f7e911cb5bc3f868f0679728a8df440ca6a8aba7ed98db743b9e652f93644970
+size 5335155736

model-00053-of-00101.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:cfe6f61b1a98023e3f5d9f0827647b315b76e3bfe8151b625dce1f92de1821b5
+size 3877810563

model-00055-of-00101.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:9ef829e6f3c369a229bc62688de538e93c98751a8aca4e165264cb09da94a1c6
+size 3777147043

model-00056-of-00101.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:5c895fcacb8f3ff853a93a39a7bb1368f22d0f113a4d96362246d306ef411238
+size 5335155738

model-00057-of-00101.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:e4c828782bf13af1f1a5ffeeaaffd3154598b6c5f65fe5a19d28f8425eabb015
+size 3877810565

model-00059-of-00101.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:d9042a978ca96c498f87307f83ffebc660a48103f523c2539288344387f10181
+size 3777147101

model-00061-of-00101.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:0720e5d38e0231f6838cf5a3e0a6583f6494e4cd624ecc52799593be04bfafc8
+size 3877810533

model-00062-of-00101.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:96f14b99574ff2b76a0238cfceb424ccbe3abad6d225834abc89106dddf8dc98
+size 3777147139

model-00064-of-00101.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:6a0f22a96494a435ac9827f1c557c4261af44d7cfb9302c414d24fcb13c07dac
+size 5335155736

model-00067-of-00101.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:1a21b4b066b4484d5b4bbeb892571d3b3875a184f2355226d7e8a4dfdff3b5ff
+size 3777146993

model-00070-of-00101.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:2d6af2f0e357fd68b14c2d07377781a043889bd8fa9cc83fa535fbb1564ec464
+size 3777147129

model-00072-of-00101.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:c2d4ca85b83ce6c3f5f065927b15544e29a1872b6a50d21b2beefc02f9e60669
+size 5335155732

model-00073-of-00101.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:0fa2b08a9e3fc16e1efbcc5caf1297cb388ee446f75175efc6b23ddc8f20921a
+size 3877810547

model-00075-of-00101.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:c3f9544e68d9278cb890153931885470ca186c09cc432604b5ae5a249a72a288
+size 3777147081

model-00076-of-00101.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:cadbd19b538e3369fc4f9b3ff1765b41f85529b18196eb058ba05c452228ad56
+size 5335155734

model-00077-of-00101.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:b56c05b211f1fd9c2eae2380e75837754533a91cf9c4e9696db7524138efdef3
+size 3877810569

model-00078-of-00101.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:e6317928e9f2af392357703a996f577c9a6bc7dd429e202f2e99c546fdeb8434
+size 3777147143

model-00079-of-00101.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:cc9dbbec3f09baa1e68b900ced69675793b8aff5fce99f4e6ac97f364269abed
+size 3777147053

model-00080-of-00101.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:b21f90f5d46cb7ae81ab44722d094766b0764c96f6ae2077ed401d8a1795cb2d
+size 5335155736

model-00081-of-00101.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:be5e488c1b063c6967c4d64758b2b2cd3232fa1c0e8ffd04e52c35805d027fad
+size 3877810563

model-00083-of-00101.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:6128738194a2e403e16bc9c1b2da84889a252fe6b20a999b25235772d2901c2b
+size 3777147047

model-00084-of-00101.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:f95cf14faf1d5ea1ed540e6f19b98224a8ab31b9f96ce3d2e50c8d45c38e5c64
+size 5335155734

model-00085-of-00101.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:69a25fb75ae499dbcfc4e7dcc1cb042430357413b4bfce39c6e329aa9d73f2c9
+size 3877810571