Instructions to use orcarouter/GLM-5.3-MLX with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use orcarouter/GLM-5.3-MLX with MLX:

# Make sure mlx-lm is installed
# pip install --upgrade mlx-lm

# Generate text with mlx-lm
from mlx_lm import load, generate

model, tokenizer = load("orcarouter/GLM-5.3-MLX")

prompt = "Write a story about Einstein"
messages = [{"role": "user", "content": prompt}]
prompt = tokenizer.apply_chat_template(
    messages, add_generation_prompt=True
)

text = generate(model, tokenizer, prompt=prompt, verbose=True)

Notebooks
Google Colab
Kaggle
Local Apps Settings
LM Studio

How to use orcarouter/GLM-5.3-MLX with Pi:

Start the MLX server

# Install MLX LM:
uv tool install mlx-lm
# Start a local OpenAI-compatible server:
mlx_lm.server --model "orcarouter/GLM-5.3-MLX"

Configure the model in Pi

# Install Pi:
npm install -g @earendil-works/pi-coding-agent
# Add to ~/.pi/agent/models.json:
{
  "providers": {
    "mlx-lm": {
      "baseUrl": "http://localhost:8080/v1",
      "api": "openai-completions",
      "apiKey": "none",
      "models": [
        {
          "id": "orcarouter/GLM-5.3-MLX"
        }
      ]
    }
  }
}

Run Pi

# Start Pi in your project directory:
pi

MLX LM

How to use orcarouter/GLM-5.3-MLX with MLX LM:

Generate or start a chat session

# Install MLX LM
uv tool install mlx-lm
# Interactive chat REPL
mlx_lm.chat --model "orcarouter/GLM-5.3-MLX"

Run an OpenAI-compatible server

# Install MLX LM
uv tool install mlx-lm
# Start the server
mlx_lm.server --model "orcarouter/GLM-5.3-MLX"
# Calling the OpenAI-compatible server with curl
curl -X POST "http://localhost:8000/v1/chat/completions" \
   -H "Content-Type: application/json" \
   --data '{
     "model": "orcarouter/GLM-5.3-MLX",
     "messages": [
       {"role": "user", "content": "Hello"}
     ]
   }'

Hermes Agent

How to use orcarouter/GLM-5.3-MLX with Hermes Agent:

Start the MLX server

# Install MLX LM:
uv tool install mlx-lm
# Start a local OpenAI-compatible server:
mlx_lm.server --model "orcarouter/GLM-5.3-MLX"

Configure Hermes

# Install Hermes:
curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash
hermes setup
# Point Hermes at the local server:
hermes config set model.provider custom
hermes config set model.base_url http://127.0.0.1:8080/v1
hermes config set model.default orcarouter/GLM-5.3-MLX

Run Hermes

hermes

Atomic Chat

OpenClaw

How to use orcarouter/GLM-5.3-MLX with OpenClaw:

Start the MLX server

# Install MLX LM:
uv tool install mlx-lm
# Start a local OpenAI-compatible server:
mlx_lm.server --model "orcarouter/GLM-5.3-MLX"

Configure OpenClaw

# Install OpenClaw:
npm install -g openclaw@latest
# Register the local server and set it as the default model:
openclaw onboard --non-interactive --mode local \
  --auth-choice custom-api-key \
  --custom-base-url http://127.0.0.1:8080/v1 \
  --custom-model-id "orcarouter/GLM-5.3-MLX" \
  --custom-provider-id mlx-lm \
  --custom-compatibility openai \
  --custom-text-input \
  --accept-risk \
  --skip-health

Run OpenClaw

openclaw agent --local --agent main --message "Hello from Hugging Face"

hugging-yiii commited on 1 day ago

Commit

c070ae8

verified ·

1 Parent(s): 564677c

Add GLM-5.3 MLX builds: 2/3/4/6-bit OrcaSAQ (4-bit mirrored at root) (5/7)

Browse files

This view is limited to 50 files because it contains too many changes. See raw diff

Files changed (50) hide show

.gitattributes +1 -0
4-bit/model-00130-of-00140.safetensors +3 -0
4-bit/model-00131-of-00140.safetensors +3 -0
4-bit/model-00132-of-00140.safetensors +3 -0
4-bit/model-00133-of-00140.safetensors +3 -0
4-bit/model-00134-of-00140.safetensors +3 -0
4-bit/model-00135-of-00140.safetensors +3 -0
4-bit/model-00136-of-00140.safetensors +3 -0
4-bit/model-00137-of-00140.safetensors +3 -0
4-bit/model-00138-of-00140.safetensors +3 -0
4-bit/model-00139-of-00140.safetensors +3 -0
4-bit/model-00140-of-00140.safetensors +3 -0
4-bit/model.safetensors.index.json +3 -0
4-bit/tokenizer.json +3 -0
6-bit/model-00001-of-00140.safetensors +3 -0
6-bit/model-00002-of-00140.safetensors +3 -0
6-bit/model-00003-of-00140.safetensors +3 -0
6-bit/model-00004-of-00140.safetensors +3 -0
6-bit/model-00005-of-00140.safetensors +3 -0
6-bit/model-00006-of-00140.safetensors +3 -0
6-bit/model-00007-of-00140.safetensors +3 -0
6-bit/model-00008-of-00140.safetensors +3 -0
6-bit/model-00009-of-00140.safetensors +3 -0
6-bit/model-00010-of-00140.safetensors +3 -0
6-bit/model-00011-of-00140.safetensors +3 -0
6-bit/model-00012-of-00140.safetensors +3 -0
6-bit/model-00013-of-00140.safetensors +3 -0
6-bit/model-00014-of-00140.safetensors +3 -0
6-bit/model-00015-of-00140.safetensors +3 -0
6-bit/model-00016-of-00140.safetensors +3 -0
6-bit/model-00017-of-00140.safetensors +3 -0
6-bit/model-00018-of-00140.safetensors +3 -0
6-bit/model-00019-of-00140.safetensors +3 -0
6-bit/model-00020-of-00140.safetensors +3 -0
6-bit/model-00021-of-00140.safetensors +3 -0
6-bit/model-00022-of-00140.safetensors +3 -0
6-bit/model-00023-of-00140.safetensors +3 -0
6-bit/model-00024-of-00140.safetensors +3 -0
6-bit/model-00025-of-00140.safetensors +3 -0
6-bit/model-00026-of-00140.safetensors +3 -0
6-bit/model-00027-of-00140.safetensors +3 -0
6-bit/model-00028-of-00140.safetensors +3 -0
6-bit/model-00029-of-00140.safetensors +3 -0
6-bit/model-00030-of-00140.safetensors +3 -0
6-bit/model-00031-of-00140.safetensors +3 -0
6-bit/model-00032-of-00140.safetensors +3 -0
6-bit/model-00033-of-00140.safetensors +3 -0
6-bit/model-00034-of-00140.safetensors +3 -0
6-bit/model-00035-of-00140.safetensors +3 -0
6-bit/model-00036-of-00140.safetensors +3 -0

.gitattributes CHANGED Viewed

@@ -36,3 +36,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 model.safetensors.index.json filter=lfs diff=lfs merge=lfs -text
 2-bit/tokenizer.json filter=lfs diff=lfs merge=lfs -text
 3-bit/tokenizer.json filter=lfs diff=lfs merge=lfs -text

 model.safetensors.index.json filter=lfs diff=lfs merge=lfs -text
 2-bit/tokenizer.json filter=lfs diff=lfs merge=lfs -text
 3-bit/tokenizer.json filter=lfs diff=lfs merge=lfs -text
+4-bit/tokenizer.json filter=lfs diff=lfs merge=lfs -text

4-bit/model-00130-of-00140.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:1a795539a1c9c25ec47d6a66282d75549500e8917ff56743dc12e06c8e0b45d4
+size 3338417856

4-bit/model-00131-of-00140.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:74531282bd4ee240010d0f7bf223a21d0223a84b84b629fdf64ad963b66ad0e3
+size 3238684600

4-bit/model-00132-of-00140.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:b41887bcafbc28b27ac69e236521ece8bf5da5be4dc43bde7dee6a78014fe8ce
+size 3325178832

4-bit/model-00133-of-00140.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:ec317d5f29f81aefc2432abb2a9fe37df16b0e9315819f9d98fc99c520d3a1f3
+size 3238684448

4-bit/model-00134-of-00140.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:847498cd8b77faa5b19be75ae9b18f1f0cc1ec07e4c0d3178c4ee68cc179717a
+size 3326751856

4-bit/model-00135-of-00140.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:b7fb7c8953e953d11034b66e6ad65edd3693170642b012eb09a02d2f16524907
+size 3238684240

4-bit/model-00136-of-00140.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:c965348ee49c212eef246e8612572014d568552f443fe55931bc0b55705b1a3f
+size 1151362776

4-bit/model-00137-of-00140.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:43eca02ac8eaff35214e01850fcebc359fb5c2260b41258e001c287eb4820230
+size 2593003760

4-bit/model-00138-of-00140.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:55aa4b7135b1a2fcfe37a14a4fd65fbcb2d22c063854d750026b43be8d3089a5
+size 3238682624

4-bit/model-00139-of-00140.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:33d462e7c49d39d2a81e0d3b0a2a65ae7ac1f6e946e75f217564433e74d6a0bc
+size 3326751192

4-bit/model-00140-of-00140.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:c59d7204c299e2c397b009d069ea9c2745f8c57003cf6f53ce61da0cba073259
+size 2937447856

4-bit/model.safetensors.index.json ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:bb758dbe2b996600e13fab43c9982707266c1f01421c0a3d9281026bb511d1dc
+size 15908995

4-bit/tokenizer.json ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:19e773648cb4e65de8660ea6365e10acca112d42a854923df93db4a6f333a82d
+size 20217442

6-bit/model-00001-of-00140.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:e8c30f361fd1a6b1371223c8a5c6ec806841b16118acc20aaef1f2ac06736f3a
+size 5238968848

6-bit/model-00002-of-00140.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:d66847995ba01f305610864167b4da7cfcad611be3e2e09a65bad4b7dc56886a
+size 4802111816

6-bit/model-00003-of-00140.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:c6b1972571ea8cf67801a51021c4d1a903ef870780a69d45f8589384c4b6c07a
+size 4849940552

6-bit/model-00004-of-00140.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:348529d1ddc6feb4658210855681fe875b4852c222e6705c82e0b09caf7433e1
+size 4802111728

6-bit/model-00005-of-00140.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:0656fa54220c217573145c8c9c0d8dfaab4689f1b9ee6f2f9e343dd026418fe5
+size 4838274464

6-bit/model-00006-of-00140.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:fc904ffb0d4e061b63758de7cefa34fd92ef6c8fb02b4a6bba43c3403a3e5557
+size 4802111528

6-bit/model-00007-of-00140.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:b13f1d10999330e317421eab6ac79413910bcd127815ff3faf7128a987cbe336
+size 4841420408

6-bit/model-00008-of-00140.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:ee279f5476161ab056e1877b629d335ab199a8467a1862b3281583b6e9d17688
+size 4802111320

6-bit/model-00009-of-00140.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:86dd8e3ed9a4e5ed6ccf00aee939b372e296d8419fffffe81118ed976226c770
+size 4841420624

6-bit/model-00010-of-00140.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:b5b1b24f6ec69e2f4539354fa1d77f00a4ca26219e70b23836fb951b485f7fed
+size 4802111120

6-bit/model-00011-of-00140.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:499f259436bfc34c4b8f7a1907c5881dbf4560a88f00c6c3ee49c408db76080f
+size 4846795520

6-bit/model-00012-of-00140.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:0fe5d17a46be33eb24d33ec287ee9ed14647128144217c61ae5fb5dfc77286c8
+size 4841420104

6-bit/model-00013-of-00140.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:709f0a71c608ec28cdf907dd54ad9209c32166efcbcc9535ebbb40496f03fe77
+size 4802111816

6-bit/model-00014-of-00140.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:cec546a9615d8e319c3b6eb111f5e89c0187e52eabc90a41182a3909d6a38e1d
+size 4838274376

6-bit/model-00015-of-00140.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:109b08ed2eb6428bcf310da8142da6b7627e0d7fec9f1b189abae2ad14ffa45c
+size 4802111800

6-bit/model-00016-of-00140.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:0087c2169eb904028ee41f68063fb00ba1c31f6200c90cfe9b4144b72c564163
+size 4841420136

6-bit/model-00017-of-00140.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:735c7e21c40bb58fb78753f229976bde8d2eb0e0729fe4495f39f64e90b63c7d
+size 4802111592

6-bit/model-00018-of-00140.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:b298606d7af35437ebbd2512b3c95eb2c1f6576252ab56c0dba18d2bacbf4d3e
+size 4846795040

6-bit/model-00019-of-00140.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:fbfeb9538901c5c6b8247254f7723dbd4676a58de7a3dc8364ac676f732f566f
+size 4802111392

6-bit/model-00020-of-00140.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:6430d6b7d6229fbf67b5a9867f851b7f51b7de15acb1809c187d8fd3cfbc7df1
+size 4857785760

6-bit/model-00021-of-00140.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:08e3135644ff1fb94637042bcfe8f8a66183631cef9bc7bfa2667f64c17c60ca
+size 4802111272

6-bit/model-00022-of-00140.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:f8d748c9510e80baaa37df29150b6b52a93022a88c5062839efac7886af27218
+size 4841420664

6-bit/model-00023-of-00140.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:5f98595346c9a75c3935364d724c57294431eb813d66c6d6dc79e4ab068b1cdf
+size 4807327840

6-bit/model-00024-of-00140.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:32b7cccf7dead19f48d7664ce5a08b280e7ff54cd9c6f286f484416f9479e658
+size 4822834408

6-bit/model-00025-of-00140.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:9de6169f47baa0603478444e42424efe83dd0b0370db3ce99a14a2a476cd45fc
+size 4849940552

6-bit/model-00026-of-00140.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:00eb91a66f7d3564f1d1972b4338a1bba63a5225b698221b06232393a5031926
+size 4802111816

6-bit/model-00027-of-00140.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:99d426c935ab8916c987d92f3dfde8ae95b0486f8bd3a03eaa4c156837ae8e3e
+size 4838274384

6-bit/model-00028-of-00140.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:54a48856ed162ef0feef8e740e2bbd335e18b06851afb950d2060abba6b0b99b
+size 4802111744

6-bit/model-00029-of-00140.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:faad1ddb9b67e800f0197ecd51005ff4189c0adfdd228f1fe851abae4e2dc354
+size 4841420192

6-bit/model-00030-of-00140.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:187acc5c5845dd000801a6a22e59513a50e184766640e43cbeeb27f5b2ab8559
+size 4802111536

6-bit/model-00031-of-00140.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:b72fdd27b4fe1f1f7f746f2224977e310c86538f5e2b2baddc6fe51dc08806b8
+size 4841420384

6-bit/model-00032-of-00140.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:172f15e26d4f90aae29aaf20a0a4213d3517b9b6d26e200e83d8490d6563f859
+size 4802111336

6-bit/model-00033-of-00140.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:63d34bcaab04d918def7d77cc6da67d38137d90fca2c9d625ab40a63828c9f10
+size 4846795312

6-bit/model-00034-of-00140.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:e21bdfbdee531ae4caca42f0e00acd8fe161d2d615bdf12c30cca6f91556a48d
+size 4802111128

6-bit/model-00035-of-00140.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:2fe250d31185ec2e4c07a33d5af52322f665dcaacadb9cceaa72e835c66ac6bd
+size 4841420792

6-bit/model-00036-of-00140.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:f85ae53192674110800e8e01206e47b1139a986ed99e921fbe0e614c14550fa5
+size 4838274384