Instructions to use orcarouter/GLM-5.3-MLX with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use orcarouter/GLM-5.3-MLX with MLX:

# Make sure mlx-lm is installed
# pip install --upgrade mlx-lm

# Generate text with mlx-lm
from mlx_lm import load, generate

model, tokenizer = load("orcarouter/GLM-5.3-MLX")

prompt = "Write a story about Einstein"
messages = [{"role": "user", "content": prompt}]
prompt = tokenizer.apply_chat_template(
    messages, add_generation_prompt=True
)

text = generate(model, tokenizer, prompt=prompt, verbose=True)

Notebooks
Google Colab
Kaggle
Local Apps Settings
LM Studio

How to use orcarouter/GLM-5.3-MLX with Pi:

Start the MLX server

# Install MLX LM:
uv tool install mlx-lm
# Start a local OpenAI-compatible server:
mlx_lm.server --model "orcarouter/GLM-5.3-MLX"

Configure the model in Pi

# Install Pi:
npm install -g @earendil-works/pi-coding-agent
# Add to ~/.pi/agent/models.json:
{
  "providers": {
    "mlx-lm": {
      "baseUrl": "http://localhost:8080/v1",
      "api": "openai-completions",
      "apiKey": "none",
      "models": [
        {
          "id": "orcarouter/GLM-5.3-MLX"
        }
      ]
    }
  }
}

Run Pi

# Start Pi in your project directory:
pi

MLX LM

How to use orcarouter/GLM-5.3-MLX with MLX LM:

Generate or start a chat session

# Install MLX LM
uv tool install mlx-lm
# Interactive chat REPL
mlx_lm.chat --model "orcarouter/GLM-5.3-MLX"

Run an OpenAI-compatible server

# Install MLX LM
uv tool install mlx-lm
# Start the server
mlx_lm.server --model "orcarouter/GLM-5.3-MLX"
# Calling the OpenAI-compatible server with curl
curl -X POST "http://localhost:8000/v1/chat/completions" \
   -H "Content-Type: application/json" \
   --data '{
     "model": "orcarouter/GLM-5.3-MLX",
     "messages": [
       {"role": "user", "content": "Hello"}
     ]
   }'

Hermes Agent

How to use orcarouter/GLM-5.3-MLX with Hermes Agent:

Start the MLX server

# Install MLX LM:
uv tool install mlx-lm
# Start a local OpenAI-compatible server:
mlx_lm.server --model "orcarouter/GLM-5.3-MLX"

Configure Hermes

# Install Hermes:
curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash
hermes setup
# Point Hermes at the local server:
hermes config set model.provider custom
hermes config set model.base_url http://127.0.0.1:8080/v1
hermes config set model.default orcarouter/GLM-5.3-MLX

Run Hermes

hermes

Atomic Chat

OpenClaw

How to use orcarouter/GLM-5.3-MLX with OpenClaw:

Start the MLX server

# Install MLX LM:
uv tool install mlx-lm
# Start a local OpenAI-compatible server:
mlx_lm.server --model "orcarouter/GLM-5.3-MLX"

Configure OpenClaw

# Install OpenClaw:
npm install -g openclaw@latest
# Register the local server and set it as the default model:
openclaw onboard --non-interactive --mode local \
  --auth-choice custom-api-key \
  --custom-base-url http://127.0.0.1:8080/v1 \
  --custom-model-id "orcarouter/GLM-5.3-MLX" \
  --custom-provider-id mlx-lm \
  --custom-compatibility openai \
  --custom-text-input \
  --accept-risk \
  --skip-health

Run OpenClaw

openclaw agent --local --agent main --message "Hello from Hugging Face"

hugging-yiii commited on 1 day ago

Commit

e1f8e66

verified ·

1 Parent(s): d6a95eb

Add GLM-5.3 MLX builds: 2/3/4/6-bit OrcaSAQ (4-bit mirrored at root) (1/7)

Browse files

This view is limited to 50 files because it contains too many changes. See raw diff

Files changed (50) hide show

2-bit/model-00014-of-00140.safetensors +3 -0
2-bit/model-00015-of-00140.safetensors +3 -0
2-bit/model-00016-of-00140.safetensors +3 -0
2-bit/model-00017-of-00140.safetensors +3 -0
2-bit/model-00018-of-00140.safetensors +3 -0
2-bit/model-00019-of-00140.safetensors +3 -0
2-bit/model-00020-of-00140.safetensors +3 -0
2-bit/model-00021-of-00140.safetensors +3 -0
2-bit/model-00022-of-00140.safetensors +3 -0
2-bit/model-00023-of-00140.safetensors +3 -0
2-bit/model-00024-of-00140.safetensors +3 -0
2-bit/model-00025-of-00140.safetensors +3 -0
2-bit/model-00026-of-00140.safetensors +3 -0
2-bit/model-00027-of-00140.safetensors +3 -0
2-bit/model-00028-of-00140.safetensors +3 -0
2-bit/model-00029-of-00140.safetensors +3 -0
2-bit/model-00030-of-00140.safetensors +3 -0
2-bit/model-00031-of-00140.safetensors +3 -0
2-bit/model-00032-of-00140.safetensors +3 -0
2-bit/model-00033-of-00140.safetensors +3 -0
2-bit/model-00034-of-00140.safetensors +3 -0
2-bit/model-00035-of-00140.safetensors +3 -0
2-bit/model-00036-of-00140.safetensors +3 -0
2-bit/model-00037-of-00140.safetensors +3 -0
2-bit/model-00038-of-00140.safetensors +3 -0
2-bit/model-00039-of-00140.safetensors +3 -0
2-bit/model-00040-of-00140.safetensors +3 -0
2-bit/model-00041-of-00140.safetensors +3 -0
2-bit/model-00042-of-00140.safetensors +3 -0
2-bit/model-00043-of-00140.safetensors +3 -0
2-bit/model-00044-of-00140.safetensors +3 -0
2-bit/model-00045-of-00140.safetensors +3 -0
2-bit/model-00046-of-00140.safetensors +3 -0
2-bit/model-00047-of-00140.safetensors +3 -0
2-bit/model-00048-of-00140.safetensors +3 -0
2-bit/model-00049-of-00140.safetensors +3 -0
2-bit/model-00050-of-00140.safetensors +3 -0
2-bit/model-00051-of-00140.safetensors +3 -0
2-bit/model-00052-of-00140.safetensors +3 -0
2-bit/model-00053-of-00140.safetensors +3 -0
2-bit/model-00054-of-00140.safetensors +3 -0
2-bit/model-00055-of-00140.safetensors +3 -0
2-bit/model-00056-of-00140.safetensors +3 -0
2-bit/model-00057-of-00140.safetensors +3 -0
2-bit/model-00058-of-00140.safetensors +3 -0
2-bit/model-00059-of-00140.safetensors +3 -0
2-bit/model-00060-of-00140.safetensors +3 -0
2-bit/model-00061-of-00140.safetensors +3 -0
2-bit/model-00062-of-00140.safetensors +3 -0
2-bit/model-00063-of-00140.safetensors +3 -0

2-bit/model-00014-of-00140.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:f744c1c7e3a854ed6226db75745a1a3f58e69ecaa0a625047d9239afb444bcec
+size 2348430544

2-bit/model-00015-of-00140.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:b207e5bfcc75474f5397974ddd975c018e9b05f9915ba1be663d30520516b9d3
+size 2233624776

2-bit/model-00016-of-00140.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:b9ffbe15f99574ec5b79f2cc03921b649f8d6cec11fd597f7aee189e9af8d648
+size 2350003504

2-bit/model-00017-of-00140.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:c56558dabe99e1e84deb0b594aaaf81639a624a448d9072740e53a4f1f866b3d
+size 2233624568

2-bit/model-00018-of-00140.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:0a8ae2ecf8af5e9c7f6bc92d433268760dce3408cbddf93903e82d137750ff4c
+size 2362456312

2-bit/model-00019-of-00140.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:d7d9ea7783e92c7687201c0d414581af5c5f975190714e937803f1526074bd02
+size 2233624368

2-bit/model-00020-of-00140.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:ac3856bed56c1ae878a3c82a42d4ee202c1ff93af25e2834949c2108a52ab35a
+size 2559831568

2-bit/model-00021-of-00140.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:2dc6e9a4944e4b167bc80996efdda286b7490373d0b36201371364aea032080f
+size 2233624256

2-bit/model-00022-of-00140.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:964852a0416219f1e4920cbdf628700ded5ace9af2667a88f617602e658cee6e
+size 2350004024

2-bit/model-00023-of-00140.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:b1b67c23f6c0f7d704545855539b6c1124e05b61e078b6402f945a07da176124
+size 2250637296

2-bit/model-00024-of-00140.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:0330d11d6a56f67c96c223160f29604596dfbb44644aa2f91e1d6c976042aaad
+size 2326699216

2-bit/model-00025-of-00140.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:e24f742c55211609bbd94d179ce7975651c89d04238285b55532b35c919fa044
+size 2364028872

2-bit/model-00026-of-00140.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:94726bb6458bb752e4a0ce27f6a4ced6536bf13ef12e76f8d75edac48b2f0002
+size 2233624792

2-bit/model-00027-of-00140.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:797a6ff42fc12d091489935febad9a926f5b13652354eb122e1f4f6589afcd2d
+size 2348430552

2-bit/model-00028-of-00140.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:668d0947dee91d78afbf2dad5ec1bb24e2ebd65a2bc2b7f74d4fd748fbfa299b
+size 2233624720

2-bit/model-00029-of-00140.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:02911d764f067546dc28729a5b1a80af98862d7a4be1c5791459b9865d8e3bcb
+size 2350003576

2-bit/model-00030-of-00140.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:d746237688a639e847fdb45cadadd03ceb6c9abf51b3b6f41da5de0a9a07c87f
+size 2233624520

2-bit/model-00031-of-00140.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:1e2de66886422e7b892ce2a94c8de2391c7eaada631c8716294957aa15331b2f
+size 2350003776

2-bit/model-00032-of-00140.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:9697491f47835e82595cceffaf373b47fa66ba4278724d10cad9a41216e9e146
+size 2233624312

2-bit/model-00033-of-00140.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:01b4a886c3b61448708ecbb7036645e0dd8b3b6fedb586fbf1f418f599f9352e
+size 2362456576

2-bit/model-00034-of-00140.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:904a2f2e11217eca962398848073b962107d23f815f86f808a7faedea62254a8
+size 2233624112

2-bit/model-00035-of-00140.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:1f24d64652f3f0ac3e04259cf98ba27dc21a85598a9b9e5e0386c97ba5e172bf
+size 2350004176

2-bit/model-00036-of-00140.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:8f0bb3d68402d18069bd30db9ee8e164dfb34f8c2cb2e405c85b2e8dca7efa2f
+size 2348430552

2-bit/model-00037-of-00140.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:f94fbe07ab6776c192b187ccd8ca84b84f0169f745e390149dfd02666f07b32e
+size 2233624792

2-bit/model-00038-of-00140.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:25ad8fece6df877f6646926769d2fb4cdd0877b599a918b84024efe55ed1cb2f
+size 2350003104

2-bit/model-00039-of-00140.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:7931bb34c5da6cea8241714db4d2eec69cbb68d9736df7975a6392e2b5477b14
+size 2233623496

2-bit/model-00040-of-00140.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:69a169f2328ad1b63e4d552028704c803610e977a918fa95436d22db329ab481
+size 2350002744

2-bit/model-00041-of-00140.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:f1f1cdf81b713e8a0fc831c3e9639069ef43d8ca9117b301eaf40019a4137ad5
+size 2233624576

2-bit/model-00042-of-00140.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:1135ccf21b362d5abbcb1a742d73890fb3893caf4caeb60980c46461ac64e0a3
+size 2362456312

2-bit/model-00043-of-00140.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:ab9019e54aeeee7d34ae1931b99728a90abc09ac5ff726de48d9cc23515b31bb
+size 2233624376

2-bit/model-00044-of-00140.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:fbc96d2a32475706361931b0e2f098311557e68d92a7baf8898df87fe0aaba95
+size 2350003912

2-bit/model-00045-of-00140.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:6976f8fab70b38553bae16f42fa913c83a056327ad6ed9afb597779ffb95bfb3
+size 2233624176

2-bit/model-00046-of-00140.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:d5177efaedbf95ce1ea2e799bbe38522e6bbbe2cc284fd50d7e161f6d0976cd6
+size 2348431232

2-bit/model-00047-of-00140.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:d2304ec4c469f7853171c5d624a0d402967b3e18b6a4a20712640f4fd4f3a276
+size 2350003416

2-bit/model-00048-of-00140.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:b9352069582bbfd339edee93e07fb4a8e636afb8521d0fb2a7c6261f29c6c58e
+size 2233624792

2-bit/model-00049-of-00140.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:f623c5c54d936fc9f2d1391e8376784185b7e671533231f99b2d32ad4bd0b4aa
+size 2362456008

2-bit/model-00050-of-00140.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:61db65611bf19efa8332ca1fff636ed944cae88254efaa38f0ff5cb2886ce099
+size 2233624792

2-bit/model-00051-of-00140.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:e5698e34fb7c751078ac24dc395d447e3bfd76ff390e74c17bb60838939d1143
+size 2350003440

2-bit/model-00052-of-00140.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:004f263fc5a812fceced4314087be476c0e727fce4c46047db5bbe8365722c13
+size 2233624632

2-bit/model-00053-of-00140.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:123d73ae16cad66c50981b0ee5e0dfd499a92d601b57800606dcab5a809cf069
+size 2350003656

2-bit/model-00054-of-00140.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:c39a988aa889f6a4049742e618e58e58415d480e4b66172fc7e58bd269870dcf
+size 2233624432

2-bit/model-00055-of-00140.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:9f5a067488e6aac12f44fa8ff71aa5afd735b4d412b747fccee1a10595a2e378
+size 2348431000

2-bit/model-00056-of-00140.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:bfa0c2603ccd832874e82e6958b5ca84977d3ecc44e108af2c4514ab60f67984
+size 2233624224

2-bit/model-00057-of-00140.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:837aaa271e5f8c1904cefd7fd78ed79ba15690a1322b1ac7af4081fcc3463efa
+size 2364029504

2-bit/model-00058-of-00140.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:ce2675e8c5bb5c71e5100b0d882bc7fa5b80626eb01640eedfb66a54a15d63fe
+size 2315126312

2-bit/model-00059-of-00140.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:63ce2375c7abfe24beea18ce8e75f77965b8d6e3d1124fa855185d04bb66e82b
+size 2262208856

2-bit/model-00060-of-00140.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:22fecae7291075b023f01411bc2da7d24d6aef56d5ecee6f3fa1cf566fd07c14
+size 2350002344

2-bit/model-00061-of-00140.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:f1e94ec11214cd5aa5d4c611fff09801eeb780a7d355049cb8f7b2d9da0a9a42
+size 2233624792

2-bit/model-00062-of-00140.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:c229ef7e8c338d81c72f565b25e89636ad86a77ba7cb72f6a528ccb6b4679735
+size 2348430552

2-bit/model-00063-of-00140.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:f32dd045ed113b548fef8136b4c11596f07c2a3e57ae51581e29893cd653ffa2
+size 2233624696