Instructions to use orcarouter/GLM-5.3-Flash-MLX with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use orcarouter/GLM-5.3-Flash-MLX with MLX:

# Make sure mlx-vlm is installed
# pip install --upgrade mlx-vlm

from mlx_vlm import load, generate
from mlx_vlm.prompt_utils import apply_chat_template
from mlx_vlm.utils import load_config

# Load the model
model, processor = load("orcarouter/GLM-5.3-Flash-MLX")
config = load_config("orcarouter/GLM-5.3-Flash-MLX")

# Prepare input
image = ["http://images.cocodataset.org/val2017/000000039769.jpg"]
prompt = "Describe this image."

# Apply chat template
formatted_prompt = apply_chat_template(
    processor, config, prompt, num_images=1
)

# Generate output
output = generate(model, processor, formatted_prompt, image)
print(output)

Notebooks
Google Colab
Kaggle
Local Apps Settings
LM Studio

How to use orcarouter/GLM-5.3-Flash-MLX with Pi:

Start the MLX server

# Install MLX LM:
uv tool install mlx-lm
# Start a local OpenAI-compatible server:
mlx_lm.server --model "orcarouter/GLM-5.3-Flash-MLX"

Configure the model in Pi

# Install Pi:
npm install -g @earendil-works/pi-coding-agent
# Add to ~/.pi/agent/models.json:
{
  "providers": {
    "mlx-lm": {
      "baseUrl": "http://localhost:8080/v1",
      "api": "openai-completions",
      "apiKey": "none",
      "models": [
        {
          "id": "orcarouter/GLM-5.3-Flash-MLX"
        }
      ]
    }
  }
}

Run Pi

# Start Pi in your project directory:
pi

Hermes Agent

How to use orcarouter/GLM-5.3-Flash-MLX with Hermes Agent:

Start the MLX server

# Install MLX LM:
uv tool install mlx-lm
# Start a local OpenAI-compatible server:
mlx_lm.server --model "orcarouter/GLM-5.3-Flash-MLX"

Configure Hermes

# Install Hermes:
curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash
hermes setup
# Point Hermes at the local server:
hermes config set model.provider custom
hermes config set model.base_url http://127.0.0.1:8080/v1
hermes config set model.default orcarouter/GLM-5.3-Flash-MLX

Run Hermes

hermes

Atomic Chat

OpenClaw

How to use orcarouter/GLM-5.3-Flash-MLX with OpenClaw:

Start the MLX server

# Install MLX LM:
uv tool install mlx-lm
# Start a local OpenAI-compatible server:
mlx_lm.server --model "orcarouter/GLM-5.3-Flash-MLX"

Configure OpenClaw

# Install OpenClaw:
npm install -g openclaw@latest
# Register the local server and set it as the default model:
openclaw onboard --non-interactive --mode local \
  --auth-choice custom-api-key \
  --custom-base-url http://127.0.0.1:8080/v1 \
  --custom-model-id "orcarouter/GLM-5.3-Flash-MLX" \
  --custom-provider-id mlx-lm \
  --custom-compatibility openai \
  --custom-text-input \
  --accept-risk \
  --skip-health

Run OpenClaw

openclaw agent --local --agent main --message "Hello from Hugging Face"

hugging-yiii commited on 4 days ago

Commit

7a5847e

verified ·

1 Parent(s): 0bc8a05

Add 2bit-lite MLX quantization (3/9)

Browse files

Files changed (6) hide show

2bit-lite/model-00009-of-00062.safetensors +2 -2
2bit-lite/model-00010-of-00062.safetensors +2 -2
2bit-lite/model-00011-of-00062.safetensors +2 -2
2bit-lite/model-00012-of-00062.safetensors +2 -2
2bit-lite/model-00014-of-00062.safetensors +2 -2
2bit-lite/model-00015-of-00062.safetensors +2 -2

2bit-lite/model-00009-of-00062.safetensors CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:e998474ef249442c22f7514092f4abdd1c807036ac5b64bcabe35aef645406ee
-size 1510214192

 version https://git-lfs.github.com/spec/v1
+oid sha256:32f988b9e8e1bfd7540595c7ea86d52f2f26bce7501a9443eae7eecb6146bcc1
+size 1510214752

2bit-lite/model-00010-of-00062.safetensors CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:b491470a7cb5794a193fd5ecf4ec1b05d0d3f518053296ebc420b8c1c54dae1e
-size 1710186852

 version https://git-lfs.github.com/spec/v1
+oid sha256:ba8fc3af54218101e8f601c61a05cb1ce24379f323a431540863d0dc29f11dac
+size 1710203408

2bit-lite/model-00011-of-00062.safetensors CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:012bfa5d5403703abb1b1fef7e66e5d940b2566e830db8f51dd816df1d7b87b9
-size 1549292260

 version https://git-lfs.github.com/spec/v1
+oid sha256:6759db47329d71e7ad7cbd5a43fd8e76d64fae39bc5198c45515ba2e5b50d93f
+size 1549292872

2bit-lite/model-00012-of-00062.safetensors CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:e0b1ae78e143c88223f2971e4d6268a550f90af0d92e1c50ad5de75b4459bc58
-size 1712546300

 version https://git-lfs.github.com/spec/v1
+oid sha256:bdfcbd2ec9fafb25f1aa5015e40f30577fc768955acbb4522e520aaecb640250
+size 1712563416

2bit-lite/model-00014-of-00062.safetensors CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:327277f034a41136e59e95181896e0a6697a808c29f56ee9aade1978f0a976e1
-size 1712546596

 version https://git-lfs.github.com/spec/v1
+oid sha256:5a03b29352fc68d4c298a00d8f9537ef41210c4967e23ca548a24de50c694a16
+size 1712563712

2bit-lite/model-00015-of-00062.safetensors CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:626aab314723342c89814974cf17d046d192c441584c3cf3579eaa9adc750e1e
-size 1712546300

 version https://git-lfs.github.com/spec/v1
+oid sha256:9f81b645c58c2c7a47bab5dfa6908032f15eeddf3d669631d77ac9901dd39208
+size 1712563416