Instructions to use pipenetwork/GLM-5.2-MLX-8bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use pipenetwork/GLM-5.2-MLX-8bit with MLX:

# Make sure mlx-lm is installed
# pip install --upgrade mlx-lm

# Generate text with mlx-lm
from mlx_lm import load, generate

model, tokenizer = load("pipenetwork/GLM-5.2-MLX-8bit")

prompt = "Write a story about Einstein"
messages = [{"role": "user", "content": prompt}]
prompt = tokenizer.apply_chat_template(
    messages, add_generation_prompt=True
)

text = generate(model, tokenizer, prompt=prompt, verbose=True)

Notebooks
Google Colab
Kaggle
Local Apps Settings
LM Studio

How to use pipenetwork/GLM-5.2-MLX-8bit with Pi:

Start the MLX server

# Install MLX LM:
uv tool install mlx-lm
# Start a local OpenAI-compatible server:
mlx_lm.server --model "pipenetwork/GLM-5.2-MLX-8bit"

Configure the model in Pi

# Install Pi:
npm install -g @mariozechner/pi-coding-agent
# Add to ~/.pi/agent/models.json:
{
  "providers": {
    "mlx-lm": {
      "baseUrl": "http://localhost:8080/v1",
      "api": "openai-completions",
      "apiKey": "none",
      "models": [
        {
          "id": "pipenetwork/GLM-5.2-MLX-8bit"
        }
      ]
    }
  }
}

Run Pi

# Start Pi in your project directory:
pi

Hermes Agent new

How to use pipenetwork/GLM-5.2-MLX-8bit with Hermes Agent:

Start the MLX server

# Install MLX LM:
uv tool install mlx-lm
# Start a local OpenAI-compatible server:
mlx_lm.server --model "pipenetwork/GLM-5.2-MLX-8bit"

Configure Hermes

# Install Hermes:
curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash
hermes setup
# Point Hermes at the local server:
hermes config set model.provider custom
hermes config set model.base_url http://127.0.0.1:8080/v1
hermes config set model.default pipenetwork/GLM-5.2-MLX-8bit

Run Hermes

hermes

OpenClaw new

How to use pipenetwork/GLM-5.2-MLX-8bit with OpenClaw:

Start the MLX server

# Install MLX LM:
uv tool install mlx-lm
# Start a local OpenAI-compatible server:
mlx_lm.server --model "pipenetwork/GLM-5.2-MLX-8bit"

Configure OpenClaw

# Install OpenClaw:
npm install -g openclaw@latest
# Register the local server and set it as the default model:
openclaw onboard --non-interactive --mode local \
  --auth-choice custom-api-key \
  --custom-base-url http://127.0.0.1:8080/v1 \
  --custom-model-id "pipenetwork/GLM-5.2-MLX-8bit" \
  --custom-provider-id mlx-lm \
  --custom-compatibility openai \
  --custom-text-input \
  --accept-risk \
  --skip-health

Run OpenClaw

openclaw agent --local --agent main --message "Hello from Hugging Face"

MLX LM

How to use pipenetwork/GLM-5.2-MLX-8bit with MLX LM:

Generate or start a chat session

# Install MLX LM
uv tool install mlx-lm
# Interactive chat REPL
mlx_lm.chat --model "pipenetwork/GLM-5.2-MLX-8bit"

Run an OpenAI-compatible server

# Install MLX LM
uv tool install mlx-lm
# Start the server
mlx_lm.server --model "pipenetwork/GLM-5.2-MLX-8bit"
# Calling the OpenAI-compatible server with curl
curl -X POST "http://localhost:8000/v1/chat/completions" \
   -H "Content-Type: application/json" \
   --data '{
     "model": "pipenetwork/GLM-5.2-MLX-8bit",
     "messages": [
       {"role": "user", "content": "Hello"}
     ]
   }'

pipenetwork commited on 28 days ago

Commit

a0fdc95

verified ·

1 Parent(s): 01029da

Add files using upload-large-folder tool

Browse files

This view is limited to 50 files because it contains too many changes. See raw diff

Files changed (50) hide show

.gitattributes +1 -0
model-00009-of-00226.safetensors +3 -0
model-00010-of-00226.safetensors +3 -0
model-00015-of-00226.safetensors +3 -0
model-00022-of-00226.safetensors +3 -0
model-00027-of-00226.safetensors +3 -0
model-00028-of-00226.safetensors +3 -0
model-00031-of-00226.safetensors +3 -0
model-00034-of-00226.safetensors +3 -0
model-00047-of-00226.safetensors +3 -0
model-00048-of-00226.safetensors +3 -0
model-00051-of-00226.safetensors +3 -0
model-00054-of-00226.safetensors +3 -0
model-00063-of-00226.safetensors +3 -0
model-00066-of-00226.safetensors +3 -0
model-00069-of-00226.safetensors +3 -0
model-00070-of-00226.safetensors +3 -0
model-00075-of-00226.safetensors +3 -0
model-00083-of-00226.safetensors +3 -0
model-00086-of-00226.safetensors +3 -0
model-00090-of-00226.safetensors +3 -0
model-00095-of-00226.safetensors +3 -0
model-00103-of-00226.safetensors +3 -0
model-00106-of-00226.safetensors +3 -0
model-00109-of-00226.safetensors +3 -0
model-00110-of-00226.safetensors +3 -0
model-00115-of-00226.safetensors +3 -0
model-00127-of-00226.safetensors +3 -0
model-00128-of-00226.safetensors +3 -0
model-00131-of-00226.safetensors +3 -0
model-00134-of-00226.safetensors +3 -0
model-00142-of-00226.safetensors +3 -0
model-00147-of-00226.safetensors +3 -0
model-00148-of-00226.safetensors +3 -0
model-00151-of-00226.safetensors +3 -0
model-00154-of-00226.safetensors +3 -0
model-00166-of-00226.safetensors +3 -0
model-00169-of-00226.safetensors +3 -0
model-00170-of-00226.safetensors +3 -0
model-00175-of-00226.safetensors +3 -0
model-00183-of-00226.safetensors +3 -0
model-00186-of-00226.safetensors +3 -0
model-00195-of-00226.safetensors +3 -0
model-00202-of-00226.safetensors +3 -0
model-00207-of-00226.safetensors +3 -0
model-00208-of-00226.safetensors +3 -0
model-00211-of-00226.safetensors +3 -0
model-00214-of-00226.safetensors +3 -0
model-00223-of-00226.safetensors +3 -0
model-00226-of-00226.safetensors +3 -0

.gitattributes CHANGED Viewed

@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text

 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+tokenizer.json filter=lfs diff=lfs merge=lfs -text

model-00009-of-00226.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:7743612845825fdbfe67a4b549cbc34dee47738f832982d46041b7f9bb823a0d
+size 3422552468

model-00010-of-00226.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:128ab255ec255af859a9d57630b1ab96365dd57b125f2a7f727b42b00a564f61
+size 3651133400

model-00015-of-00226.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:13bb311b93688bcfb62b6e7fa2fb514078322ef90a64a1fcf782e901532087a8
+size 3422552468

model-00022-of-00226.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:5e36e1abceb9b312c21d5107d730d7cd570ed9212ee2de161cbd2ca716587cb3
+size 3651133435

model-00027-of-00226.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:2adb40881630b49783cd45001efe02cfb717f96100cbd4c53ecbe8fee2db29cf
+size 3422552471

model-00028-of-00226.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:d7d7acd68e57c04ea21a5aef62d8208a0fa6ca292154aa677f960a95b80d8dc1
+size 3641174274

model-00031-of-00226.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:66ce567bf1a65a216eb816dbbeab5e33d918107886df43f5244a60d875c16232
+size 3641174314

model-00034-of-00226.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:4c7c1a03ad24d7ac701edaf374bc6c5293318337ab00370789c866d4c62951a3
+size 3651133473

model-00047-of-00226.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:516e9b9fb8cf7af8b277a0dca424c60e0656718e2fcc1680c8d82dfde8f30eb7
+size 3422552477

model-00048-of-00226.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:f24b63122dd7688ff75967327152df0d674ebb5cab1d533e4396257dea2bac30
+size 3422552471

model-00051-of-00226.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:7fff79225a5dcfc6f716fe301f5712261eda2f59b166478375e02fc5b4d165ad
+size 3422552471

model-00054-of-00226.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:3f2a469fa8eca95ddff4efe407d69edc5ee224c3771e2da08377d1ab1b350df9
+size 3422552471

model-00063-of-00226.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:90cfad9b63b6dc4b6a9781d00f8da2a3f263ac9986d69466343af9f708284fcd
+size 3422552471

model-00066-of-00226.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:406b281747c9da2ef2490f0bbc8c289a5861aa4a79baf2151aa6f9829fd29fd0
+size 3422552471

model-00069-of-00226.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:25254ae56f7ebd7eaa7e56cd9d0829b0d9ea4293df772560f1a6bad8202ea518
+size 3422552471

model-00070-of-00226.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:42f7e70c9f38e33b2f06d5fdbb52b0ff8c1dfbdd01bfaac79f408492b9fd8424
+size 3651133479

model-00075-of-00226.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:981133dc9b171602c11d21a84a6928303a6928bc44291f3190f0de6080e1e30c
+size 3422552471

model-00083-of-00226.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:96c14414e788858de15c9f3480b3d4befc9e7a5aceadb8c32dc050796393d397
+size 3422552477

model-00086-of-00226.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:53cd9f8b95dbb3efffd1bd26e6b886887c333e2bba54179c8fed7fc56d2a7053
+size 3422552477

model-00090-of-00226.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:aadd58b1700821f6bbd6ffb1c5aaf62f8461b6d32e51ce6f14835fab3653e2f6
+size 3422552471

model-00095-of-00226.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:3e7af62c1a30068add54bae05d8759fd73eb8dceb2f2ab1e13c8ede860466697
+size 3422552477

model-00103-of-00226.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:24278ab75eccc1149cec494accc1fc3d47181dde6c5e42b3421a946560e49e2a
+size 3641174236

model-00106-of-00226.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:6f2ad61c9946cc1119684cf29fa769d9441103e4938dc34749610320482d57ad
+size 3651133469

model-00109-of-00226.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:5d53309cf29b233734e23268372ff655bdf98baf59f0eca1cbf92d4f3a8eff30
+size 3641174300

model-00110-of-00226.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:043e8f0620a931c50585c90efe03d7abf9ada5590bd96916e5d93168b80ecd92
+size 3422552477

model-00115-of-00226.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:e24b5d6469d67903c572f5d8c24d759fed06a7a6c91629f21e47a38cc1f1ffb6
+size 3641174278

model-00127-of-00226.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:b3b6ffd43e5fb6ff1e18ebe1e6a5ae2689da884525c96c93466eba8789c921df
+size 3641174270

model-00128-of-00226.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:e2ce8fc3064badbaca5a1e7e28b1bd0e77936dc856b795b57e8e79bc85ad647e
+size 3422552477

model-00131-of-00226.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:1664e09730ae26aa4d8796dc900a25abef4e50f8a924faf5726001f31cd52a2b
+size 3422552477

model-00134-of-00226.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:32bd9c26b1b867628432d187dcadb7343279919c23d54498762bcbc64a452efe
+size 3422552477

model-00142-of-00226.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:70774e8b213e52e1d3f813b4cdc8970ff0ebb64ce65dd9a7f7a176471ec22081
+size 3651133445

model-00147-of-00226.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:c984d1b04a60b81cf674ad04e5d48b77e2986638ab174659fdae673746ba2e14
+size 3422552471

model-00148-of-00226.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:a9712c52397f40cd1dcbee512d435a3acde91e63e76e92d92e1617a381110200
+size 3641174242

model-00151-of-00226.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:1de4d7056080d88371bf4ec1d9c2ca939fc4b23fe410892ea483738149617a1f
+size 3641174220

model-00154-of-00226.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:86cbc7af3b9f24b8642e1bd7c2d4ccaad6e6635986a3564e7e73bcf21e4d2788
+size 3651133427

model-00166-of-00226.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:ca4d8739e8d8469aacf9e6afa0370586819d7edf2a038d3be9842b56bb8dbb3a
+size 3651133443

model-00169-of-00226.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:c710fafb119dda7dadc7958c44cca91f716be331a016fb02ff1869f9e397e956
+size 3641174272

model-00170-of-00226.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:604ee6c4eeb211e7308641b525199f1297ab7b8a2eb2296cd5bc1cd58e24351b
+size 3422552477

model-00175-of-00226.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:414a1f5585f7388d9e39fe61b85496b5a610185ce6b80ea9af7613217f6d635e
+size 3641174324

model-00183-of-00226.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:4989baa8e691d9f8370c5189afaa9ca3316970866fa5566f68aefefa132b4e87
+size 3422552471

model-00186-of-00226.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:b7e2b2b47acd06d76616883d3f81c584ecaf730098e9b335eb68b96b31187c55
+size 3422552471

model-00195-of-00226.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:b7b9a33c3a2efe98d65fde7aa7a1f53d76be9d93a163f2a50153509a07fb081f
+size 3422552471

model-00202-of-00226.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:e16bc3bddd0c9ef1580312db0db94cfd26c54901120c6c7b88ab84e2c3a96282
+size 3651133441

model-00207-of-00226.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:4e64b509f8dd2930682ae571027e3c88770dd701e94e25ed80a8bae9f8d3a36e
+size 3422552471

model-00208-of-00226.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:72364ad85b23c2740da7e3ddc47ff6b79f8eacebf99581963f74709bbd860ad4
+size 3641174290

model-00211-of-00226.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:1935f2385c1323c63acdfb3063e60d34540e6bd003743cdbeda8f3eba2942b34
+size 3641174256

model-00214-of-00226.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:28beede61e8afe9af950c1d8fed3db26e5bb00e0bb5444641ef125a5209b8c40
+size 3651133415

model-00223-of-00226.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:03c036c98af642677d82eca45ccd227a554926755b0dd4168f5a4956a8dd0c28
+size 3641174274

model-00226-of-00226.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:87d93b053bacc84e185bd6264998115a9e942f84d553e47d147d64677b89913a
+size 4476902741