Instructions to use kernelpool/GLM-5.2-8bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use kernelpool/GLM-5.2-8bit with MLX:
# Make sure mlx-lm is installed # pip install --upgrade mlx-lm # Generate text with mlx-lm from mlx_lm import load, generate model, tokenizer = load("kernelpool/GLM-5.2-8bit") prompt = "Write a story about Einstein" messages = [{"role": "user", "content": prompt}] prompt = tokenizer.apply_chat_template( messages, add_generation_prompt=True ) text = generate(model, tokenizer, prompt=prompt, verbose=True) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Pi
How to use kernelpool/GLM-5.2-8bit with Pi:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "kernelpool/GLM-5.2-8bit"
Configure the model in Pi
# Install Pi: npm install -g @mariozechner/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "mlx-lm": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "kernelpool/GLM-5.2-8bit" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Hermes Agent new
How to use kernelpool/GLM-5.2-8bit with Hermes Agent:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "kernelpool/GLM-5.2-8bit"
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default kernelpool/GLM-5.2-8bit
Run Hermes
hermes
- OpenClaw new
How to use kernelpool/GLM-5.2-8bit with OpenClaw:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "kernelpool/GLM-5.2-8bit"
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "kernelpool/GLM-5.2-8bit" \ --custom-provider-id mlx-lm \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
- MLX LM
How to use kernelpool/GLM-5.2-8bit with MLX LM:
Generate or start a chat session
# Install MLX LM uv tool install mlx-lm # Interactive chat REPL mlx_lm.chat --model "kernelpool/GLM-5.2-8bit"
Run an OpenAI-compatible server
# Install MLX LM uv tool install mlx-lm # Start the server mlx_lm.server --model "kernelpool/GLM-5.2-8bit" # Calling the OpenAI-compatible server with curl curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "kernelpool/GLM-5.2-8bit", "messages": [ {"role": "user", "content": "Hello"} ] }'
Add files using upload-large-folder tool
Browse files- model-00001-of-00226.safetensors +3 -0
- model-00004-of-00226.safetensors +3 -0
- model-00019-of-00226.safetensors +3 -0
- model-00021-of-00226.safetensors +3 -0
- model-00033-of-00226.safetensors +3 -0
- model-00036-of-00226.safetensors +3 -0
- model-00040-of-00226.safetensors +3 -0
- model-00045-of-00226.safetensors +3 -0
- model-00058-of-00226.safetensors +3 -0
- model-00060-of-00226.safetensors +3 -0
- model-00072-of-00226.safetensors +3 -0
- model-00077-of-00226.safetensors +3 -0
- model-00081-of-00226.safetensors +3 -0
- model-00084-of-00226.safetensors +3 -0
- model-00093-of-00226.safetensors +3 -0
- model-00112-of-00226.safetensors +3 -0
- model-00117-of-00226.safetensors +3 -0
- model-00118-of-00226.safetensors +3 -0
- model-00120-of-00226.safetensors +3 -0
- model-00125-of-00226.safetensors +3 -0
- model-00138-of-00226.safetensors +3 -0
- model-00141-of-00226.safetensors +3 -0
- model-00153-of-00226.safetensors +3 -0
- model-00156-of-00226.safetensors +3 -0
- model-00159-of-00226.safetensors +3 -0
- model-00161-of-00226.safetensors +3 -0
- model-00164-of-00226.safetensors +3 -0
- model-00179-of-00226.safetensors +3 -0
- model-00197-of-00226.safetensors +3 -0
- model-00198-of-00226.safetensors +3 -0
- model-00200-of-00226.safetensors +3 -0
- model-00205-of-00226.safetensors +3 -0
- model-00217-of-00226.safetensors +3 -0
model-00001-of-00226.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:8a051bbdfa3affef592dd7656fca48d7d19380c814f2bc12c9b6c2802d35d41c
|
| 3 |
+
size 2464320041
|
model-00004-of-00226.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:5089d736a39fe7c724013f81aebb50daf72902d566f0da94eb6ad59804ace047
|
| 3 |
+
size 3641174242
|
model-00019-of-00226.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:2407b4a7247e43c9343259885bb0e1516459977a4d04026764bd3e63789c68af
|
| 3 |
+
size 3641174230
|
model-00021-of-00226.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:e367b7144818e46af04af2d6f7cf93375a3fee9f481bc7f6b2bb55851143499c
|
| 3 |
+
size 3422552468
|
model-00033-of-00226.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:7b65d13906d2c81f8d4e84b90187db6ade6194f7c401f804dbef156e7aa77d86
|
| 3 |
+
size 3422552471
|
model-00036-of-00226.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:edf1abdf80b4f66baaf7833b991b2f8fa1ea5412d4e07a318ab864274d4ba04c
|
| 3 |
+
size 3422552471
|
model-00040-of-00226.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:8b3798a4931a33034be7518a0255dd468fd78113adefe52c0d45fc019995c96e
|
| 3 |
+
size 3641174306
|
model-00045-of-00226.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:8f2ae044c63c198471c115c7de031b13b58b98242841e3c89a5d896a91f2c5e8
|
| 3 |
+
size 3422552471
|
model-00058-of-00226.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:1438beee2d7b74c5d361aa796e69a52f4bbded633e461764b6d78257f58d1234
|
| 3 |
+
size 3651133439
|
model-00060-of-00226.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:6fadbf2f7c6295087a14a755b227ec35b073805af8315adbda0702e628755475
|
| 3 |
+
size 3422552471
|
model-00072-of-00226.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:6371057a0f7dd20e2b111967c74401bec7b3a300e5af0f6f178fd339307f1034
|
| 3 |
+
size 3422552471
|
model-00077-of-00226.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:39b534478807a87fdd9fadc0413436d39452b813402192c5477e701b5d612095
|
| 3 |
+
size 3422552477
|
model-00081-of-00226.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:afd9a9b09bcd75f2f381903a0585ccd52957518ed2053519710f63b037069dfb
|
| 3 |
+
size 3422552471
|
model-00084-of-00226.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:675d4a672bd2d6a1830385ac3a01b5b6a4b93fe713b76d61258f59385d8a7394
|
| 3 |
+
size 3422552471
|
model-00093-of-00226.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:3721c0d18386d73c4c58e284e9fcdba495ca68f784a47630314eb32f3c48029b
|
| 3 |
+
size 3422552471
|
model-00112-of-00226.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:37a51d9264f419e974faccf41e7970072cbaaac5a8660a019f79cda43ab54ce2
|
| 3 |
+
size 3641174234
|
model-00117-of-00226.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:e1433d60affc9ff916a278bd43637d274edf1a5e6f7f5da59c9cd3d88e93c406
|
| 3 |
+
size 3422552471
|
model-00118-of-00226.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:0d620c4c425e4be56bf2fd8210ae1a19def93ca7f54b880e81eb3c45d23669fc
|
| 3 |
+
size 3651133431
|
model-00120-of-00226.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:dda92eedc57f81d2a1e4a7fc02be8f364004aeb6d4ccf6042a86da62765165b9
|
| 3 |
+
size 3422552471
|
model-00125-of-00226.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:89151fe65aff73300fdbcb6390399abcbf980957c80144c45fd4d0d61a7d2bb3
|
| 3 |
+
size 3422552477
|
model-00138-of-00226.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:29901ae16bf089a2e62cfc4a3e778a4457e2f147da80e5a03474a1bad0debecf
|
| 3 |
+
size 3422552471
|
model-00141-of-00226.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:b18008023554cd8c9444952a5daa8ae5c5e6afa97e16540034250240d24a999a
|
| 3 |
+
size 3422552471
|
model-00153-of-00226.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:c313c4dc090dc9805c4bc69edf9aabc5094b71640dfb1a2e85dfd624bda88beb
|
| 3 |
+
size 3422552471
|
model-00156-of-00226.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:d6e8a32b202180041836613252f9afb9470eac13176bdb76734c2322a03b9808
|
| 3 |
+
size 3422552471
|
model-00159-of-00226.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:b5ba305a7d4129506c6d5ae7ec9a981646923f71fcaa6d8c173e0722ac8b6418
|
| 3 |
+
size 3422552471
|
model-00161-of-00226.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:47bbe1a3d5deecedc24ba822b68cc0d9f9b8f4ae51a4173fd2f62494d5ccbcf9
|
| 3 |
+
size 3422552477
|
model-00164-of-00226.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:9bff069ec0fd5d997085303e870bdf27a93e82723c769e855a2f5263f85ef9e1
|
| 3 |
+
size 3422552477
|
model-00179-of-00226.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:c0aed52d2ad39382365bfc3d8679abbd855546d291730832f1bdb0da40fba4cc
|
| 3 |
+
size 3422552477
|
model-00197-of-00226.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:c840d798e2ac1f69d10b8ee8a3c8004c39bcf12ceefc1947e328dc025d69e7bc
|
| 3 |
+
size 3422552477
|
model-00198-of-00226.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:a95015ecbaf2e802e8bc1b72eda2e923d801d8f8c0067d4c1f3db44b5ea53376
|
| 3 |
+
size 3422552471
|
model-00200-of-00226.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:f9a99117c3314f487a3e99f0f2709b0c0e3d6f211267656e6691dbc59e416519
|
| 3 |
+
size 3422552477
|
model-00205-of-00226.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:ab5c81e328fc2063a56d7ef630c8e27bd00a703928c108ae8fb0a5e5cfc90a12
|
| 3 |
+
size 3641174302
|
model-00217-of-00226.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:558985a586731daaf4639a6b5e299ce2a267605b55ee630a79161c8ff3f37f45
|
| 3 |
+
size 3641174278
|