Instructions to use kernelpool/GLM-5.2-6bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use kernelpool/GLM-5.2-6bit with MLX:
# Make sure mlx-lm is installed # pip install --upgrade mlx-lm # Generate text with mlx-lm from mlx_lm import load, generate model, tokenizer = load("kernelpool/GLM-5.2-6bit") prompt = "Write a story about Einstein" messages = [{"role": "user", "content": prompt}] prompt = tokenizer.apply_chat_template( messages, add_generation_prompt=True ) text = generate(model, tokenizer, prompt=prompt, verbose=True) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Pi
How to use kernelpool/GLM-5.2-6bit with Pi:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "kernelpool/GLM-5.2-6bit"
Configure the model in Pi
# Install Pi: npm install -g @mariozechner/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "mlx-lm": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "kernelpool/GLM-5.2-6bit" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Hermes Agent new
How to use kernelpool/GLM-5.2-6bit with Hermes Agent:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "kernelpool/GLM-5.2-6bit"
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default kernelpool/GLM-5.2-6bit
Run Hermes
hermes
- MLX LM
How to use kernelpool/GLM-5.2-6bit with MLX LM:
Generate or start a chat session
# Install MLX LM uv tool install mlx-lm # Interactive chat REPL mlx_lm.chat --model "kernelpool/GLM-5.2-6bit"
Run an OpenAI-compatible server
# Install MLX LM uv tool install mlx-lm # Start the server mlx_lm.server --model "kernelpool/GLM-5.2-6bit" # Calling the OpenAI-compatible server with curl curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "kernelpool/GLM-5.2-6bit", "messages": [ {"role": "user", "content": "Hello"} ] }'
Add files using upload-large-folder tool
Browse files- model-00002-of-00121.safetensors +3 -0
- model-00008-of-00121.safetensors +3 -0
- model-00010-of-00121.safetensors +3 -0
- model-00015-of-00121.safetensors +3 -0
- model-00022-of-00121.safetensors +3 -0
- model-00027-of-00121.safetensors +3 -0
- model-00028-of-00121.safetensors +3 -0
- model-00030-of-00121.safetensors +3 -0
- model-00035-of-00121.safetensors +3 -0
- model-00043-of-00121.safetensors +3 -0
- model-00049-of-00121.safetensors +3 -0
- model-00051-of-00121.safetensors +3 -0
- model-00054-of-00121.safetensors +3 -0
- model-00063-of-00121.safetensors +3 -0
- model-00066-of-00121.safetensors +3 -0
- model-00069-of-00121.safetensors +3 -0
- model-00071-of-00121.safetensors +3 -0
- model-00074-of-00121.safetensors +3 -0
- model-00082-of-00121.safetensors +3 -0
- model-00087-of-00121.safetensors +3 -0
- model-00088-of-00121.safetensors +3 -0
- model-00090-of-00121.safetensors +3 -0
- model-00095-of-00121.safetensors +3 -0
- model-00103-of-00121.safetensors +3 -0
- model-00106-of-00121.safetensors +3 -0
- model-00109-of-00121.safetensors +3 -0
- model-00111-of-00121.safetensors +3 -0
- model-00114-of-00121.safetensors +3 -0
model-00002-of-00121.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:1a37fdc61f32bb840f82e4ee09af92fcb8e17c7898e07941d99b482b36cff619
|
| 3 |
+
size 5320632555
|
model-00008-of-00121.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:a3a1969be2139e5e1f9f9051f84bc658aa6138dfad283501fac0c5ee0f77b5aa
|
| 3 |
+
size 5335155602
|
model-00010-of-00121.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:3fddb52225b72824b412f77a1ff47cd0684ce3c5cdf9cad7017611733c1278ae
|
| 3 |
+
size 2986502589
|
model-00015-of-00121.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:a3b96adb99eb2c29f028f6d9de8c693556c35ae843ec6540849c417901a01f7b
|
| 3 |
+
size 5301758470
|
model-00022-of-00121.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:0fbf05dba69046113fff475661ca26434a774a183fed3d99e07e4892376c6a30
|
| 3 |
+
size 5268332908
|
model-00027-of-00121.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:bf5613bef1208d8f2d2c31897a26605cfa45f11c523721016e0e139368921220
|
| 3 |
+
size 5234492184
|
model-00028-of-00121.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:731f59c17830b4f2c53186a5c3ddae44f60d560bb6a1e8de9f07e7950341dbf8
|
| 3 |
+
size 5301758542
|
model-00030-of-00121.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:3a2b62b6a9081359c552ed13649572f3fa79e27157c89369280dd61fe74de82a
|
| 3 |
+
size 5268332906
|
model-00035-of-00121.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:e7308d00d4fee86b80ade71503056b3f6a2ed90a305abefb50ba555271adb7bc
|
| 3 |
+
size 5234492180
|
model-00043-of-00121.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:cd3e259107a7b905df7f66c7fae615020671493735b2fd251d114e86776c738f
|
| 3 |
+
size 5234492188
|
model-00049-of-00121.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:8c5f2c56a96621f5a63d89f713fe7e24c7d5c294e71eb0a71a2fed62004e587f
|
| 3 |
+
size 5301758541
|
model-00051-of-00121.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:8c1e89f02dc39743487d1fbb43b6a536d7b8686467ca5e1b18393f10410bac12
|
| 3 |
+
size 5234492186
|
model-00054-of-00121.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:dade960601d230f40857a32ce9bebe7d630e0dc972e4158578648210cd0fca8b
|
| 3 |
+
size 5268332906
|
model-00063-of-00121.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:8cb36252a9209295ba2fd1e8b30df45bdaa5a3b0213d3c101591f1ee430feb6c
|
| 3 |
+
size 5309374865
|
model-00066-of-00121.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:3f761e349f6aae51fc08f3cab0f7c62f4a569dbb23dc63b61a7bf35c59cf8727
|
| 3 |
+
size 2986502647
|
model-00069-of-00121.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:c1319e73371837647b0c91ca017041fea19e2e9301af781dcb9f99cd16e6edc8
|
| 3 |
+
size 5368581202
|
model-00071-of-00121.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:74ccdd2799f8b6aafdcc1d5310ceb74b0d12f67a66af0aad11d314f64e7a5a68
|
| 3 |
+
size 5301758542
|
model-00074-of-00121.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:c5b768a00f2183596fceb4d8df6894cfe6c566dad5b160cc01ca0df5cb4a84df
|
| 3 |
+
size 2986502663
|
model-00082-of-00121.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:acd44e6ea7c7a0d4c9492014311fa53874f8f887da196ad9da1df73b2c033af0
|
| 3 |
+
size 2994119008
|
model-00087-of-00121.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:9985d3e728741ebb2f876a1fbedb473131fb0db263a5269dcbe0808811c48512
|
| 3 |
+
size 5301758528
|
model-00088-of-00121.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:d0440329e48af093bffcf7dea7249e548ae8c5b9530ce9106c5843c150a8b034
|
| 3 |
+
size 5335155609
|
model-00090-of-00121.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:6126da29182fd2925f03796cddb668896c85e29e6a1dd0a97442395fcb542903
|
| 3 |
+
size 2986502629
|
model-00095-of-00121.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:81baae4b1c4dec655fc8fbee3a36e9482d453a7e696bb6795384ff7510108ca5
|
| 3 |
+
size 5309374865
|
model-00103-of-00121.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:5e9682e3062cf14a5fc9aaba0ed3074f2523dd126add75a7f930f22f1b726877
|
| 3 |
+
size 5301758434
|
model-00106-of-00121.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:21bbc96210a1d8e3f5db43673c5e68d6c7c315f8c0031c3222bf40a79166ccbe
|
| 3 |
+
size 2986502631
|
model-00109-of-00121.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:5a39c52bcf5f5e23cdb6eeb72db053ede022c7d5103bc3c4366460f03d988a67
|
| 3 |
+
size 5368581210
|
model-00111-of-00121.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:4db23d9ba01bed9b9260d37d4e60991ad2702fe439af736b854f89b4afdc3afc
|
| 3 |
+
size 5301758484
|
model-00114-of-00121.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:8cabafb9b05896ab6131fb4235847e4eb22293992424c52e9f7225b5dc945e72
|
| 3 |
+
size 2994118916
|