GLM
Collection
Baa.ai quantized versions of GLM models • 4 items • Updated
Mixed-precision quantized version of zai-org/GLM-5.1 optimised by baa.ai using a proprietary Black Sheep AI method.
Per-tensor bit-width allocation via advanced sensitivity analysis and budget-constrained optimisation — no calibration data required.
| Metric | Value |
|---|---|
| Size | 289 GB |
from mlx_lm import load, generate
model, tokenizer = load("baa-ai/GLM-5.1-RAM-270GB-MLX")
response = generate(model, tokenizer, prompt="Hello!", max_tokens=256)
print(response)
Quantized by baa.ai
4-bit
Base model
zai-org/GLM-5.1