GLM-5.2-Uncensored - GGUF

As a reaction to the CEO of a frontier model lobbying the media + congress to boogeyman open source models, I release:

Imatrix GGUF quantizations of zandenAI/GLM-5.2-FP8-Uncensored, an abliterated (refusal-removed) build of zai-org/GLM-5.2-FP8 - a 754B-parameter Mixture-of-Experts model.

All credit for the abliteration methodology and the source weights goes to Zanden Kane (@zandenkane). This repository only provides GGUF conversions for local inference.

Method

• Source: FP8 -> dequantized to BF16 -> GGUF (the BF16 source is included here).
• Quants: built with an importance matrix (imatrix) and a dynamic, MoE-aware recipe - experts at the target bit-width, with token-embeddings / output / attention kept higher (Q8_0 / Q6_K).
• Calibration: standard public imatrix calibration corpus.

Files

(Quants upload as they finish - some may still be in progress.)

Run with llama.cpp

./llama-server -m glm52-IQ4_XS.gguf -ngl 99 -c 16384 --host 0.0.0.0 --port 8080

For the sharded BF16, download all parts and point llama.cpp at the first shard; it auto-loads the rest.

Hardware guide

Safety

The source model removes general refusals but preserves categorical refusal for CSAM / minor-exploitation content. Use responsibly and in accordance with your local laws. The original license and disclaimer apply in full.

License

MIT (inherited from the base model).

Credits

• Base model: Z.ai / zai-org - GLM-5.2-FP8
• Abliteration + source weights: Zanden Kane - zandenAI/GLM-5.2-FP8-Uncensored
• GGUF conversion (imatrix + dynamic recipe): this repository