Instructions to use 0xdfi/GLM-5.2-QuantTrio-Abliterated with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use 0xdfi/GLM-5.2-QuantTrio-Abliterated with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="0xdfi/GLM-5.2-QuantTrio-Abliterated")
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("0xdfi/GLM-5.2-QuantTrio-Abliterated")
model = AutoModelForCausalLM.from_pretrained("0xdfi/GLM-5.2-QuantTrio-Abliterated", device_map="auto")
messages = [
    {"role": "user", "content": "Who are you?"},
]
inputs = tokenizer.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=40)
print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use 0xdfi/GLM-5.2-QuantTrio-Abliterated with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "0xdfi/GLM-5.2-QuantTrio-Abliterated"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "0xdfi/GLM-5.2-QuantTrio-Abliterated",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/0xdfi/GLM-5.2-QuantTrio-Abliterated

SGLang

How to use 0xdfi/GLM-5.2-QuantTrio-Abliterated with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "0xdfi/GLM-5.2-QuantTrio-Abliterated" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "0xdfi/GLM-5.2-QuantTrio-Abliterated",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "0xdfi/GLM-5.2-QuantTrio-Abliterated" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "0xdfi/GLM-5.2-QuantTrio-Abliterated",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use 0xdfi/GLM-5.2-QuantTrio-Abliterated with Docker Model Runner:
```
docker model run hf.co/0xdfi/GLM-5.2-QuantTrio-Abliterated
```

Model Access and Use Terms

This repository is publicly accessible, but you have to accept the conditions to access its files and content.

By checking the required box below and selecting “Agree and Access Model,” you (for yourself and your heirs, successors, and assigns) represent that you are at least 18 years old (or the age of majority in your jurisdiction, if greater), have legal capacity and authority to enter this agreement, and have read and understood these terms. You acknowledge that the model weights, code, configurations, documentation, and related files in this repository (the “Artifact”) are an unofficial research derivative in a model lineage with intentionally reduced refusal or safety behavior, are not sponsored, endorsed, approved by, or affiliated with any upstream author or base-model provider, have not been safety-evaluated by the repository owner, and may generate or enable harmful, illegal, offensive, infringing, private, sensitive, inaccurate, or otherwise unsafe content or outcomes. You accept the Artifact “AS IS” and “WITH ALL FAULTS.” To the fullest extent permitted by applicable law, the repository owner, author, uploader, maintainers, contributors, licensors, upstream authors, and each of their respective affiliates, officers, employees, and agents (collectively, the “Released Parties”) disclaim all warranties and conditions, express, implied, statutory, or arising from course of dealing or usage of trade, including merchantability, fitness for a particular purpose, title, non-infringement, accuracy, reliability, and safety. You knowingly and voluntarily assume all risks arising from access to or any use, misuse, modification, fine-tuning, distribution, deployment, output, or reliance on the Artifact and, to the fullest extent permitted by applicable law, irrevocably release, waive, discharge, and covenant not to sue the Released Parties for any claim, loss, liability, damage, penalty, cost, or expense arising from or related to the Artifact, including claims based on ordinary negligence. The Released Parties will not be liable for indirect, incidental, special, consequential, exemplary, or punitive damages, and their total aggregate liability arising from or related to the Artifact will not exceed US $100. You are solely responsible for reviewing and validating outputs, implementing appropriate safeguards and human oversight, preventing access by minors, complying with all applicable laws, regulations, export and sanctions controls, and license terms, and all consequences of your access and use. You agree to defend, indemnify, and hold harmless the Released Parties from every third-party claim and resulting loss, liability, damage, penalty, cost, or expense, including reasonable attorneys’ fees, arising from or related to your access, use, misuse, modification, distribution, deployment, outputs, or violation of law or these terms. The Released Parties are intended third-party beneficiaries entitled to enforce this agreement. These access and risk-allocation terms supplement and do not alter the copyright permissions granted by any applicable license; if a conflict exists, the applicable license controls copyright permissions and these terms control repository access and risk allocation. This agreement is governed by New York law, excluding conflict-of-laws rules, and you consent to exclusive jurisdiction and venue in the state and federal courts located in New York County, New York. If any provision is held unenforceable, it will be modified and limited to the minimum extent necessary or severed, and the remainder will remain in full force and effect. Terms version 2026-07-23.

Gated model

You can list files but not access them

Preview of files found in this repository

Model Access and Use Terms

Gated model You can list files but not access them

Gated model

You can list files but not access them