Instructions to use bknyaz/GLM-4.5-Air-REAM with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use bknyaz/GLM-4.5-Air-REAM with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="bknyaz/GLM-4.5-Air-REAM")
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("bknyaz/GLM-4.5-Air-REAM")
model = AutoModelForCausalLM.from_pretrained("bknyaz/GLM-4.5-Air-REAM")
messages = [
    {"role": "user", "content": "Who are you?"},
]
inputs = tokenizer.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=40)
print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Notebooks
Google Colab
Kaggle
Local Apps

vLLM

How to use bknyaz/GLM-4.5-Air-REAM with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "bknyaz/GLM-4.5-Air-REAM"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "bknyaz/GLM-4.5-Air-REAM",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/bknyaz/GLM-4.5-Air-REAM

SGLang

How to use bknyaz/GLM-4.5-Air-REAM with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "bknyaz/GLM-4.5-Air-REAM" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "bknyaz/GLM-4.5-Air-REAM",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "bknyaz/GLM-4.5-Air-REAM" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "bknyaz/GLM-4.5-Air-REAM",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use bknyaz/GLM-4.5-Air-REAM with Docker Model Runner:
```
docker model run hf.co/bknyaz/GLM-4.5-Air-REAM
```

arXiv: REAM: Merging Improves Pruning of Experts in LLMs

GLM-4.5-Air-REAM

This model is a compressed version of zai-org/GLM-4.5-Air. It is obtained by reducing the number of experts in each MoE layer from 128 to 96. This reduction is achieved by the REAM method described in https://bknyaz.github.io/blog/2026/moe/.

Compared to other models obtained in this collection, more code data is used in the calibration data during pruning/merging to better preserve original's model coding abilities. Specifically, the ratio between c4, math and coding data (see https://bknyaz.github.io/blog/2026/moe/) is 0.0, 0.3, 0.7. The calibration data used here is the same as in GLM-4.5-Air-REAP.

The compressed model has 82B params (164GB) instead of 110B (220GB) of the original model, reducing storage and GPU memory requirements by roughly 25%. At the same time, the model retains >=95% of the original model's performance on a variety of benchmarks (see Results section below). Additional efficiency optimization (e.g., quantization) can be added similarly to the original model.

MTP layer is ignored in this model, but can be added using our code https://github.com/SamsungSAILMontreal/ream.

For eval on HumanEval and LiveCodeBench we use https://github.com/zai-org/glm-simple-evals. See additional details at Qwen3-30B-A3B-Instruct-2507-REAM.

Results

Model	IFeval	AIME25	GSM8K	GPQA-D	HumanEval	LiveCodeBench	AVG
GLM-4.5-Air	90.4	83.3	94.8	42.9	93.9	57.4	77.1
GLM-4.5-Air-REAM	83.6	83.3	94.9	37.9	90.2	53.7	73.9

License

Please refer to the license of the original model zai-org/GLM-4.5-Air.

Downloads last month: 11

Safetensors

Model size

82B params

Tensor type

F32

BF16

Model tree for bknyaz/GLM-4.5-Air-REAM

Base model

zai-org/GLM-4.5-Air

Finetuned

(38)

this model

Paper for bknyaz/GLM-4.5-Air-REAM

REAM: Merging Improves Pruning of Experts in LLMs

Paper • 2604.04356 • Published Apr 6 • 9