Instructions to use zai-org/GLM-5.1-FP8 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use zai-org/GLM-5.1-FP8 with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="zai-org/GLM-5.1-FP8")
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("zai-org/GLM-5.1-FP8")
model = AutoModelForCausalLM.from_pretrained("zai-org/GLM-5.1-FP8")
messages = [
    {"role": "user", "content": "Who are you?"},
]
inputs = tokenizer.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=40)
print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Inference
HuggingChat
Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use zai-org/GLM-5.1-FP8 with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "zai-org/GLM-5.1-FP8"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "zai-org/GLM-5.1-FP8",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/zai-org/GLM-5.1-FP8

SGLang

How to use zai-org/GLM-5.1-FP8 with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "zai-org/GLM-5.1-FP8" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "zai-org/GLM-5.1-FP8",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "zai-org/GLM-5.1-FP8" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "zai-org/GLM-5.1-FP8",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use zai-org/GLM-5.1-FP8 with Docker Model Runner:
```
docker model run hf.co/zai-org/GLM-5.1-FP8
```

GLM-5.1-FP8

Commit History

Update EvalEval source links to flat datastore

a7f4d78
verified

EvalEvalBot commited on 10 days ago

Add EvalEval community eval results

7366a3d
verified

EvalEvalBot commited on Jun 5

Add EvalEval community eval results

abfc939
verified

EvalEvalBot commited on Jun 5

update chat_template

f396cf8

zRzRzRzRzRzRzR commited on Apr 16

update CyberGym score for Gemini 3.1 Pro and GPT-5.4

a92f815

zRzRzRzRzRzRzR commited on Apr 12

update

94017d0

zRzRzRzRzRzRzR commited on Apr 11

Update README.md

28d85cc
verified

ZHANGYUXUAN-zR commited on Apr 8

Update README.md

a21c5dd
verified

ZHANGYUXUAN-zR commited on Apr 7

Update README.md

b0c5785
verified

ZHANGYUXUAN-zR commited on Apr 7

Add files using upload-large-folder tool

baa9742
verified

ZHANGYUXUAN-zR commited on Apr 4

Add files using upload-large-folder tool

975065f
verified

ZHANGYUXUAN-zR commited on Apr 4

Add files using upload-large-folder tool

0c385d2
verified

ZHANGYUXUAN-zR commited on Apr 4

initial commit

70bd6d5
verified

ZHANGYUXUAN-zR commited on Apr 3

Commit History

Update EvalEval source links to flat datastore a7f4d78 verified

Add EvalEval community eval results 7366a3d verified

Add EvalEval community eval results abfc939 verified

update chat_template f396cf8

update CyberGym score for Gemini 3.1 Pro and GPT-5.4 a92f815

update 94017d0

Update README.md 28d85cc verified

Update README.md a21c5dd verified

Update README.md b0c5785 verified

Add files using upload-large-folder tool baa9742 verified

Add files using upload-large-folder tool 975065f verified

Add files using upload-large-folder tool 0c385d2 verified

initial commit 70bd6d5 verified

Update EvalEval source links to flat datastore

a7f4d78
verified

Add EvalEval community eval results

7366a3d
verified

Add EvalEval community eval results

abfc939
verified

update chat_template

f396cf8

update CyberGym score for Gemini 3.1 Pro and GPT-5.4

a92f815

update

94017d0

Update README.md

28d85cc
verified

Update README.md

a21c5dd
verified

Update README.md

b0c5785
verified

Add files using upload-large-folder tool

baa9742
verified

Add files using upload-large-folder tool

975065f
verified

Add files using upload-large-folder tool

0c385d2
verified

initial commit

70bd6d5
verified