Instructions to use zai-org/GLM-5.3-Flash with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use zai-org/GLM-5.3-Flash with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="zai-org/GLM-5.3-Flash")
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
pipe(text=messages)

# Load model directly
from transformers import AutoProcessor, AutoModelForMultimodalLM

processor = AutoProcessor.from_pretrained("zai-org/GLM-5.3-Flash")
model = AutoModelForMultimodalLM.from_pretrained("zai-org/GLM-5.3-Flash", device_map="auto")
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
inputs = processor.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=40)
print(processor.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Inference
HuggingChat
Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use zai-org/GLM-5.3-Flash with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "zai-org/GLM-5.3-Flash"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "zai-org/GLM-5.3-Flash",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/zai-org/GLM-5.3-Flash

SGLang

How to use zai-org/GLM-5.3-Flash with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "zai-org/GLM-5.3-Flash" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "zai-org/GLM-5.3-Flash",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "zai-org/GLM-5.3-Flash" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "zai-org/GLM-5.3-Flash",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use zai-org/GLM-5.3-Flash with Docker Model Runner:
```
docker model run hf.co/zai-org/GLM-5.3-Flash
```

GLM-5.3-Flash

Commit History

Add evaluation results

2d894c6
verified

SaylorTwift HF Staff commited on 1 day ago

update

84c6a6a

zRzRzRzRzRzRzR commited on 1 day ago

update

9a7ae5f

zRzRzRzRzRzRzR commited on 1 day ago

update template

c5b82b6

zRzRzRzRzRzRzR commited on 1 day ago

Add files using upload-large-folder tool

dbc994b
verified

ZHANGYUXUAN-zR commited on 1 day ago

Add files using upload-large-folder tool

9855d73
verified

ZHANGYUXUAN-zR commited on 1 day ago

update

c54b8d1

zRzRzRzRzRzRzR commited on 1 day ago

Add files using upload-large-folder tool

edfc283
verified

ZHANGYUXUAN-zR commited on 1 day ago

Add files using upload-large-folder tool

545670d
verified

ZHANGYUXUAN-zR commited on 1 day ago

Update README.md

5d626e9
verified

ZHANGYUXUAN-zR commited on 1 day ago

Update README.md

69032ad
verified

ZHANGYUXUAN-zR commited on 1 day ago

initial commit

3c7f1b4
verified

ZHANGYUXUAN-zR commited on 2 days ago

Commit History

Add evaluation results 2d894c6 verified

update 84c6a6a

update 9a7ae5f

update template c5b82b6

Add files using upload-large-folder tool dbc994b verified

Add files using upload-large-folder tool 9855d73 verified

update c54b8d1

Add files using upload-large-folder tool edfc283 verified

Add files using upload-large-folder tool 545670d verified

Update README.md 5d626e9 verified

Update README.md 69032ad verified

initial commit 3c7f1b4 verified

Add evaluation results

2d894c6
verified

update

84c6a6a

update

9a7ae5f

update template

c5b82b6

Add files using upload-large-folder tool

dbc994b
verified

Add files using upload-large-folder tool

9855d73
verified

update

c54b8d1

Add files using upload-large-folder tool

edfc283
verified

Add files using upload-large-folder tool

545670d
verified

Update README.md

5d626e9
verified

Update README.md

69032ad
verified

initial commit

3c7f1b4
verified