Instructions to use zai-org/GLM-5.3-Flash with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use zai-org/GLM-5.3-Flash with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="zai-org/GLM-5.3-Flash")
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
pipe(text=messages)

# Load model directly
from transformers import AutoProcessor, AutoModelForMultimodalLM

processor = AutoProcessor.from_pretrained("zai-org/GLM-5.3-Flash")
model = AutoModelForMultimodalLM.from_pretrained("zai-org/GLM-5.3-Flash", device_map="auto")
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
inputs = processor.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=40)
print(processor.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Inference
HuggingChat
Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use zai-org/GLM-5.3-Flash with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "zai-org/GLM-5.3-Flash"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "zai-org/GLM-5.3-Flash",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/zai-org/GLM-5.3-Flash

SGLang

How to use zai-org/GLM-5.3-Flash with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "zai-org/GLM-5.3-Flash" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "zai-org/GLM-5.3-Flash",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "zai-org/GLM-5.3-Flash" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "zai-org/GLM-5.3-Flash",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use zai-org/GLM-5.3-Flash with Docker Model Runner:
```
docker model run hf.co/zai-org/GLM-5.3-Flash
```

GLM-5.3-Flash

Commit History

Add ParseBench evaluation results

ecf69ce
verified

boyang-runllama commited on 1 day ago

Add ExtractBench evaluation results

c6b6ffa
verified

boyang-runllama commited on 1 day ago

update

04c4e9e

zRzRzRzRzRzRzR commited on 3 days ago

update

3f1971b

zRzRzRzRzRzRzR commited on 4 days ago

update

84c6a6a

zRzRzRzRzRzRzR commited on 4 days ago

update

9a7ae5f

zRzRzRzRzRzRzR commited on 4 days ago

update template

c5b82b6

zRzRzRzRzRzRzR commited on 4 days ago

Add files using upload-large-folder tool

dbc994b
verified

ZHANGYUXUAN-zR commited on 4 days ago

Add files using upload-large-folder tool

9855d73
verified

ZHANGYUXUAN-zR commited on 4 days ago

update

c54b8d1

zRzRzRzRzRzRzR commited on 4 days ago

Add files using upload-large-folder tool

edfc283
verified

ZHANGYUXUAN-zR commited on 4 days ago

Add files using upload-large-folder tool

545670d
verified

ZHANGYUXUAN-zR commited on 4 days ago

Update README.md

5d626e9
verified

ZHANGYUXUAN-zR commited on 4 days ago

Update README.md

69032ad
verified

ZHANGYUXUAN-zR commited on 4 days ago

initial commit

3c7f1b4
verified

ZHANGYUXUAN-zR commited on 5 days ago

Commit History

Add ParseBench evaluation results ecf69ce verified

Add ExtractBench evaluation results c6b6ffa verified

update 04c4e9e

update 3f1971b

update 84c6a6a

update 9a7ae5f

update template c5b82b6

Add files using upload-large-folder tool dbc994b verified

Add files using upload-large-folder tool 9855d73 verified

update c54b8d1

Add files using upload-large-folder tool edfc283 verified

Add files using upload-large-folder tool 545670d verified

Update README.md 5d626e9 verified

Update README.md 69032ad verified

initial commit 3c7f1b4 verified

Add ParseBench evaluation results

ecf69ce
verified

Add ExtractBench evaluation results

c6b6ffa
verified

update

04c4e9e

update

3f1971b

update

84c6a6a

update

9a7ae5f

update template

c5b82b6

Add files using upload-large-folder tool

dbc994b
verified

Add files using upload-large-folder tool

9855d73
verified

update

c54b8d1

Add files using upload-large-folder tool

edfc283
verified

Add files using upload-large-folder tool

545670d
verified

Update README.md

5d626e9
verified

Update README.md

69032ad
verified

initial commit

3c7f1b4
verified