Instructions to use zai-org/GLM-5.3-Flash-BF16 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use zai-org/GLM-5.3-Flash-BF16 with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="zai-org/GLM-5.3-Flash-BF16")
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
pipe(text=messages)

# Load model directly
from transformers import AutoProcessor, AutoModelForMultimodalLM

processor = AutoProcessor.from_pretrained("zai-org/GLM-5.3-Flash-BF16")
model = AutoModelForMultimodalLM.from_pretrained("zai-org/GLM-5.3-Flash-BF16", device_map="auto")
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
inputs = processor.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=40)
print(processor.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Inference
HuggingChat
Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use zai-org/GLM-5.3-Flash-BF16 with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "zai-org/GLM-5.3-Flash-BF16"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "zai-org/GLM-5.3-Flash-BF16",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/zai-org/GLM-5.3-Flash-BF16

SGLang

How to use zai-org/GLM-5.3-Flash-BF16 with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "zai-org/GLM-5.3-Flash-BF16" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "zai-org/GLM-5.3-Flash-BF16",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "zai-org/GLM-5.3-Flash-BF16" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "zai-org/GLM-5.3-Flash-BF16",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use zai-org/GLM-5.3-Flash-BF16 with Docker Model Runner:
```
docker model run hf.co/zai-org/GLM-5.3-Flash-BF16
```

GLM-5.3-Flash-BF16

Commit History

update template

b196718

zRzRzRzRzRzRzR commited on about 3 hours ago

update

a6c167b

zRzRzRzRzRzRzR commited on about 5 hours ago

update

058880e

zRzRzRzRzRzRzR commited on about 5 hours ago

update template

b340720

zRzRzRzRzRzRzR commited on about 6 hours ago

Merge branch 'main' of hf.co:zai-org/GLM-5.3-Flash-BF16

99d2f30

zRzRzRzRzRzRzR commited on about 6 hours ago

update template

cac97e1

zRzRzRzRzRzRzR commited on about 6 hours ago

Add files using upload-large-folder tool

c168f9f
verified

ZHANGYUXUAN-zR commited on about 6 hours ago

Add files using upload-large-folder tool

203c144
verified

ZHANGYUXUAN-zR commited on about 7 hours ago

Add files using upload-large-folder tool

3bbda24
verified

ZHANGYUXUAN-zR commited on about 7 hours ago

Add files using upload-large-folder tool

8a1a121
verified

ZHANGYUXUAN-zR commited on about 7 hours ago

Update README.md

f55c930
verified

ZHANGYUXUAN-zR commited on about 10 hours ago

Update README.md

bdf5ce3
verified

ZHANGYUXUAN-zR commited on about 13 hours ago

initial commit

c54416c
verified

ZHANGYUXUAN-zR commited on 1 day ago

Commit History

update template b196718

update a6c167b

update 058880e

update template b340720

Merge branch 'main' of hf.co:zai-org/GLM-5.3-Flash-BF16 99d2f30

update template cac97e1

Add files using upload-large-folder tool c168f9f verified

Add files using upload-large-folder tool 203c144 verified

Add files using upload-large-folder tool 3bbda24 verified

Add files using upload-large-folder tool 8a1a121 verified

Update README.md f55c930 verified

Update README.md bdf5ce3 verified

initial commit c54416c verified

update template

b196718

update

a6c167b

update

058880e

update template

b340720

Merge branch 'main' of hf.co:zai-org/GLM-5.3-Flash-BF16

99d2f30

update template

cac97e1

Add files using upload-large-folder tool

c168f9f
verified

Add files using upload-large-folder tool

203c144
verified

Add files using upload-large-folder tool

3bbda24
verified

Add files using upload-large-folder tool

8a1a121
verified

Update README.md

f55c930
verified

Update README.md

bdf5ce3
verified

initial commit

c54416c
verified