Instructions to use zai-org/GLM-5.3-Flash-BF16 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use zai-org/GLM-5.3-Flash-BF16 with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="zai-org/GLM-5.3-Flash-BF16")
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
pipe(text=messages)

# Load model directly
from transformers import AutoProcessor, AutoModelForMultimodalLM

processor = AutoProcessor.from_pretrained("zai-org/GLM-5.3-Flash-BF16")
model = AutoModelForMultimodalLM.from_pretrained("zai-org/GLM-5.3-Flash-BF16", device_map="auto")
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
inputs = processor.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=40)
print(processor.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Inference
HuggingChat
Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use zai-org/GLM-5.3-Flash-BF16 with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "zai-org/GLM-5.3-Flash-BF16"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "zai-org/GLM-5.3-Flash-BF16",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/zai-org/GLM-5.3-Flash-BF16

SGLang

How to use zai-org/GLM-5.3-Flash-BF16 with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "zai-org/GLM-5.3-Flash-BF16" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "zai-org/GLM-5.3-Flash-BF16",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "zai-org/GLM-5.3-Flash-BF16" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "zai-org/GLM-5.3-Flash-BF16",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use zai-org/GLM-5.3-Flash-BF16 with Docker Model Runner:
```
docker model run hf.co/zai-org/GLM-5.3-Flash-BF16
```

ZHANGYUXUAN-zR commited on about 8 hours ago

Commit

3bbda24

verified ·

1 Parent(s): 8a1a121

Add files using upload-large-folder tool

Browse files

Files changed (50) hide show

model-00003-of-00120.safetensors +3 -0
model-00009-of-00120.safetensors +3 -0
model-00010-of-00120.safetensors +3 -0
model-00011-of-00120.safetensors +3 -0
model-00015-of-00120.safetensors +3 -0
model-00016-of-00120.safetensors +3 -0
model-00021-of-00120.safetensors +3 -0
model-00023-of-00120.safetensors +3 -0
model-00027-of-00120.safetensors +3 -0
model-00028-of-00120.safetensors +3 -0
model-00034-of-00120.safetensors +3 -0
model-00035-of-00120.safetensors +3 -0
model-00040-of-00120.safetensors +3 -0
model-00046-of-00120.safetensors +3 -0
model-00056-of-00120.safetensors +3 -0
model-00058-of-00120.safetensors +3 -0
model-00059-of-00120.safetensors +3 -0
model-00060-of-00120.safetensors +3 -0
model-00063-of-00120.safetensors +3 -0
model-00065-of-00120.safetensors +3 -0
model-00066-of-00120.safetensors +3 -0
model-00068-of-00120.safetensors +3 -0
model-00070-of-00120.safetensors +3 -0
model-00074-of-00120.safetensors +3 -0
model-00075-of-00120.safetensors +3 -0
model-00077-of-00120.safetensors +3 -0
model-00079-of-00120.safetensors +3 -0
model-00081-of-00120.safetensors +3 -0
model-00082-of-00120.safetensors +3 -0
model-00084-of-00120.safetensors +3 -0
model-00086-of-00120.safetensors +3 -0
model-00088-of-00120.safetensors +3 -0
model-00089-of-00120.safetensors +3 -0
model-00090-of-00120.safetensors +3 -0
model-00091-of-00120.safetensors +3 -0
model-00094-of-00120.safetensors +3 -0
model-00095-of-00120.safetensors +3 -0
model-00096-of-00120.safetensors +3 -0
model-00098-of-00120.safetensors +3 -0
model-00101-of-00120.safetensors +3 -0
model-00106-of-00120.safetensors +3 -0
model-00107-of-00120.safetensors +3 -0
model-00108-of-00120.safetensors +3 -0
model-00111-of-00120.safetensors +3 -0
model-00113-of-00120.safetensors +3 -0
model-00115-of-00120.safetensors +3 -0
model-00117-of-00120.safetensors +3 -0
model-00118-of-00120.safetensors +3 -0
model-00119-of-00120.safetensors +3 -0
model-00120-of-00120.safetensors +3 -0

model-00003-of-00120.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:b1c074e78f6839dbf8d5fa976ca7e818fb94c74f45017ca73ce045ca45d59298
+size 5368754080

model-00009-of-00120.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:20e1607acb84ff3f0f1f718c6c658f6104afd7725258b53318a2c8fde36bcff8
+size 5362972992

model-00010-of-00120.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:4eedc71726f60260d4cf4542013a0c387e275552021595e3b37312f9f263884b
+size 5368754192

model-00011-of-00120.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:ec169413131fa43e8e8edb5e2933a0f4151c71ddda8d740ed0ef338638b9476d
+size 5368754168

model-00015-of-00120.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:b0675c7c17dba8294f699163b7b8a1d36583532428312df2158353567cdeaf63
+size 5362973080

model-00016-of-00120.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:ac6e1f3995bd35f0cf84d81127c3b47a08755ec440d271872aae71eac239b1ce
+size 5368754184

model-00021-of-00120.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:770e6e5ff64be12df60f0db52fc2468f329cef29e1ffa24ab51ceedf93458053
+size 5353623672

model-00023-of-00120.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:1a1cc24e1f054ccfa871cb3f77ee45c33a7b16b939eb9102a09244489c58e6e1
+size 5362972992

model-00027-of-00120.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:0c2279cbac07ee1150c581fd38b00cf823798066e0fb5cbccc6608df7406065c
+size 5368754192

model-00028-of-00120.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:126c58a26adb9305d16bbab3e422eeb9520f0929886362a558c7942976a161a1
+size 5368754040

model-00034-of-00120.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:403b364c1f11a5dbbed0c7f11ba47720fe2b0c8b431ccd0d9769c8fd6ffcab90
+size 5362972992

model-00035-of-00120.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:81539b0fddb1ecce4ae6b2af80489b3788c812a47e3d7ef128e811f9aed12ae5
+size 5368754192

model-00040-of-00120.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:710f6a7eb5675ecd64965b11b01b11c302e717611c09f82524f5e5e333d2d18e
+size 5354098216

model-00046-of-00120.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:cc89ce7800b91ceafeb9f7a72facd72f28d17cd108e5a851f564bc71f03b08af
+size 5368754184

model-00056-of-00120.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:0f574404ed58fd0cefb586647ea0b79f62765837917cfee8ae35e82b1a688c91
+size 5361260904

model-00058-of-00120.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:d9554ddd98762c1e2065d52ffc267f2237843d9a3d937068e804110770f7c7fd
+size 5368753872

model-00059-of-00120.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:2d38c61b4ff9df2dd83c74c7ac22781c7ce6fd26eab8e12a34428bcc69fc968b
+size 5354097856

model-00060-of-00120.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:cfafdfefc2879b21a13612d4edb278e2fd794f262da247bc8326c87b057baa35
+size 5368754184

model-00063-of-00120.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:be0a20702356e7274e7c3a96adc70bc4887f4506977f30f824b8dfd9e9aad947
+size 5368754184

model-00065-of-00120.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:fcf035c0a187435869ef856043e5cb206be2354ce11f2922308cb9e5dbc42287
+size 5354098264

model-00066-of-00120.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:f3931912c4416aa278fbb2b582efd1fc946a4d2dacec063b8d0f10c11866a6e4
+size 5368754192

model-00068-of-00120.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:f82e75d1f75d0a182242a00d72b550546c64cfdac07e3875fb9d3ca24de68f65
+size 5362973216

model-00070-of-00120.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:214cb7cdbc3c52e9bfa008a1aea6c7861a36b0e0df7fb9595f8c4bc3b31ab347
+size 5362972992

model-00074-of-00120.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:081d1497a3f6ce9caf1f8d6b3d1a51465dbd056b3453b3dd77e7766f8cf31ca7
+size 5368754184

model-00075-of-00120.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:9bdb84215177430580f0976583bdab693f632711756f8d4ba369a91678e9eac0
+size 5368754056

model-00077-of-00120.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:64e78980c701027b11bf9fc71bd8f2e0ad4b3878dd382cdff6a998f62754e655
+size 5368754184

model-00079-of-00120.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:6f528a8175db7eecac559bd68d346d5070acde2c716213cc4f55a9ddf80f088c
+size 5362973200

model-00081-of-00120.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:41a7fd50e088208f80a23e0ace640e3fdd56c954113753e9868e7d0e6be1479f
+size 5362972992

model-00082-of-00120.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:3fa5404568b8a5330d30faa36bec97bf4e71d0c24dd96babb8cd5442af6125b8
+size 5368754184

model-00084-of-00120.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:513f3d94f2d46d808750cd2c2c1bf70e81148f4b048e9344ecf106bb47aa9a7d
+size 5362973032

model-00086-of-00120.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:a446b6e54098990b48b5ce997de698c36b3dd365c30d2a657d159c60f682d267
+size 5368754072

model-00088-of-00120.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:f863d001895a3db588c76f41fbee804110ec5db1638badda9c2c264a298444bc
+size 5368753864

model-00089-of-00120.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:f21b7b2f204ecb817c71c62056b05d0e83fe93ed1319b730be96945b289cca72
+size 5368753680

model-00090-of-00120.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:2f2c6bb9b1dd5d0c19841379c6e9c7de3b2a71d6303db48deac80adfc6fafbe8
+size 5362973128

model-00091-of-00120.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:8b6762764ec81dc4972945822319b7e8f762b736afbaec65406d1f4745a82a12
+size 5368754184

model-00094-of-00120.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:6d6f4f4598b7bb873d83269b5c4f2d8bfa749bd4512a4fb5c9185e4e449d13fc
+size 5368754168

model-00095-of-00120.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:61ac70142fa19936720ee499f978b1510c31671b2efa82b35fa5483edce4c4fc
+size 5362973016

model-00096-of-00120.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:1cc8041badb8cf57c01eb3226707d9df67e5a1e4d097f98de0a0ae54dd5bbe5c
+size 5368754184

model-00098-of-00120.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:d791d185a1bf9e0ad7b761bc7ebf82bea6ba3e19ef3734c9e0fb7d834c64a3de
+size 5362973096

model-00101-of-00120.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:57c97a94304bab817922467c7bb31a2d921c2e9c8337d5b2cc5971edd737158c
+size 5354098280

model-00106-of-00120.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:b6f76d74f4b614c8a68986b24d9a2ec7a95c649a1144c10bab00d9957e6d320f
+size 5354106360

model-00107-of-00120.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:4b71427a2684c8ca9970f10528b2cbc852eaaea31d1a69b0819d8a4a6ff3af4e
+size 5368753872

model-00108-of-00120.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:ebbd4704500f68a0f8b1a623fa986c5a188376fa08457b0b245b1a90258e58d4
+size 5368753784

model-00111-of-00120.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:d64b1b55c743aef1ba35419e1bb19d0adf449e94c2ed389c83694c1fa4b87316
+size 5368753712

model-00113-of-00120.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:571fe50898d29ea049161f877c79338c3dda083d6e316c065992248145759197
+size 5368753864

model-00115-of-00120.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:be37113b7167d3ec11d719bbd09404518d58f09d22d5ec9365a198c28b1655eb
+size 5366143376

model-00117-of-00120.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:7c1aad74e5b8d7bcd0300198091086029a951401cd48b187517df838d8349acd
+size 5362972664

model-00118-of-00120.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:49af8859fd4c1613d4f96ffc411f15bcae36ab51d54a1d22090148e73120004e
+size 5368753864

model-00119-of-00120.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:7421081853879b19d764b5a88cc83d6b39bcc13edaaeca39c639120d9ba51d22
+size 5368753800

model-00120-of-00120.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:0c65310ff08488ae4385d2e146f325f73a87f46cb9abbe0742fb6a24a0dae9de
+size 4173417528