Instructions to use JANGQ-AI/GLM-5.3-FP8 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use JANGQ-AI/GLM-5.3-FP8 with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="JANGQ-AI/GLM-5.3-FP8")
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("JANGQ-AI/GLM-5.3-FP8")
model = AutoModelForCausalLM.from_pretrained("JANGQ-AI/GLM-5.3-FP8", device_map="auto")
messages = [
    {"role": "user", "content": "Who are you?"},
]
inputs = tokenizer.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=40)
print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use JANGQ-AI/GLM-5.3-FP8 with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "JANGQ-AI/GLM-5.3-FP8"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "JANGQ-AI/GLM-5.3-FP8",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/JANGQ-AI/GLM-5.3-FP8

SGLang

How to use JANGQ-AI/GLM-5.3-FP8 with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "JANGQ-AI/GLM-5.3-FP8" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "JANGQ-AI/GLM-5.3-FP8",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "JANGQ-AI/GLM-5.3-FP8" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "JANGQ-AI/GLM-5.3-FP8",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use JANGQ-AI/GLM-5.3-FP8 with Docker Model Runner:
```
docker model run hf.co/JANGQ-AI/GLM-5.3-FP8
```

jangq commited on 4 days ago

Commit

6da3ec8

verified ·

1 Parent(s): ad5f478

Add files using upload-large-folder tool

Browse files

This view is limited to 50 files because it contains too many changes. See raw diff

Files changed (50) hide show

model-00002-of-00282.safetensors +3 -0
model-00009-of-00282.safetensors +3 -0
model-00013-of-00282.safetensors +3 -0
model-00016-of-00282.safetensors +3 -0
model-00018-of-00282.safetensors +3 -0
model-00020-of-00282.safetensors +3 -0
model-00026-of-00282.safetensors +3 -0
model-00029-of-00282.safetensors +3 -0
model-00031-of-00282.safetensors +3 -0
model-00032-of-00282.safetensors +3 -0
model-00033-of-00282.safetensors +3 -0
model-00034-of-00282.safetensors +3 -0
model-00037-of-00282.safetensors +3 -0
model-00039-of-00282.safetensors +3 -0
model-00040-of-00282.safetensors +3 -0
model-00041-of-00282.safetensors +3 -0
model-00043-of-00282.safetensors +3 -0
model-00045-of-00282.safetensors +3 -0
model-00056-of-00282.safetensors +3 -0
model-00063-of-00282.safetensors +3 -0
model-00065-of-00282.safetensors +3 -0
model-00066-of-00282.safetensors +3 -0
model-00067-of-00282.safetensors +3 -0
model-00068-of-00282.safetensors +3 -0
model-00071-of-00282.safetensors +3 -0
model-00076-of-00282.safetensors +3 -0
model-00079-of-00282.safetensors +3 -0
model-00081-of-00282.safetensors +3 -0
model-00082-of-00282.safetensors +3 -0
model-00088-of-00282.safetensors +3 -0
model-00089-of-00282.safetensors +3 -0
model-00090-of-00282.safetensors +3 -0
model-00091-of-00282.safetensors +3 -0
model-00106-of-00282.safetensors +3 -0
model-00107-of-00282.safetensors +3 -0
model-00111-of-00282.safetensors +3 -0
model-00112-of-00282.safetensors +3 -0
model-00114-of-00282.safetensors +3 -0
model-00117-of-00282.safetensors +3 -0
model-00118-of-00282.safetensors +3 -0
model-00121-of-00282.safetensors +3 -0
model-00122-of-00282.safetensors +3 -0
model-00125-of-00282.safetensors +3 -0
model-00130-of-00282.safetensors +3 -0
model-00131-of-00282.safetensors +3 -0
model-00132-of-00282.safetensors +3 -0
model-00135-of-00282.safetensors +3 -0
model-00142-of-00282.safetensors +3 -0
model-00149-of-00282.safetensors +3 -0
model-00151-of-00282.safetensors +3 -0

model-00002-of-00282.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:8982d267c66b1d9d9f8dad2c47d52bc5f3f3bfc519fdfae6b6ef5658ab672816
+size 2676684696

model-00009-of-00282.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:679508cd75b91d509d3220c62e7607ff7615ade8f429d5f8dd1ef9ea5a9c577a
+size 2685485336

model-00013-of-00282.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:1a8f17d2329c9414d7b5f40cbc78407912518d53d260030e378eebd2ef8ce89d
+size 2682324960

model-00016-of-00282.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:20eab7068a509bf55912ab8d510762f3ecc49dfa22497c88eab518b6eede1d97
+size 2685485160

model-00018-of-00282.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:0e2716c39600e2af995a56197c0db49ba87480eecddba899094018335fca9651
+size 2680868152

model-00020-of-00282.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:677fc2e73be61bcbc794f9f2860a401e502087d0fdff6ad4a24859f99c8b324d
+size 2682470912

model-00026-of-00282.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:d5d286ceeeeabb66bb05a8797a2b79c96a4d15a7ddab4173b999edf356d32c45
+size 2680867976

model-00029-of-00282.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:2f9307359b9dacae0e0e21a1110c853003d6ee751c96619cf1693a98723fbfe2
+size 2680868152

model-00031-of-00282.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:515d3f1fa60a1c00f5dc706c6abfb15247e333d674bdb7ad6edd6fa91d0d2411
+size 2685485280

model-00032-of-00282.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:d54324eaf350cf30a45f8267d2933a7c81db8efb02ddb4020a10cd4e40634ea0
+size 2680868168

model-00033-of-00282.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:7bd1df46982325c84538600917f0a199e606d682c82519ac4227d7afe58d4709
+size 2680868120

model-00034-of-00282.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:3d78a5ffb9e8382f38bdfdd4025ea5e52087b46644b6f5d7c96babd2732541e3
+size 2680867736

model-00037-of-00282.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:b497783d43a04e3ba9e80bfd3d69ec047d17cc140555db233e429419444bd96b
+size 2680868000

model-00039-of-00282.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:64b07f54671c03d5bcc53a7b66755297e6e548c1ee1f2419aed523aeb8a57605
+size 2680868152

model-00040-of-00282.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:a218c73afa057363ecaca8207cb4ae0d21b04faa52e178bbee3e4bd2e9a5bf84
+size 2680868152

model-00041-of-00282.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:141db32fae4bbc8344bd5cc52234423ed3bf31cba328beecc7f2efc84436913b
+size 2680867928

model-00043-of-00282.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:397d63809f4566e1911ded6154ab00a588cf17775ccd941b53e72226fc14cbdf
+size 2680868160

model-00045-of-00282.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:dcdef67c76c89208635dc7df2a7b8e625a551bd8a934c059893f790fd6132bca
+size 2680867792

model-00056-of-00282.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:56a3833bc2353f8c91910474c90d028366484b6028f6ebf3defde4be3249535b
+size 2680867824

model-00063-of-00282.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:8c340bb7b35b691f8d0f214b0f21f007b2918cbd25414351fe4a68bfa9cbb37e
+size 2680867976

model-00065-of-00282.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:ae2c031544c06927f689ff555a977de4fe15d933ee6da0de044108833edf1325
+size 2680868168

model-00066-of-00282.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:6a3c25cc7fbead69fa6c002be3ecb4bc701ca04e77196e3d350b5bf5abeba541
+size 2680868152

model-00067-of-00282.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:8f16dcf7efd6f0ee50543e6faff4214bb9225f668ac31b69d990868c9a5130ed
+size 2680867840

model-00068-of-00282.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:1b278aaea4b0e8754f58aaa946a4503ab8505aad37c11c042cebbe0730b2b26d
+size 2685485280

model-00071-of-00282.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:1908157cc8a8ca2e2cfb356cb5c244746cae018e7b1954b9934a46ff0523cfa1
+size 2680867744

model-00076-of-00282.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:bbf814793d369b2f43d0938ee59fbcfc27ff4427bdc40158d3c3e82d6b8464f1
+size 2680867736

model-00079-of-00282.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:5b1e190ec4f31140aa13402d2353124932c634f39fb5747d1343dce93acc5055
+size 2685485064

model-00081-of-00282.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:feb5224d40e88b0b7347161e7aa9daa371657f93fbcae900077be1eccb37b000
+size 2680868144

model-00082-of-00282.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:788a3e92dcc4b7c1b7553e3fcb82dff6a816d210696d9db1e80d77cc55fb35a8
+size 2680867736

model-00088-of-00282.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:b9e941f9970c19d9f2ea30c67fc060b641be5f186036630ec73b92aef9fcf7e7
+size 2680868152

model-00089-of-00282.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:fd4ed7e2b5e9ebdf3eff6c1e01150569bf4505bdfb59f104e1011134f95d8072
+size 2680867888

model-00090-of-00282.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:fea4b8942909e9a227de5135f33388dbbe98ba9b3e4c34d59ffceb837ee42ccc
+size 2685485248

model-00091-of-00282.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:9fc8f691a282b105a1fbe7b32b6f8c152bf7bdda2094355dadfd28ffbb1d85ee
+size 2680868160

model-00106-of-00282.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:68fe262ef817d1d902f0dfab8049c21cbcebc89844bb48d1a9c569a234eb0d7d
+size 2680868152

model-00107-of-00282.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:4012a4df090daa3260d506313293644ef2b0284d0b7e071931cad88f19d347cf
+size 2680868056

model-00111-of-00282.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:bc11e5f2e1d0c0f14bf62b1f3f28c04b537ae793f931b8de97f4bb04b67bb938
+size 2680867920

model-00112-of-00282.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:55fcfcc8ca419711af89a449b836d2238feaeeffc849194c65650a5d47b45c1a
+size 2682470816

model-00114-of-00282.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:c4bc1c623e3f0aee3b6b9dce041aa5e1ec63fac1df223d82367bbf31185bec47
+size 2680868152

model-00117-of-00282.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:423a1bcd6ea96d03d009724d47be25512789b370d86982ab997fbc64f1196609
+size 2680867728

model-00118-of-00282.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:5ee6a08d91c1de772d6efe6c16d4f625f189417668b99842b639b71866b05ef9
+size 2680867656

model-00121-of-00282.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:30b837b056b1d5eeab3fe174867c322f2c6048885e0e1828ec737067baf65f91
+size 2680868152

model-00122-of-00282.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:1bd4b5291c3c071559811303bab89a42de763449c9f75a260c11105ccac1e321
+size 2680867944

model-00125-of-00282.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:fa4559231074cb6651eee088f9ce274d87ceff41eedaad71be81900b60431aa2
+size 2680868152

model-00130-of-00282.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:f4934217f0e3e825280a094b02ac96cb5f6f83a295a91acb5bac75b3d7a2b3dc
+size 2684554048

model-00131-of-00282.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:5fe82c5eca27b8f8b740215c2cbc9e9f8be6c58955bb45594e53456be5f6c8d2
+size 2678784808

model-00132-of-00282.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:2ecd925c522af5c12ce6bf10e6e445d1d1b88ce15efc97dd07951b18e9228776
+size 2680868152

model-00135-of-00282.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:8a231a6f99f04841ac3f13ef07afce52f6d2a8b608ea0a036dfb4038c47e29dd
+size 2680868168

model-00142-of-00282.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:1be1fa1f99bc58b8c8797ae716b8135d5298e694d0cfb69504685a3db7280725
+size 2685485472

model-00149-of-00282.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:88312861cdd64ddee58cde8254007c872452476b0270a81e08e282a611e82047
+size 2685485280

model-00151-of-00282.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:a646a6fa84f67715e352e1782c65345adf6b25095bd588e36bab88c34ac878cf
+size 2680868120