Instructions to use QuixiAI/DeepSeek-R1-0528-bf16 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use QuixiAI/DeepSeek-R1-0528-bf16 with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="QuixiAI/DeepSeek-R1-0528-bf16")
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("QuixiAI/DeepSeek-R1-0528-bf16")
model = AutoModelForCausalLM.from_pretrained("QuixiAI/DeepSeek-R1-0528-bf16", device_map="auto")
messages = [
    {"role": "user", "content": "Who are you?"},
]
inputs = tokenizer.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=40)
print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use QuixiAI/DeepSeek-R1-0528-bf16 with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "QuixiAI/DeepSeek-R1-0528-bf16"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "QuixiAI/DeepSeek-R1-0528-bf16",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/QuixiAI/DeepSeek-R1-0528-bf16

SGLang

How to use QuixiAI/DeepSeek-R1-0528-bf16 with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "QuixiAI/DeepSeek-R1-0528-bf16" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "QuixiAI/DeepSeek-R1-0528-bf16",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "QuixiAI/DeepSeek-R1-0528-bf16" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "QuixiAI/DeepSeek-R1-0528-bf16",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use QuixiAI/DeepSeek-R1-0528-bf16 with Docker Model Runner:
```
docker model run hf.co/QuixiAI/DeepSeek-R1-0528-bf16
```

ehartford commited on May 31, 2025

Commit

5cef95b

verified ·

1 Parent(s): 05e7555

Add files using upload-large-folder tool

Browse files

Files changed (29) hide show

model-00009-of-000163.safetensors +3 -0
model-00011-of-000163.safetensors +3 -0
model-00013-of-000163.safetensors +3 -0
model-00016-of-000163.safetensors +3 -0
model-00024-of-000163.safetensors +3 -0
model-00027-of-000163.safetensors +3 -0
model-00040-of-000163.safetensors +3 -0
model-00041-of-000163.safetensors +3 -0
model-00042-of-000163.safetensors +3 -0
model-00055-of-000163.safetensors +3 -0
model-00058-of-000163.safetensors +3 -0
model-00060-of-000163.safetensors +3 -0
model-00067-of-000163.safetensors +3 -0
model-00068-of-000163.safetensors +3 -0
model-00077-of-000163.safetensors +3 -0
model-00080-of-000163.safetensors +3 -0
model-00090-of-000163.safetensors +3 -0
model-00093-of-000163.safetensors +3 -0
model-00095-of-000163.safetensors +3 -0
model-00110-of-000163.safetensors +3 -0
model-00111-of-000163.safetensors +3 -0
model-00117-of-000163.safetensors +3 -0
model-00125-of-000163.safetensors +3 -0
model-00126-of-000163.safetensors +3 -0
model-00130-of-000163.safetensors +3 -0
model-00135-of-000163.safetensors +3 -0
model-00142-of-000163.safetensors +3 -0
model-00151-of-000163.safetensors +3 -0
model-00152-of-000163.safetensors +3 -0

model-00009-of-000163.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:190f5e686b12362eb191aa794e0b7ee7c3652d77c896f5b22d46d2a06ea5c7c0
+size 8598786392

model-00011-of-000163.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:70a3c9ea0a626855b2d7fe2a8076c688ef9c79bf4e9516f59e174ce82229b008
+size 8602554152

model-00013-of-000163.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:782b89bd17a652e964eaca71a1ed97fdf4a2beab230ec6e0567c9ee624d4837c
+size 8598757320

model-00016-of-000163.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:ceccabdbb94a33eb9c3da17e0bf7542313a4ba78ad02cfbb2c2171879e68b3fa
+size 8602553936

model-00024-of-000163.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:cac4a3ccd1779639ff30e452a2cc143335702e60da936a4d4dd1f1ba1466dc3c
+size 8602554224

model-00027-of-000163.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:a8baadfcd4871ce2e3b7c05b3e6e4c433b57ab43f10b2a24a4e9fe21f020ac20
+size 8602554312

model-00040-of-000163.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:cd938dad7049c6936c16cb0237f34f9c26f63de4d317201302d947f40faf747b
+size 8598786608

model-00041-of-000163.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:9a4f3a344d86d1e682e93c0e18c839477dd8d39ca50427ffc09e702734c241a0
+size 8602554320

model-00042-of-000163.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:6f9de634e7b503c9ba4d1569229dc3ba73431d594ff82aacd6f64e308ad367f0
+size 8602554448

model-00055-of-000163.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:60cadedff949e4a58f4de8a07a771cdb3912a11a3f212298eb60ee55981dfda0
+size 8602554448

model-00058-of-000163.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:74c8f1bc2682cab4fb0349283f3dfe80cd8a4d59e0ed62653fb783b9b1dc611a
+size 8602554424

model-00060-of-000163.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:4e870cfb92c08218d018478ba978a067361bce2c610f2797d14c5fa1f594e23e
+size 8602554224

model-00067-of-000163.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:8c4d41126feb87b79b7cb8b32b37b9a2fc7a7a232ae2a81b03b5a49ceb1ca344
+size 8598786704

model-00068-of-000163.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:01415d07c611e664224818ee16b040b2ea864f0f42945e397472a506f32aa5eb
+size 8602554224

model-00077-of-000163.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:138c931872d9a44122d386739788168c4c5b2b12400484cfa5e16b46990bbf50
+size 8602554448

model-00080-of-000163.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:848875e77f9a2eb7593c684f04de3b07d6f3d11003086342e8f8e84cfa16c534
+size 8602554424

model-00090-of-000163.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:12711a718eaee64efbfb05c2c9bde74464d442f01594d38c7841dc45a598717a
+size 8602554224

model-00093-of-000163.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:96fd062f6c8d2345f06d001a44c1800f4bc7839524e56e3238ad19c0faf17a95
+size 8602554312

model-00095-of-000163.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:7aa7ea46c123da591097e47ea8ac0fbb258f5fce1d38c85f8d460c87f97f4400
+size 8598786520

model-00110-of-000163.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:b1d8436a18397b24e8969ca06a94f4592f81fe3829512440e6295b029b55d53b
+size 8602554416

model-00111-of-000163.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:0850dcdeb47d2eeaa5834539d14f9c68a8e2fd88a3abdad62cacc6dd4fa52ad8
+size 8598786704

model-00117-of-000163.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:b0d9d382015fde21f936a9d8efc9342c58b487e00ef44fb7f9b3179debbca360
+size 8598786520

model-00125-of-000163.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:9a3a9887c15254608b2238f3fe17737f1c1314752f8b23fb8013c841cdd9ba58
+size 8598786704

model-00126-of-000163.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:c8cb44c53eaaad45e32f9220dbc4c704f5d399356865dce9520e5d4653e3ac66
+size 8602554224

model-00130-of-000163.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:c06ea41bcbb0d0c435b24b7f413622d2b55149fe0ec935d11ab86df577a0a6c9
+size 8602554448

model-00135-of-000163.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:d6ecfc487f12f4f3d99c3c312b2045c476f0559a7a1f015bd47f62365bc548e1
+size 8602554448

model-00142-of-000163.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:f27ece43e69ace2862eaf851df811a4b118e4f7da194c309488e37a8dfe4806e
+size 8598757608

model-00151-of-000163.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:29dfe32e04a850d908f812e29fb091be9242a6ece351936c90878342aac7371e
+size 8602554416

model-00152-of-000163.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:7ee7f8856dc90ac7d6d597cf7074b687a9d1b6f3e1ef9bc2a6405847822d513a
+size 8598786704