Instructions to use adamo1139/DeepSeek-R1-Zero-AWQ with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use adamo1139/DeepSeek-R1-Zero-AWQ with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="adamo1139/DeepSeek-R1-Zero-AWQ", trust_remote_code=True)
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("adamo1139/DeepSeek-R1-Zero-AWQ", trust_remote_code=True)
model = AutoModelForCausalLM.from_pretrained("adamo1139/DeepSeek-R1-Zero-AWQ", trust_remote_code=True)
messages = [
    {"role": "user", "content": "Who are you?"},
]
inputs = tokenizer.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=40)
print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Notebooks
Google Colab
Kaggle
Local Apps

vLLM

How to use adamo1139/DeepSeek-R1-Zero-AWQ with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "adamo1139/DeepSeek-R1-Zero-AWQ"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "adamo1139/DeepSeek-R1-Zero-AWQ",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/adamo1139/DeepSeek-R1-Zero-AWQ

SGLang

How to use adamo1139/DeepSeek-R1-Zero-AWQ with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "adamo1139/DeepSeek-R1-Zero-AWQ" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "adamo1139/DeepSeek-R1-Zero-AWQ",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "adamo1139/DeepSeek-R1-Zero-AWQ" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "adamo1139/DeepSeek-R1-Zero-AWQ",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use adamo1139/DeepSeek-R1-Zero-AWQ with Docker Model Runner:
```
docker model run hf.co/adamo1139/DeepSeek-R1-Zero-AWQ
```

adamo1139 commited on Jun 1, 2025

Commit

10854d1

verified ·

1 Parent(s): 384052f

Add files using upload-large-folder tool

Browse files

Files changed (32) hide show

model-00001-of-00074.safetensors +3 -0
model-00004-of-00074.safetensors +3 -0
model-00006-of-00074.safetensors +3 -0
model-00007-of-00074.safetensors +3 -0
model-00009-of-00074.safetensors +3 -0
model-00013-of-00074.safetensors +3 -0
model-00016-of-00074.safetensors +3 -0
model-00019-of-00074.safetensors +3 -0
model-00020-of-00074.safetensors +3 -0
model-00022-of-00074.safetensors +3 -0
model-00024-of-00074.safetensors +3 -0
model-00025-of-00074.safetensors +3 -0
model-00029-of-00074.safetensors +3 -0
model-00030-of-00074.safetensors +3 -0
model-00031-of-00074.safetensors +3 -0
model-00034-of-00074.safetensors +3 -0
model-00035-of-00074.safetensors +3 -0
model-00039-of-00074.safetensors +3 -0
model-00041-of-00074.safetensors +3 -0
model-00042-of-00074.safetensors +3 -0
model-00043-of-00074.safetensors +3 -0
model-00045-of-00074.safetensors +3 -0
model-00047-of-00074.safetensors +3 -0
model-00050-of-00074.safetensors +3 -0
model-00051-of-00074.safetensors +3 -0
model-00052-of-00074.safetensors +3 -0
model-00061-of-00074.safetensors +3 -0
model-00062-of-00074.safetensors +3 -0
model-00064-of-00074.safetensors +3 -0
model-00065-of-00074.safetensors +3 -0
model-00066-of-00074.safetensors +3 -0
model-00067-of-00074.safetensors +3 -0

model-00001-of-00074.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:1d7527e783907fd5707ff4c450b119b42a7402556b89d219c6eecb243a68eee5
+size 4995076312

model-00004-of-00074.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:791c32f6334c2823125bc22acfef8bbeb82f50eefb655cf9b598ef9947e0371f
+size 4995319632

model-00006-of-00074.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:e2154de20195ddb7bcbffa9eb6c74a2db7bfe6ceabaa0ace6b2ff4c45a4a95a1
+size 4995319680

model-00007-of-00074.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:91a7b59c72189b30728b72d44f3c9b2dd3e9060ef1fa559dae5c9f7470db2800
+size 4995320096

model-00009-of-00074.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:7488e2200d73d8abe3247f38a931364ecc0e6df176352db67a073c2ce4ca6103
+size 4995319632

model-00013-of-00074.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:52778cf089e8e89c57a0e8927a818b4f8d69541c11763a8429300d75ea4e9cd4
+size 4955755456

model-00016-of-00074.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:3750c79ad229cc40ae300f2f60d7f6a975401c78eca48a2911d05f42a547f147
+size 4995321512

model-00019-of-00074.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:5fd99fab1dedef3359687a87a02555fb245948daf7ebce7b2d1700e859b39548
+size 4993634296

model-00020-of-00074.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:ced101640ddbe95cb3de200b119a593d72759a42e7ce445c541afa12d4eab51d
+size 4995321512

model-00022-of-00074.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:aa8b6dd8ba5cd0f5dcb9cbc24f3f6e7392bad505cfa944a77f82f98b3f844358
+size 4995321864

model-00024-of-00074.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:e42b79f4fc675f54ec9878ce45dd26a9cde853aec4bb4eb5650dc6cc34565b1c
+size 4993634408

model-00025-of-00074.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:b3c4018caca946c7e020010abcca1880b1929186b67fbb96912eb7be74ccc353
+size 4995321512

model-00029-of-00074.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:8f63a48d63af1df64d34d325de64a3857f8823afc28d1b1da40cbdba3f646a69
+size 4993634464

model-00030-of-00074.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:d188466a3bfcd5a4c698268894d11af8f3964a9f1df9f3a94f23962a9b4ad32a
+size 4995321512

model-00031-of-00074.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:fd29051be1a6833eb954f2b505433714a05e7b458b3e69a3997554ec7504b879
+size 4995321512

model-00034-of-00074.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:ccaa25312ef3f49a934cd60b3f7b0453e208bd6dd24f3df4ed0bcf05b1cb032a
+size 4993634520

model-00035-of-00074.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:2ea570b756244176235a68826c89f1daa6b14498ff7bc71830d04efd581b8a9b
+size 4995321512

model-00039-of-00074.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:ca3eb0102dd5fab199b6ad53d642fd175e904f1606b752444751b86ed5174b0c
+size 4993634584

model-00041-of-00074.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:db45fb9a40ff8d2cd2bbf6cccbd14cbf64626104e5cc0d5a7dbaa0be58236f88
+size 4995321512

model-00042-of-00074.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:515ce838f1a7455b89630a382280055f1fe03e871d827cdfc011d8f750e784a1
+size 4995321632

model-00043-of-00074.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:91a675773e198bbde0a690fb8ffbbc51c7eb3fd16c9817ab4c504976a50077b5
+size 4995321968

model-00045-of-00074.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:5fd0e4abec99c8cbec942b4ecbbef3b69475b96b5edefcfce38b25e5ad25861b
+size 4995321512

model-00047-of-00074.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:db0d311e6af93890f7df4b62a8fa0e50189c7ce3c72372bad9d74ef8f404f866
+size 4995321576

model-00050-of-00074.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:a4c34a599dd9b5de81fa4a83cbe36dc40ea5be0ac41f99cb45e82585fc80e114
+size 4995321512

model-00051-of-00074.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:6587980d25d474c5535007e1123fc62acebab34fd5592e9d99bf1d4c5aba952b
+size 4995321512

model-00052-of-00074.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:da5dd1495925491551472516d35f22a795cc85fc2e274225d0fd7d0c075ef894
+size 4995321520

model-00061-of-00074.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:fb23058bd5493ed1ec832e3d736528b178b391cd2a5373a991c845868e9ad615
+size 4995321512

model-00062-of-00074.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:d9d1e09e2f505befb45d6a0f824bb84d9fd5373d5f7ea75225087cbabf3e2ebf
+size 4995321512

model-00064-of-00074.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:ae01fc9e9223dfd4d8c8f2475f89133f7a73e9643eb6f4072e65fd054fdab9bc
+size 4995321976

model-00065-of-00074.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:4e5231d8c3d52e9c95f98a77a7451e4f7e440b90e8b5dcf892e28e82fda0a80a
+size 4993634400

model-00066-of-00074.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:e1d2f1157bf0bfb6b3b177e39f39033bb1fe3c9034ea5073eb64074d7e34de0f
+size 4995321512

model-00067-of-00074.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:be284fc5ebfbe04e6c7ef692fa7c0a7a8b850001efa0e7052b8b9e68ea90d2cf
+size 4995321512