Instructions to use TachyHealth/DeepSeek-R1 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use TachyHealth/DeepSeek-R1 with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="TachyHealth/DeepSeek-R1", trust_remote_code=True)

# pip install -U transformers accelerate
# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("TachyHealth/DeepSeek-R1", trust_remote_code=True)
model = AutoModelForCausalLM.from_pretrained("TachyHealth/DeepSeek-R1", trust_remote_code=True, device_map="auto")

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use TachyHealth/DeepSeek-R1 with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "TachyHealth/DeepSeek-R1"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "TachyHealth/DeepSeek-R1",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker

docker model run hf.co/TachyHealth/DeepSeek-R1

SGLang

How to use TachyHealth/DeepSeek-R1 with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "TachyHealth/DeepSeek-R1" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "TachyHealth/DeepSeek-R1",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "TachyHealth/DeepSeek-R1" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "TachyHealth/DeepSeek-R1",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Docker Model Runner
How to use TachyHealth/DeepSeek-R1 with Docker Model Runner:
```
docker model run hf.co/TachyHealth/DeepSeek-R1
```

DeepSeek-R1

Commit History

Jan 30, 2025

00:09
Upload model-00113-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
ea90451
00:05
Upload model-00112-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
4ca2895
00:00
Upload model-00111-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
4e2d39a

Jan 29, 2025

23:56
Upload model-00110-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
88891df
23:52
Upload model-00109-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
74e1b02
23:48
Upload model-00108-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
a0a3446
23:43
Upload model-00107-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
7e7215c
23:39
Upload model-00106-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
f2a44fd
23:35
Upload model-00105-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
1b16155
23:30
Upload model-00104-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
1f2cead
23:26
Upload model-00103-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
0560d43
23:21
Upload model-00102-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
6f6af91
23:17
Upload model-00101-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
a77dc69
23:12
Upload model-00100-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
52df7ed
23:11
Upload model-00099-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
955863d
23:06
Upload model-00098-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
c93ab76
23:02
Upload model-00097-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
2c44709
22:58
Upload model-00096-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
9e06eb4
22:53
Upload model-00095-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
ac23a32
22:49
Upload model-00094-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
150459c
22:44
Upload model-00093-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
6b63bd6
22:40
Upload model-00092-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
d6a0264
22:35
Upload model-00091-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
bc05864
22:31
Upload model-00090-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
ad7fe3c
22:27
Upload model-00089-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
481124e
22:22
Upload model-00088-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
1d5f546
22:18
Upload model-00087-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
743a74a
22:14
Upload model-00086-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
9d35ebc
22:10
Upload model-00085-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
70e3cfc
22:06
Upload model-00084-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
dcd8305
22:02
Upload model-00083-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
3fa820c
21:57
Upload model-00082-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
40612bc
21:53
Upload model-00081-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
53c72fc
21:49
Upload model-00080-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
9fec9d6
21:45
Upload model-00079-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
7055a87
21:41
Upload model-00078-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
a7ff3b0
21:39
Upload model-00077-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
508a5b9
21:35
Upload model-00076-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
26c720a
21:31
Upload model-00075-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
53dc8e6
21:26
Upload model-00074-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
39bbc03
21:22
Upload model-00073-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
066b3ec
21:18
Upload model-00072-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
b662f6b
21:14
Upload model-00071-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
206dcf6
21:10
Upload model-00070-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
e7f2e83
21:06
Upload model-00069-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
66efcde
21:01
Upload model-00068-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
98287e1
20:56
Upload model-00067-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
bcab51f
20:52
Upload model-00066-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
1b90c17
20:48
Upload model-00065-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
a02d073
20:44
Upload model-00064-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
2b9b0d6

Commit History

Jan 30, 2025

Upload model-00113-of-000163.safetensors with huggingface_hub

Upload model-00112-of-000163.safetensors with huggingface_hub

Upload model-00111-of-000163.safetensors with huggingface_hub

Jan 29, 2025

Upload model-00110-of-000163.safetensors with huggingface_hub

Upload model-00109-of-000163.safetensors with huggingface_hub

Upload model-00108-of-000163.safetensors with huggingface_hub

Upload model-00107-of-000163.safetensors with huggingface_hub

Upload model-00106-of-000163.safetensors with huggingface_hub

Upload model-00105-of-000163.safetensors with huggingface_hub

Upload model-00104-of-000163.safetensors with huggingface_hub

Upload model-00103-of-000163.safetensors with huggingface_hub

Upload model-00102-of-000163.safetensors with huggingface_hub

Upload model-00101-of-000163.safetensors with huggingface_hub

Upload model-00100-of-000163.safetensors with huggingface_hub

Upload model-00099-of-000163.safetensors with huggingface_hub

Upload model-00098-of-000163.safetensors with huggingface_hub

Upload model-00097-of-000163.safetensors with huggingface_hub

Upload model-00096-of-000163.safetensors with huggingface_hub

Upload model-00095-of-000163.safetensors with huggingface_hub

Upload model-00094-of-000163.safetensors with huggingface_hub

Upload model-00093-of-000163.safetensors with huggingface_hub

Upload model-00092-of-000163.safetensors with huggingface_hub

Upload model-00091-of-000163.safetensors with huggingface_hub

Upload model-00090-of-000163.safetensors with huggingface_hub

Upload model-00089-of-000163.safetensors with huggingface_hub

Upload model-00088-of-000163.safetensors with huggingface_hub

Upload model-00087-of-000163.safetensors with huggingface_hub

Upload model-00086-of-000163.safetensors with huggingface_hub

Upload model-00085-of-000163.safetensors with huggingface_hub

Upload model-00084-of-000163.safetensors with huggingface_hub

Upload model-00083-of-000163.safetensors with huggingface_hub

Upload model-00082-of-000163.safetensors with huggingface_hub

Upload model-00081-of-000163.safetensors with huggingface_hub

Upload model-00080-of-000163.safetensors with huggingface_hub

Upload model-00079-of-000163.safetensors with huggingface_hub

Upload model-00078-of-000163.safetensors with huggingface_hub

Upload model-00077-of-000163.safetensors with huggingface_hub

Upload model-00076-of-000163.safetensors with huggingface_hub

Upload model-00075-of-000163.safetensors with huggingface_hub

Upload model-00074-of-000163.safetensors with huggingface_hub

Upload model-00073-of-000163.safetensors with huggingface_hub

Upload model-00072-of-000163.safetensors with huggingface_hub

Upload model-00071-of-000163.safetensors with huggingface_hub

Upload model-00070-of-000163.safetensors with huggingface_hub

Upload model-00069-of-000163.safetensors with huggingface_hub

Upload model-00068-of-000163.safetensors with huggingface_hub

Upload model-00067-of-000163.safetensors with huggingface_hub

Upload model-00066-of-000163.safetensors with huggingface_hub

Upload model-00065-of-000163.safetensors with huggingface_hub

Upload model-00064-of-000163.safetensors with huggingface_hub