Instructions to use TachyHealth/DeepSeek-R1 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use TachyHealth/DeepSeek-R1 with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="TachyHealth/DeepSeek-R1", trust_remote_code=True)

# pip install -U transformers accelerate
# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("TachyHealth/DeepSeek-R1", trust_remote_code=True)
model = AutoModelForCausalLM.from_pretrained("TachyHealth/DeepSeek-R1", trust_remote_code=True, device_map="auto")

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use TachyHealth/DeepSeek-R1 with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "TachyHealth/DeepSeek-R1"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "TachyHealth/DeepSeek-R1",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker

docker model run hf.co/TachyHealth/DeepSeek-R1

SGLang

How to use TachyHealth/DeepSeek-R1 with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "TachyHealth/DeepSeek-R1" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "TachyHealth/DeepSeek-R1",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "TachyHealth/DeepSeek-R1" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "TachyHealth/DeepSeek-R1",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Docker Model Runner
How to use TachyHealth/DeepSeek-R1 with Docker Model Runner:
```
docker model run hf.co/TachyHealth/DeepSeek-R1
```

DeepSeek-R1

Commit History

Jan 29, 2025

22:53
Upload model-00095-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
ac23a32
22:49
Upload model-00094-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
150459c
22:44
Upload model-00093-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
6b63bd6
22:40
Upload model-00092-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
d6a0264
22:35
Upload model-00091-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
bc05864
22:31
Upload model-00090-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
ad7fe3c
22:27
Upload model-00089-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
481124e
22:22
Upload model-00088-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
1d5f546
22:18
Upload model-00087-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
743a74a
22:14
Upload model-00086-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
9d35ebc
22:10
Upload model-00085-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
70e3cfc
22:06
Upload model-00084-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
dcd8305
22:02
Upload model-00083-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
3fa820c
21:57
Upload model-00082-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
40612bc
21:53
Upload model-00081-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
53c72fc
21:49
Upload model-00080-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
9fec9d6
21:45
Upload model-00079-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
7055a87
21:41
Upload model-00078-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
a7ff3b0
21:39
Upload model-00077-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
508a5b9
21:35
Upload model-00076-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
26c720a
21:31
Upload model-00075-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
53dc8e6
21:26
Upload model-00074-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
39bbc03
21:22
Upload model-00073-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
066b3ec
21:18
Upload model-00072-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
b662f6b
21:14
Upload model-00071-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
206dcf6
21:10
Upload model-00070-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
e7f2e83
21:06
Upload model-00069-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
66efcde
21:01
Upload model-00068-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
98287e1
20:56
Upload model-00067-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
bcab51f
20:52
Upload model-00066-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
1b90c17
20:48
Upload model-00065-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
a02d073
20:44
Upload model-00064-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
2b9b0d6
20:40
Upload model-00063-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
151cd70
20:35
Upload model-00062-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
33f57ae
20:31
Upload model-00061-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
2dfaade
20:27
Upload model-00060-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
4ca5a72
20:23
Upload model-00059-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
3b1ed7f
20:19
Upload model-00058-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
ddd98af
20:14
Upload model-00057-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
ea5f5b4
20:10
Upload model-00056-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
58714d6
20:08
Upload model-00055-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
6fb6c78
20:04
Upload model-00054-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
b45772f
20:00
Upload model-00053-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
a443509
19:56
Upload model-00052-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
4843086
19:52
Upload model-00051-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
c404426
19:47
Upload model-00050-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
c54ffad
19:43
Upload model-00049-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
6a5c145
19:39
Upload model-00048-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
3cf4acd
19:35
Upload model-00047-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
c74b902
19:31
Upload model-00046-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
39db4e3

Commit History

Jan 29, 2025

Upload model-00095-of-000163.safetensors with huggingface_hub

Upload model-00094-of-000163.safetensors with huggingface_hub

Upload model-00093-of-000163.safetensors with huggingface_hub

Upload model-00092-of-000163.safetensors with huggingface_hub

Upload model-00091-of-000163.safetensors with huggingface_hub

Upload model-00090-of-000163.safetensors with huggingface_hub

Upload model-00089-of-000163.safetensors with huggingface_hub

Upload model-00088-of-000163.safetensors with huggingface_hub

Upload model-00087-of-000163.safetensors with huggingface_hub

Upload model-00086-of-000163.safetensors with huggingface_hub

Upload model-00085-of-000163.safetensors with huggingface_hub

Upload model-00084-of-000163.safetensors with huggingface_hub

Upload model-00083-of-000163.safetensors with huggingface_hub

Upload model-00082-of-000163.safetensors with huggingface_hub

Upload model-00081-of-000163.safetensors with huggingface_hub

Upload model-00080-of-000163.safetensors with huggingface_hub

Upload model-00079-of-000163.safetensors with huggingface_hub

Upload model-00078-of-000163.safetensors with huggingface_hub

Upload model-00077-of-000163.safetensors with huggingface_hub

Upload model-00076-of-000163.safetensors with huggingface_hub

Upload model-00075-of-000163.safetensors with huggingface_hub

Upload model-00074-of-000163.safetensors with huggingface_hub

Upload model-00073-of-000163.safetensors with huggingface_hub

Upload model-00072-of-000163.safetensors with huggingface_hub

Upload model-00071-of-000163.safetensors with huggingface_hub

Upload model-00070-of-000163.safetensors with huggingface_hub

Upload model-00069-of-000163.safetensors with huggingface_hub

Upload model-00068-of-000163.safetensors with huggingface_hub

Upload model-00067-of-000163.safetensors with huggingface_hub

Upload model-00066-of-000163.safetensors with huggingface_hub

Upload model-00065-of-000163.safetensors with huggingface_hub

Upload model-00064-of-000163.safetensors with huggingface_hub

Upload model-00063-of-000163.safetensors with huggingface_hub

Upload model-00062-of-000163.safetensors with huggingface_hub

Upload model-00061-of-000163.safetensors with huggingface_hub

Upload model-00060-of-000163.safetensors with huggingface_hub

Upload model-00059-of-000163.safetensors with huggingface_hub

Upload model-00058-of-000163.safetensors with huggingface_hub

Upload model-00057-of-000163.safetensors with huggingface_hub

Upload model-00056-of-000163.safetensors with huggingface_hub

Upload model-00055-of-000163.safetensors with huggingface_hub

Upload model-00054-of-000163.safetensors with huggingface_hub

Upload model-00053-of-000163.safetensors with huggingface_hub

Upload model-00052-of-000163.safetensors with huggingface_hub

Upload model-00051-of-000163.safetensors with huggingface_hub

Upload model-00050-of-000163.safetensors with huggingface_hub

Upload model-00049-of-000163.safetensors with huggingface_hub

Upload model-00048-of-000163.safetensors with huggingface_hub

Upload model-00047-of-000163.safetensors with huggingface_hub

Upload model-00046-of-000163.safetensors with huggingface_hub