Instructions to use TachyHealth/DeepSeek-R1 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use TachyHealth/DeepSeek-R1 with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="TachyHealth/DeepSeek-R1", trust_remote_code=True)

# pip install -U transformers accelerate
# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("TachyHealth/DeepSeek-R1", trust_remote_code=True)
model = AutoModelForCausalLM.from_pretrained("TachyHealth/DeepSeek-R1", trust_remote_code=True, device_map="auto")

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use TachyHealth/DeepSeek-R1 with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "TachyHealth/DeepSeek-R1"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "TachyHealth/DeepSeek-R1",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker

docker model run hf.co/TachyHealth/DeepSeek-R1

SGLang

How to use TachyHealth/DeepSeek-R1 with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "TachyHealth/DeepSeek-R1" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "TachyHealth/DeepSeek-R1",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "TachyHealth/DeepSeek-R1" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "TachyHealth/DeepSeek-R1",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Docker Model Runner
How to use TachyHealth/DeepSeek-R1 with Docker Model Runner:
```
docker model run hf.co/TachyHealth/DeepSeek-R1
```

DeepSeek-R1

Commit History

Jan 29, 2025

21:49
Upload model-00080-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
9fec9d6
21:45
Upload model-00079-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
7055a87
21:41
Upload model-00078-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
a7ff3b0
21:39
Upload model-00077-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
508a5b9
21:35
Upload model-00076-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
26c720a
21:31
Upload model-00075-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
53dc8e6
21:26
Upload model-00074-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
39bbc03
21:22
Upload model-00073-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
066b3ec
21:18
Upload model-00072-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
b662f6b
21:14
Upload model-00071-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
206dcf6
21:10
Upload model-00070-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
e7f2e83
21:06
Upload model-00069-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
66efcde
21:01
Upload model-00068-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
98287e1
20:56
Upload model-00067-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
bcab51f
20:52
Upload model-00066-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
1b90c17
20:48
Upload model-00065-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
a02d073
20:44
Upload model-00064-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
2b9b0d6
20:40
Upload model-00063-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
151cd70
20:35
Upload model-00062-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
33f57ae
20:31
Upload model-00061-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
2dfaade
20:27
Upload model-00060-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
4ca5a72
20:23
Upload model-00059-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
3b1ed7f
20:19
Upload model-00058-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
ddd98af
20:14
Upload model-00057-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
ea5f5b4
20:10
Upload model-00056-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
58714d6
20:08
Upload model-00055-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
6fb6c78
20:04
Upload model-00054-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
b45772f
20:00
Upload model-00053-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
a443509
19:56
Upload model-00052-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
4843086
19:52
Upload model-00051-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
c404426
19:47
Upload model-00050-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
c54ffad
19:43
Upload model-00049-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
6a5c145
19:39
Upload model-00048-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
3cf4acd
19:35
Upload model-00047-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
c74b902
19:31
Upload model-00046-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
39db4e3
19:26
Upload model-00045-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
f7f65e6
19:22
Upload model-00044-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
6e617c4
19:18
Upload model-00043-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
335db36
19:14
Upload model-00042-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
0d1478c
19:09
Upload model-00041-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
55c1169
19:05
Upload model-00040-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
14b6af6
19:01
Upload model-00039-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
5e3e53c
18:57
Upload model-00038-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
46c717b
18:53
Upload model-00037-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
f186bea
18:48
Upload model-00036-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
d5bf215
18:44
Upload model-00035-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
b3b1b9a
18:40
Upload model-00034-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
3ca5edb
18:38
Upload model-00033-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
95af485
18:34
Upload model-00032-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
7d91eec
18:30
Upload model-00031-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
e8ff364

Commit History

Jan 29, 2025

Upload model-00080-of-000163.safetensors with huggingface_hub

Upload model-00079-of-000163.safetensors with huggingface_hub

Upload model-00078-of-000163.safetensors with huggingface_hub

Upload model-00077-of-000163.safetensors with huggingface_hub

Upload model-00076-of-000163.safetensors with huggingface_hub

Upload model-00075-of-000163.safetensors with huggingface_hub

Upload model-00074-of-000163.safetensors with huggingface_hub

Upload model-00073-of-000163.safetensors with huggingface_hub

Upload model-00072-of-000163.safetensors with huggingface_hub

Upload model-00071-of-000163.safetensors with huggingface_hub

Upload model-00070-of-000163.safetensors with huggingface_hub

Upload model-00069-of-000163.safetensors with huggingface_hub

Upload model-00068-of-000163.safetensors with huggingface_hub

Upload model-00067-of-000163.safetensors with huggingface_hub

Upload model-00066-of-000163.safetensors with huggingface_hub

Upload model-00065-of-000163.safetensors with huggingface_hub

Upload model-00064-of-000163.safetensors with huggingface_hub

Upload model-00063-of-000163.safetensors with huggingface_hub

Upload model-00062-of-000163.safetensors with huggingface_hub

Upload model-00061-of-000163.safetensors with huggingface_hub

Upload model-00060-of-000163.safetensors with huggingface_hub

Upload model-00059-of-000163.safetensors with huggingface_hub

Upload model-00058-of-000163.safetensors with huggingface_hub

Upload model-00057-of-000163.safetensors with huggingface_hub

Upload model-00056-of-000163.safetensors with huggingface_hub

Upload model-00055-of-000163.safetensors with huggingface_hub

Upload model-00054-of-000163.safetensors with huggingface_hub

Upload model-00053-of-000163.safetensors with huggingface_hub

Upload model-00052-of-000163.safetensors with huggingface_hub

Upload model-00051-of-000163.safetensors with huggingface_hub

Upload model-00050-of-000163.safetensors with huggingface_hub

Upload model-00049-of-000163.safetensors with huggingface_hub

Upload model-00048-of-000163.safetensors with huggingface_hub

Upload model-00047-of-000163.safetensors with huggingface_hub

Upload model-00046-of-000163.safetensors with huggingface_hub

Upload model-00045-of-000163.safetensors with huggingface_hub

Upload model-00044-of-000163.safetensors with huggingface_hub

Upload model-00043-of-000163.safetensors with huggingface_hub

Upload model-00042-of-000163.safetensors with huggingface_hub

Upload model-00041-of-000163.safetensors with huggingface_hub

Upload model-00040-of-000163.safetensors with huggingface_hub

Upload model-00039-of-000163.safetensors with huggingface_hub

Upload model-00038-of-000163.safetensors with huggingface_hub

Upload model-00037-of-000163.safetensors with huggingface_hub

Upload model-00036-of-000163.safetensors with huggingface_hub

Upload model-00035-of-000163.safetensors with huggingface_hub

Upload model-00034-of-000163.safetensors with huggingface_hub

Upload model-00033-of-000163.safetensors with huggingface_hub

Upload model-00032-of-000163.safetensors with huggingface_hub

Upload model-00031-of-000163.safetensors with huggingface_hub