Instructions to use tencent/Tencent-Hunyuan-Large with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use tencent/Tencent-Hunyuan-Large with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="tencent/Tencent-Hunyuan-Large")

# pip install -U transformers accelerate
# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("tencent/Tencent-Hunyuan-Large", device_map="auto")

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use tencent/Tencent-Hunyuan-Large with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "tencent/Tencent-Hunyuan-Large"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "tencent/Tencent-Hunyuan-Large",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker

docker model run hf.co/tencent/Tencent-Hunyuan-Large

SGLang

How to use tencent/Tencent-Hunyuan-Large with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "tencent/Tencent-Hunyuan-Large" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "tencent/Tencent-Hunyuan-Large",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "tencent/Tencent-Hunyuan-Large" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "tencent/Tencent-Hunyuan-Large",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Docker Model Runner
How to use tencent/Tencent-Hunyuan-Large with Docker Model Runner:
```
docker model run hf.co/tencent/Tencent-Hunyuan-Large
```

Tencent-Hunyuan-Large

Commit History

Jan 19, 2025

05:30
downloads counted

woodchen7

Verified signature
023bb21

Nov 24, 2024

09:16
Update README.md (#20)⁠

woodchen7 +1: wellzhong

Verified signature
f996145

Nov 22, 2024

03:34
Update README.md (#18)⁠

woodchen7 +1: wellzhong

Verified signature
0c335f3

Nov 20, 2024

06:39
Update README.md

woodchen7

Verified signature
094c315

Nov 19, 2024

15:52
FP8 update

woodchen7

5c22802
15:50
Upload model.safetensors.index.json with huggingface_hub

woodchen7

Verified signature
91bde94
15:34
Upload model-00080-of-00080.safetensors with huggingface_hub

woodchen7

Verified signature
c3425bb
15:32
Upload model-00079-of-00080.safetensors with huggingface_hub

woodchen7

Verified signature
3f48b63
15:30
Upload model-00036-of-00080.safetensors with huggingface_hub

woodchen7

Verified signature
8d9eb4d
15:29
Upload model-00058-of-00080.safetensors with huggingface_hub

woodchen7

Verified signature
1678f81
15:26
Upload model-00071-of-00080.safetensors with huggingface_hub

woodchen7

Verified signature
1523ff6
15:26
Upload model-00035-of-00080.safetensors with huggingface_hub

woodchen7

Verified signature
6faa081
15:25
Upload model-00056-of-00080.safetensors with huggingface_hub

woodchen7

Verified signature
06cbd41
15:21
Upload model-00019-of-00080.safetensors with huggingface_hub

woodchen7

Verified signature
da52f53
15:20
Upload model-00032-of-00080.safetensors with huggingface_hub

woodchen7

Verified signature
17d24f6
15:20
Upload model-00053-of-00080.safetensors with huggingface_hub

woodchen7

Verified signature
ebbba17
15:20
Upload model-00078-of-00080.safetensors with huggingface_hub

woodchen7

Verified signature
fc6e20e
15:15
Upload model-00015-of-00080.safetensors with huggingface_hub

woodchen7

Verified signature
ee13059
15:15
Upload model-00057-of-00080.safetensors with huggingface_hub

woodchen7

Verified signature
fc55759
15:14
Upload model-00075-of-00080.safetensors with huggingface_hub

woodchen7

Verified signature
945e728
15:14
Upload model-00030-of-00080.safetensors with huggingface_hub

woodchen7

Verified signature
960d0bd
15:10
Upload model-00054-of-00080.safetensors with huggingface_hub

woodchen7

Verified signature
d4b1ca0
15:10
Upload model-00012-of-00080.safetensors with huggingface_hub

woodchen7

Verified signature
b71e115
15:09
Upload model-00077-of-00080.safetensors with huggingface_hub

woodchen7

Verified signature
0c1415b
15:09
Upload model-00039-of-00080.safetensors with huggingface_hub

woodchen7

Verified signature
faa5e97
15:05
Upload model-00010-of-00080.safetensors with huggingface_hub

woodchen7

Verified signature
462068f
15:05
Upload model-00059-of-00080.safetensors with huggingface_hub

woodchen7

Verified signature
ae8e10c
15:04
Upload model-00072-of-00080.safetensors with huggingface_hub

woodchen7

Verified signature
b5428b9
15:03
Upload model-00033-of-00080.safetensors with huggingface_hub

woodchen7

Verified signature
183b5ab
15:00
Upload model-00052-of-00080.safetensors with huggingface_hub

woodchen7

Verified signature
c47580f
15:00
Upload model-00017-of-00080.safetensors with huggingface_hub

woodchen7

Verified signature
10833c7
14:59
Upload model-00076-of-00080.safetensors with huggingface_hub

woodchen7

Verified signature
f0640ca
14:58
Upload model-00038-of-00080.safetensors with huggingface_hub

woodchen7

Verified signature
116c2d8
14:55
Upload model-00016-of-00080.safetensors with huggingface_hub

woodchen7

Verified signature
1698e47
14:53
Upload model-00073-of-00080.safetensors with huggingface_hub

woodchen7

Verified signature
d02ef09
14:53
Upload model-00055-of-00080.safetensors with huggingface_hub

woodchen7

Verified signature
0a9d539
14:53
Upload model-00037-of-00080.safetensors with huggingface_hub

woodchen7

Verified signature
243b634
14:50
Upload model-00013-of-00080.safetensors with huggingface_hub

woodchen7

Verified signature
593ba29
14:48
Upload model-00050-of-00080.safetensors with huggingface_hub

woodchen7

Verified signature
ff29d11
14:48
Upload model-00031-of-00080.safetensors with huggingface_hub

woodchen7

Verified signature
826485e
14:47
Upload model-00074-of-00080.safetensors with huggingface_hub

woodchen7

Verified signature
5edb122
14:44
Upload model-00014-of-00080.safetensors with huggingface_hub

woodchen7

Verified signature
4b1653a
14:43
Upload model-00034-of-00080.safetensors with huggingface_hub

woodchen7

Verified signature
9ba242e
14:42
Upload model-00051-of-00080.safetensors with huggingface_hub

woodchen7

Verified signature
a1b1a6c
14:42
Upload model-00070-of-00080.safetensors with huggingface_hub

woodchen7

Verified signature
b955e9e
14:39
Upload model-00018-of-00080.safetensors with huggingface_hub

woodchen7

Verified signature
0466fe3
14:38
Upload model-00027-of-00080.safetensors with huggingface_hub

woodchen7

Verified signature
ba0df58
14:37
Upload model-00040-of-00080.safetensors with huggingface_hub

woodchen7

Verified signature
0fea78b
14:37
Upload model-00064-of-00080.safetensors with huggingface_hub

woodchen7

Verified signature
cce0d96
14:34
Upload model-00011-of-00080.safetensors with huggingface_hub

woodchen7

Verified signature
ae16711

Commit History

Jan 19, 2025

downloads counted

Nov 24, 2024

Update README.md (#20)⁠

Nov 22, 2024

Update README.md (#18)⁠

Nov 20, 2024

Update README.md

Nov 19, 2024

FP8 update

Upload model.safetensors.index.json with huggingface_hub

Upload model-00080-of-00080.safetensors with huggingface_hub

Upload model-00079-of-00080.safetensors with huggingface_hub

Upload model-00036-of-00080.safetensors with huggingface_hub

Upload model-00058-of-00080.safetensors with huggingface_hub

Upload model-00071-of-00080.safetensors with huggingface_hub

Upload model-00035-of-00080.safetensors with huggingface_hub

Upload model-00056-of-00080.safetensors with huggingface_hub

Upload model-00019-of-00080.safetensors with huggingface_hub

Upload model-00032-of-00080.safetensors with huggingface_hub

Upload model-00053-of-00080.safetensors with huggingface_hub

Upload model-00078-of-00080.safetensors with huggingface_hub

Upload model-00015-of-00080.safetensors with huggingface_hub

Upload model-00057-of-00080.safetensors with huggingface_hub

Upload model-00075-of-00080.safetensors with huggingface_hub

Upload model-00030-of-00080.safetensors with huggingface_hub

Upload model-00054-of-00080.safetensors with huggingface_hub

Upload model-00012-of-00080.safetensors with huggingface_hub

Upload model-00077-of-00080.safetensors with huggingface_hub

Upload model-00039-of-00080.safetensors with huggingface_hub

Upload model-00010-of-00080.safetensors with huggingface_hub

Upload model-00059-of-00080.safetensors with huggingface_hub

Upload model-00072-of-00080.safetensors with huggingface_hub

Upload model-00033-of-00080.safetensors with huggingface_hub

Upload model-00052-of-00080.safetensors with huggingface_hub

Upload model-00017-of-00080.safetensors with huggingface_hub

Upload model-00076-of-00080.safetensors with huggingface_hub

Upload model-00038-of-00080.safetensors with huggingface_hub

Upload model-00016-of-00080.safetensors with huggingface_hub

Upload model-00073-of-00080.safetensors with huggingface_hub

Upload model-00055-of-00080.safetensors with huggingface_hub

Upload model-00037-of-00080.safetensors with huggingface_hub

Upload model-00013-of-00080.safetensors with huggingface_hub

Upload model-00050-of-00080.safetensors with huggingface_hub

Upload model-00031-of-00080.safetensors with huggingface_hub

Upload model-00074-of-00080.safetensors with huggingface_hub

Upload model-00014-of-00080.safetensors with huggingface_hub

Upload model-00034-of-00080.safetensors with huggingface_hub

Upload model-00051-of-00080.safetensors with huggingface_hub

Upload model-00070-of-00080.safetensors with huggingface_hub

Upload model-00018-of-00080.safetensors with huggingface_hub

Upload model-00027-of-00080.safetensors with huggingface_hub

Upload model-00040-of-00080.safetensors with huggingface_hub

Upload model-00064-of-00080.safetensors with huggingface_hub

Upload model-00011-of-00080.safetensors with huggingface_hub