Instructions to use PrimeIntellect/DeepSeek-V4.1-Flash-bf16 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use PrimeIntellect/DeepSeek-V4.1-Flash-bf16 with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="PrimeIntellect/DeepSeek-V4.1-Flash-bf16")
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# pip install -U transformers accelerate
# Load model directly
from transformers import AutoModelForCausalLM
model = AutoModelForCausalLM.from_pretrained("PrimeIntellect/DeepSeek-V4.1-Flash-bf16", device_map="auto")

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use PrimeIntellect/DeepSeek-V4.1-Flash-bf16 with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "PrimeIntellect/DeepSeek-V4.1-Flash-bf16"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "PrimeIntellect/DeepSeek-V4.1-Flash-bf16",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/PrimeIntellect/DeepSeek-V4.1-Flash-bf16

SGLang

How to use PrimeIntellect/DeepSeek-V4.1-Flash-bf16 with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "PrimeIntellect/DeepSeek-V4.1-Flash-bf16" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "PrimeIntellect/DeepSeek-V4.1-Flash-bf16",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "PrimeIntellect/DeepSeek-V4.1-Flash-bf16" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "PrimeIntellect/DeepSeek-V4.1-Flash-bf16",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use PrimeIntellect/DeepSeek-V4.1-Flash-bf16 with Docker Model Runner:
```
docker model run hf.co/PrimeIntellect/DeepSeek-V4.1-Flash-bf16
```

samsja commited on 22 days ago

Commit

a5b2a81

verified ·

1 Parent(s): 80f30f0

Add files using upload-large-folder tool

Browse files

Files changed (40) hide show

model-00001-of-00048.safetensors +3 -0
model-00002-of-00048.safetensors +3 -0
model-00003-of-00048.safetensors +3 -0
model-00005-of-00048.safetensors +3 -0
model-00006-of-00048.safetensors +3 -0
model-00007-of-00048.safetensors +3 -0
model-00008-of-00048.safetensors +3 -0
model-00009-of-00048.safetensors +3 -0
model-00011-of-00048.safetensors +3 -0
model-00013-of-00048.safetensors +3 -0
model-00014-of-00048.safetensors +3 -0
model-00015-of-00048.safetensors +3 -0
model-00016-of-00048.safetensors +3 -0
model-00017-of-00048.safetensors +3 -0
model-00018-of-00048.safetensors +3 -0
model-00020-of-00048.safetensors +3 -0
model-00021-of-00048.safetensors +3 -0
model-00022-of-00048.safetensors +3 -0
model-00023-of-00048.safetensors +3 -0
model-00025-of-00048.safetensors +3 -0
model-00026-of-00048.safetensors +3 -0
model-00027-of-00048.safetensors +3 -0
model-00028-of-00048.safetensors +3 -0
model-00029-of-00048.safetensors +3 -0
model-00030-of-00048.safetensors +3 -0
model-00033-of-00048.safetensors +3 -0
model-00034-of-00048.safetensors +3 -0
model-00035-of-00048.safetensors +3 -0
model-00036-of-00048.safetensors +3 -0
model-00037-of-00048.safetensors +3 -0
model-00038-of-00048.safetensors +3 -0
model-00039-of-00048.safetensors +3 -0
model-00040-of-00048.safetensors +3 -0
model-00041-of-00048.safetensors +3 -0
model-00042-of-00048.safetensors +3 -0
model-00044-of-00048.safetensors +3 -0
model-00045-of-00048.safetensors +3 -0
model-00046-of-00048.safetensors +3 -0
model-00047-of-00048.safetensors +3 -0
model-00048-of-00048.safetensors +3 -0

model-00001-of-00048.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:562aeaf562c21fb28d85410d4a3731c6113f4309764273d45802ec72b74e4990
+size 970535864

model-00002-of-00048.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:0e5b9ba12678ff5ef0dd9c261ac08bd963ed682d5e1a0e81d487e84bb367a595
+size 1323858304

model-00003-of-00048.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:fecafe40363c18a27ed7b75ae468edc6c9dd9a64137d51cc27eef3c97f6e3afb
+size 27511135832

model-00005-of-00048.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:4ac758993b8c2f2216260b268108d1f0bdf77d10700f8532e14562fd154fa9d1
+size 27532568208

model-00006-of-00048.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:8b020d98772a6dd00cdd3f8068d27c990739e33deaf35ef1f73893cda7c567af
+size 27511135832

model-00007-of-00048.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:996f91a45cef7a6b2bc9e0c0c0888f1e6c971ec5b2c215babf2e302b04c95a55
+size 27511135832

model-00008-of-00048.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:13e980ecbc2ea94dafb8b578a82a01cf4cd4f23754dce08b012da7b39caefb20
+size 27511135832

model-00009-of-00048.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:e980dde3ae3b47d2f1a61ead469b204785f942341c39b9f5c9a679ad236348e4
+size 27511135832

model-00011-of-00048.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:dbc1ed9d69bc8403a0d4287a44887142f6dc3d863dae084fb2bbc10cb7e84b07
+size 27532568208

model-00013-of-00048.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:1460e93df1a21addab1ed936612cd1829c26ba92c13caea20c82b3cc0e673b9d
+size 27511137008

model-00014-of-00048.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:534d7c0b12261aae134111452aea5872c0f26af3bb5b84d09731a077a34e8214
+size 27511137008

model-00015-of-00048.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:c06c6d0b68d8cb5b86d8296dc38055c82cd79e177facd7a6aa43d9e761c2e38b
+size 27511137008

model-00016-of-00048.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:359f4eb55ff96447e0dd9e8cea3b43d63816d64e3c860c39c58defa0061b41fc
+size 27511137008

model-00017-of-00048.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:1a12e87ed5ee51af84282bebb7700eb61916e30bd390b6365aab391c7718b65e
+size 27532569392

model-00018-of-00048.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:7627405633afafb90310fbd1329a0c3167aa49365f6dba2b3082aef087982648
+size 27511137008

model-00020-of-00048.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:a255a99558782abacd731ce5c0fb9a0e94e9329b9f9dd2af926ee310dc799a02
+size 27511137008

model-00021-of-00048.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:08b1632ce01dcc8fb4649a4edbf731578bb53a756672d933805e87258d82899b
+size 27511137008

model-00022-of-00048.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:4ad45f448d0cbdb5c56ccfcc9fd900ee050f0c9f816473725038e1d7890a5e06
+size 27511137008

model-00023-of-00048.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:9ce8d1f7984880e420d20eeaabfde6330a25ff3f5d6345f177a1351e9a901f50
+size 27527326384

model-00025-of-00048.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:d1665f33cf702a7a2949f342b5afc8f10173a8ec17ed5c568208baa03422d383
+size 27511137008

model-00026-of-00048.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:19f1bb082ca690470de9d7f86ee0e1998bbaa3f987049f375e2bfc08aad2a22d
+size 27511137008

model-00027-of-00048.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:846e9fee100ec64a76c81473a09bcdfdc5023adf2c1b7f1a5a5ecffbe5371083
+size 27521950704

model-00028-of-00048.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:67956a809f508fc9a15597640b1ea07fba60f91083c794b831372906270bb28b
+size 27511137008

model-00029-of-00048.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:8351e7ba1a83e8abb310b28cc616d11eeebe257bbb12e36fcb725043dae0b3c4
+size 27511137008

model-00030-of-00048.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:697fa8a1fcf9a82f5d16e50c0fcf2a8237f3dba7f39e7b96398cc97e7e06c4c5
+size 27511137008

model-00033-of-00048.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:89d91f2d49b6c7690a4cd1c56f9c6a8e97e20c52ff5163947738c8e5cd757124
+size 27511137008

model-00034-of-00048.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:0c5948acc7b3f638b919c6a24cf1986db3bad2bc10fac5e1403b0b4f0292ed1c
+size 27511137008

model-00035-of-00048.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:f6223a515f3511c871798ab5ebcd22b53acf4512dd53c7c57f810a6752ed0d30
+size 27521950704

model-00036-of-00048.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:b9edcf5f7c25e6ae9d5da1a82e89d2fd7616dae8e9bcb65e402679638b52f052
+size 27511137008

model-00037-of-00048.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:86825dc2e029a930a4d40ef862eaf6c868253ba5968f5894a116388cdb629512
+size 27511137008

model-00038-of-00048.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:54a7c7e707f1973fb1c1bc00ccd90a1571a0ff3022e326be9917c6c9cffdddde
+size 27511137008

model-00039-of-00048.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:9d1528060ce4bbffd317b08451fc2ee1c2d1bed477c2d10d662c37572e3efd2a
+size 27521950704

model-00040-of-00048.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:1b56fd17c4b26a766b6b0262e2e0ded1fb733a0f16e6ec4a8ab96b56eb473545
+size 27511137008

model-00041-of-00048.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:8a434002bedde77b0c6ceb7a239d4d6208fdc1ec40f9cd5932ad9a32630316a9
+size 27511137008

model-00042-of-00048.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:9a39fd9202cc2aaf6f97cec0795e738c02a10fa2293e7e4716543da6aafa23ee
+size 27511137008

model-00044-of-00048.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:977cb4fa941a58a7e96fc129d5b7eb7fdd891be497ae317eba0e8582de15aae3
+size 9546319504

model-00045-of-00048.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:6ad6cbb219084585a9a11f446c72c95d6781727e6a388249a1634a0899bab567
+size 9389022648

model-00046-of-00048.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:12e532f30c6a331f79ef85ed15d676b06778bd89b2adb6e0b4df2828f5b79bb1
+size 9521426808

model-00047-of-00048.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:78bbf04071c800746108284a97f59342b49c19be8bd768a7396b018624aa42b1
+size 101692283664

model-00048-of-00048.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:bf5504f895bb8905026dfa17f2c19a840efa2677cb500c072deb6ca0367b8a51
+size 101695059368