Instructions to use mlx-community/DeepSeek-V4-Pro-bf16 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use mlx-community/DeepSeek-V4-Pro-bf16 with MLX:
# Make sure mlx-lm is installed # pip install --upgrade mlx-lm # Generate text with mlx-lm from mlx_lm import load, generate model, tokenizer = load("mlx-community/DeepSeek-V4-Pro-bf16") prompt = "Write a story about Einstein" messages = [{"role": "user", "content": prompt}] prompt = tokenizer.apply_chat_template( messages, add_generation_prompt=True ) text = generate(model, tokenizer, prompt=prompt, verbose=True) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- MLX LM
How to use mlx-community/DeepSeek-V4-Pro-bf16 with MLX LM:
Generate or start a chat session
# Install MLX LM uv tool install mlx-lm # Interactive chat REPL mlx_lm.chat --model "mlx-community/DeepSeek-V4-Pro-bf16"
Run an OpenAI-compatible server
# Install MLX LM uv tool install mlx-lm # Start the server mlx_lm.server --model "mlx-community/DeepSeek-V4-Pro-bf16" # Calling the OpenAI-compatible server with curl curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "mlx-community/DeepSeek-V4-Pro-bf16", "messages": [ {"role": "user", "content": "Hello"} ] }'
Add files using upload-large-folder tool
Browse files- model-00003-of-00185.safetensors +3 -0
- model-00004-of-00185.safetensors +3 -0
- model-00007-of-00185.safetensors +3 -0
- model-00008-of-00185.safetensors +3 -0
- model-00010-of-00185.safetensors +3 -0
- model-00013-of-00185.safetensors +3 -0
- model-00015-of-00185.safetensors +3 -0
- model-00022-of-00185.safetensors +3 -0
- model-00025-of-00185.safetensors +3 -0
- model-00027-of-00185.safetensors +3 -0
- model-00029-of-00185.safetensors +3 -0
- model-00032-of-00185.safetensors +3 -0
- model-00034-of-00185.safetensors +3 -0
- model-00046-of-00185.safetensors +3 -0
- model-00048-of-00185.safetensors +3 -0
- model-00052-of-00185.safetensors +3 -0
- model-00055-of-00185.safetensors +3 -0
- model-00061-of-00185.safetensors +3 -0
- model-00071-of-00185.safetensors +3 -0
- model-00073-of-00185.safetensors +3 -0
- model-00074-of-00185.safetensors +3 -0
- model-00075-of-00185.safetensors +3 -0
- model-00077-of-00185.safetensors +3 -0
- model-00079-of-00185.safetensors +3 -0
- model-00083-of-00185.safetensors +3 -0
- model-00085-of-00185.safetensors +3 -0
- model-00089-of-00185.safetensors +3 -0
- model-00091-of-00185.safetensors +3 -0
- model-00093-of-00185.safetensors +3 -0
- model-00099-of-00185.safetensors +3 -0
- model-00100-of-00185.safetensors +3 -0
- model-00104-of-00185.safetensors +3 -0
- model-00110-of-00185.safetensors +3 -0
- model-00120-of-00185.safetensors +3 -0
- model-00125-of-00185.safetensors +3 -0
- model-00151-of-00185.safetensors +3 -0
- model-00154-of-00185.safetensors +3 -0
- model-00161-of-00185.safetensors +3 -0
- model-00165-of-00185.safetensors +3 -0
- model-00175-of-00185.safetensors +3 -0
- model-00178-of-00185.safetensors +3 -0
model-00003-of-00185.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:2efcfd61315063b7d15ce5f5c538831d29be3fb87f30f08e3b09e35337ac8761
|
| 3 |
+
size 4492099863
|
model-00004-of-00185.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:6003384532f7d7fae2124d19bf3c6faf2d1341f89f07891148a518b1b1e49e68
|
| 3 |
+
size 5256069777
|
model-00007-of-00185.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:00794a1c8526dcc63dba52159e81a612c4899c3cdf14ccf20e8cfa1f56c3b54d
|
| 3 |
+
size 5304053328
|
model-00008-of-00185.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:9013d7094de9e6e4ea636383e3f465fcbe974473ea33ed60688dc453e3c332b3
|
| 3 |
+
size 4492099867
|
model-00010-of-00185.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:7cc8ea2833c2c36bf4c5dd6631e1d5e1d1fd4f2279e75cb1491790a5187450bf
|
| 3 |
+
size 5249865860
|
model-00013-of-00185.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:4ad720e9325880e5a0d1e659235b28d9fa032503395cd837adba4e08243e7939
|
| 3 |
+
size 5297849383
|
model-00015-of-00185.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:a8b5047d9e57a8aef8b5f6534607b72b1e5572fddea4a489c48866dfe66baae0
|
| 3 |
+
size 4492099863
|
model-00022-of-00185.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:65cb6ef1887eb92c0afe5d06eed0dec6b7d5a3adfa81cdb3df25207137b31025
|
| 3 |
+
size 5249865830
|
model-00025-of-00185.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:2e40ff2661f0c798f4c883b1a36d0d98d0c23b163beab1bd1cb3d1a555876f0e
|
| 3 |
+
size 5297849385
|
model-00027-of-00185.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:3f77c3c8f939ff48668a5a84fb77c3fd4d7cd0bacc0fbbc6dd5edff9bf83d456
|
| 3 |
+
size 4492099863
|
model-00029-of-00185.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:c9ff969a6e54d76c4c2f1c386821b7700d1f2a4811726b1c4ae1d148bce4de5a
|
| 3 |
+
size 4492099867
|
model-00032-of-00185.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:b4ab7a0727609326effa7e951e54246cefe7b6944e705ae8930805e9124f7830
|
| 3 |
+
size 4492099869
|
model-00034-of-00185.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:5e5ce8dc6a95e61250b38ba56b2866b9294dd473353081f436fa3cb4d0459d3a
|
| 3 |
+
size 5249865891
|
model-00046-of-00185.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:8e51e4c1296a04d23275a862047fb79a0d328320108c44b772228d19c100fd73
|
| 3 |
+
size 5249865885
|
model-00048-of-00185.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:0b5010b2a01883d0167b9cc979933f52585944a4e01dcf3ed5e1a1ba9f56674d
|
| 3 |
+
size 4492099865
|
model-00052-of-00185.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:fb2f591d4fc053a96a170c32f45471ba19ec2bc5539406e00f0e11fda5c051e0
|
| 3 |
+
size 5249865883
|
model-00055-of-00185.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:a15e539546dbd6a515d12128d2c10125cdd262996f42f985d6074716f5965cb8
|
| 3 |
+
size 5297849462
|
model-00061-of-00185.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:a09a02251f6b550c5345c2ef6624ecf6cdc8adf40d2c34ed7632ebe78a906a7c
|
| 3 |
+
size 5297849454
|
model-00071-of-00185.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:26a272b0c3ddcfd1bb9616a0703dc54bf73478897370f090ba015ec28bff15b3
|
| 3 |
+
size 4492099869
|
model-00073-of-00185.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:266800f0e5f9b043d9f94e59a713fb9d57cc8d974e877e71db368235939399aa
|
| 3 |
+
size 5297849464
|
model-00074-of-00185.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:8213e337af40a99bd985383386d3778b3f67d218ca690002f60b634f7d5aba2c
|
| 3 |
+
size 4492099869
|
model-00075-of-00185.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:e52872a7ccf824764b9b1cd31cb1d71a24b12a5d992ca7ca35d093f9bc92b5bd
|
| 3 |
+
size 4492099865
|
model-00077-of-00185.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:4673fdb4ce5205c4aee67ae72371b587b70404f4eb3e723b1db75aba82b42793
|
| 3 |
+
size 4492099869
|
model-00079-of-00185.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:1cd59fc71cdb8fd8d5535a0798e422929ebb609541102131677dc8158e14b482
|
| 3 |
+
size 5297849424
|
model-00083-of-00185.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:d91a4c6a21de56b2951669846b147cbf2e9afd60bfbceefa0b11c756cfa3e6f5
|
| 3 |
+
size 4492099869
|
model-00085-of-00185.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:8cf8e386ca827a563704ae6faa08f1db47f78dbddf6817da4f01c82875bedfee
|
| 3 |
+
size 5297849448
|
model-00089-of-00185.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:94b33c2c61c9574da5e9f0b8875ddfcdb6af0d1734cf09ef12a552c39c5d2d5e
|
| 3 |
+
size 4492099869
|
model-00091-of-00185.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:ab5568cc8ecfbf685a911fbb0a874f992e52c5e59c95d23d6c7967ef3219a478
|
| 3 |
+
size 5297849456
|
model-00093-of-00185.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:9e02f27b69e4fa1917ae301562d42f17e7672922b91df2f3afc695084b3e59d2
|
| 3 |
+
size 4492099865
|
model-00099-of-00185.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:2eb8aa765a2563fa1c93709790529797765fddd9391aa4096c65d2802a66b6df
|
| 3 |
+
size 4492099865
|
model-00100-of-00185.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:0fccc398acad9c2719e32a070e0a1bd610765b41c3635ad4bd8f2db9edf3defc
|
| 3 |
+
size 5249865889
|
model-00104-of-00185.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:41d4f48adefc5b206e027c85689e784df674db5982627ee14d3af0275d0ba8be
|
| 3 |
+
size 4492099869
|
model-00110-of-00185.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:1da0a51a846f79eddfbfd478ecc26fe738c54089bad416e12c820ac783d7263d
|
| 3 |
+
size 4492099869
|
model-00120-of-00185.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:688b3cc2cb17ab9127150575315e050d961a571d68140ea80ea62f32d1c80272
|
| 3 |
+
size 4492099865
|
model-00125-of-00185.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:39e55ee0f3f04cc5e5f84aef5b0273e56bb92540f39a819ed324dd613cb5adfa
|
| 3 |
+
size 4492099869
|
model-00151-of-00185.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:1dc2b4d4cad3669d6354ca10cb4042bc85999ddd3ea145f4578d11b0ad0d85d9
|
| 3 |
+
size 5297849496
|
model-00154-of-00185.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:50ddf754a6f1eab85233500bd3b59ce30da439cd32cba9c74e2bbc2de176dd4b
|
| 3 |
+
size 5249865887
|
model-00161-of-00185.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:fceca3890ee61375d7d206623295370e68e522f701aad4f570c94a8d8059397b
|
| 3 |
+
size 4492099869
|
model-00165-of-00185.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:77acbcd3af249628d837c52c1bd48a8c6909550c8d38617f54f7bb0e453000c2
|
| 3 |
+
size 4492099865
|
model-00175-of-00185.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:d184c53406b06e6b9d29285afdf18c6524200d612bf6672e881ddee5c0192670
|
| 3 |
+
size 5297849480
|
model-00178-of-00185.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:244ea2316943f58d2488dea1ea4d235b97b920d0ff18f60ba6ae9ab1ce438c8d
|
| 3 |
+
size 5249865889
|