Text Generation
MLX
Safetensors
deepseek_v4
omlx
awq
Mixture of Experts
quantized
deepseek
8-bit precision
Instructions to use True2456/DeepSeek-V4-Flash-0731-AWQ with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use True2456/DeepSeek-V4-Flash-0731-AWQ with MLX:
# Make sure mlx-lm is installed # pip install --upgrade mlx-lm # if on a CUDA device, also pip install mlx[cuda] # Generate text with mlx-lm from mlx_lm import load, generate model, tokenizer = load("True2456/DeepSeek-V4-Flash-0731-AWQ") prompt = "Once upon a time in" text = generate(model, tokenizer, prompt=prompt, verbose=True) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- MLX LM
How to use True2456/DeepSeek-V4-Flash-0731-AWQ with MLX LM:
Generate or start a chat session
# Install MLX LM uv tool install mlx-lm # Generate some text mlx_lm.generate --model "True2456/DeepSeek-V4-Flash-0731-AWQ" --prompt "Once upon a time"
- Atomic Chat
Ctrl+K
- encoding
- inference
- 1.52 kB
- 1.08 kB
- 7.95 kB
- 122 kB
- 170 Bytes
- 2.15 GB xet
- 2.15 GB xet
- 2.15 GB xet
- 2.15 GB xet
- 2.15 GB xet
- 2.15 GB xet
- 2.15 GB xet
- 2.15 GB xet
- 2.15 GB xet
- 2.15 GB xet
- 2.15 GB xet
- 2.15 GB xet
- 2.15 GB xet
- 2.15 GB xet
- 2.15 GB xet
- 2.15 GB xet
- 2.15 GB xet
- 2.15 GB xet
- 2.15 GB xet
- 2.15 GB xet
- 2.15 GB xet
- 2.15 GB xet
- 2.15 GB xet
- 2.15 GB xet
- 2.15 GB xet
- 2.15 GB xet
- 2.15 GB xet
- 2.15 GB xet
- 2.15 GB xet
- 2.15 GB xet
- 2.15 GB xet
- 2.15 GB xet
- 2.15 GB xet
- 2.15 GB xet
- 2.15 GB xet
- 2.15 GB xet
- 2.15 GB xet
- 2.15 GB xet
- 2.15 GB xet
- 2.15 GB xet
- 2.15 GB xet
- 2.15 GB xet
- 2.15 GB xet