Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

16

Base only

Active filters: iq2_xxs

antirez/deepseek-v4-gguf

Text Generation • 284B • Updated May 31 • 4.79M • 322

huihui-ai/Huihui-DeepSeek-V4-Flash-abliterated-ds4-GGUF

284B • Updated Jun 6 • 614k • 97

jedisct1/DeepSeek-V4-Flash-imatrix-aligned

Text Generation • 7B • Updated May 13 • 996 • 5

rbinrs/Huihui-DeepSeek-V4-Flash-abliterated-ds4-GGUF

284B • Updated about 1 month ago • 1.07k • 1

bleysg/DeepSeek-V4-Flash-IQ2XXS-Q2K-FP8-120GB-target

Text Generation • 84B • Updated May 11 • 164 • 4

opensota/deepseek-v4-gguf

Text Generation • 284B • Updated May 12 • 685 • 2

peppi314/SR2AM-v1.0-30B-IQ2XXS-asym-GGUF

Text Generation • 31B • Updated May 24 • 21

zenlm/zen5-pro-gguf

Text Generation • 284B • Updated about 24 hours ago • 730

zenlm/zen5-max-gguf

Text Generation • 1.6T • Updated about 24 hours ago • 112

Keepser/Huihui-DeepSeek-V4-Flash-abliterated-ds4-GGUF

284B • Updated May 31 • 1.03k • 1

kavenmartinez/Qwen3.6-27B-IQ2_XXS-webgpu-GGUF

Text Generation • 27B • Updated 30 days ago • 406

nahid37/deepseek-v4-gguf

Text Generation • 284B • Updated 23 days ago • 662

Ninnix96/Qwen3.6-35B-A3B-gguf

Text Generation • 35B • Updated 6 days ago • 2.82k

eadx/Huihui-DeepSeek-V4-Flash-abliterated-ds4-GGUF

284B • Updated 10 days ago • 438

wangyanwei123/deepseek-v4-gguf

Text Generation • 284B • Updated 8 days ago • 550

windy88/Huihui-DeepSeek-V4-Flash-abliterated-ds4-GGUF

284B • Updated 7 days ago • 273