Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,827

Base only

Active filters: 2-bit

huihui-ai/Huihui-DeepSeek-V4-Flash-0731-abliterated-GGUF

Text Generation • 284B • Updated 6 days ago • 118k • 106

EschaLabs/Qwen3.6-35B-A3B-Escha-W2

Text Generation • 7B • Updated 3 days ago • 4k • 238

prism-ml/Ternary-Bonsai-27B-gguf

Text Generation • 27B • Updated 22 days ago • 809k • • 1.18k

antirez/deepseek-v4-gguf

Text Generation • 284B • Updated 5 days ago • 964k • 431

deepgrove/maple-preview-2bit-mlx

1B • Updated 5 days ago • 518 • 27

AtomicChat/DeepSeek-V4-Flash-0731-GGUF

Text Generation • 284B • Updated 5 days ago • 14.5k • 19

ox-ox/DeepSeek-V4-Flash-0731-gguf-ds4

Text Generation • 284B • Updated 8 days ago • 8.16k • 23

stamsam/maple-preview-gguf

Text Generation • 20B • Updated 3 days ago • 8.12k • 11

huihui-ai/Huihui-DeepSeek-V4-Flash-abliterated-ds4-GGUF

284B • Updated Jun 6 • 322k • 123

mlx-community/DeepSeek-V4-Flash-0731-2.4bit-mixed

Text Generation • 26B • Updated 4 days ago • 1.15k • 7

anoane/DeepSeek-V4-Flash-0731-vllm-moet-sm120-cache

Updated 3 days ago • 10

Rednalreden/DeepSeek-V4-Flash-0731-dwarfstar-q2-gguf

Text Generation • 284B • Updated 9 days ago • 13.6k • 11

Jundot/DeepSeek-V4-Flash-0731-oQ2e-mtp

31B • Updated 6 days ago • 1.76k • 4

prism-ml/Ternary-Bonsai-27B-mlx-2bit

Text Generation • 3B • Updated 26 days ago • 809k • 168

Jundot/DeepSeek-V4-Flash-0731-oQ2.5e

32B • Updated 7 days ago • 1.23k • 3

MaziyarPanahi/MixTAO-7Bx2-MoE-v8.1-GGUF

Text Generation • 13B • Updated Mar 11, 2024 • 604 • 12

mlx-community/Qwen3.6-27B-AEON-Ultimate-Uncensored-BF16-mlx-2Bit

Text Generation • 27B • Updated May 13 • 1.69k • 7

twaggs88/DeepSeek-V4-Flash-REAP25-DSpark-ds4-GGUF

Text Generation • 240B • Updated 6 days ago • 11.8k • 10

schlaflos/DeepSeek-V4-Flash-0731-antirez-ds4-GGUF

Text Generation • 20B • Updated 8 days ago • 5.14k • 10

Jundot/DeepSeek-V4-Flash-0731-oQ2e

28B • Updated 6 days ago • 975 • 2

ProCreations/maple-preview-webgpu-v2

Text Generation • Updated 4 days ago • 36 • 2

mlx-community/DeepSeek-V4-Flash-0731-OptiQ-2bit

Text Generation • 26B • Updated 3 days ago • 650 • 2

MaziyarPanahi/Rabbit-7B-DPO-Chat-Mistral-7B-Instruct-v0.1-GGUF

Text Generation • 7B • Updated Jan 28, 2024 • 252 • 1

MaziyarPanahi/MixTAO-7Bx2-MoE-Instruct-v7.0-GGUF

Text Generation • 13B • Updated Feb 4, 2024 • 466 • 10

MaziyarPanahi/Calme-4x7B-MoE-v0.2-GGUF

Text Generation • 24B • Updated Mar 18, 2024 • 688 • 5

MaziyarPanahi/Yi-9B-200K-GGUF

Text Generation • 9B • Updated Mar 18, 2024 • 559 • 6

MaziyarPanahi/TowerInstruct-7B-v0.2-EN2ES-GGUF

Text Generation • 7B • Updated Apr 2, 2024 • 941 • 1

MaziyarPanahi/firefunction-v2-GGUF

Text Generation • 71B • Updated Jun 20, 2024 • 112k • 19

MaziyarPanahi/Llama-3-Groq-8B-Tool-Use-GGUF

Text Generation • 8B • Updated Jul 17, 2024 • 860 • 8

MaziyarPanahi/xLAM-8x22b-r-GGUF

Text Generation • 141B • Updated Sep 6, 2024 • 1.63k • 2