Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

45,315

Base only

Active filters: 4-bit

antirez/deepseek-v4-gguf

Text Generation • 284B • Updated about 7 hours ago • 617k • 199

huihui-ai/Huihui-DeepSeek-V4-Flash-abliterated-ds4-GGUF

284B • Updated about 10 hours ago • 8.13k • 17

Jiunsong/supergemma4-26b-uncensored-mlx-4bit-v2

Text Generation • 25B • Updated Apr 12 • 21.3k • 252

Lorbus/Qwen3.6-27B-int4-AutoRound

Image-Text-to-Text • 6B • Updated Apr 22 • 912k • 108

AlicanKiraz0/Titus-CybersecurityLLM-v1.0-mlx-4Bit

Text Generation • 35B • Updated 4 days ago • 268 • 9

Jackrong/Qwopus3.6-27B-v2-MLX-4bit

Text Generation • 27B • Updated 9 days ago • 2.75k • 14

mlx-community/Qwen3.6-27B-OptiQ-4bit

Text Generation • 27B • Updated about 15 hours ago • 14.6k • 24

Youssofal/Qwen3.6-27B-MTPLX-Optimized-Speed

Text Generation • 5B • Updated 27 days ago • 41.6k • 30

openbmb/MiniCPM5-1B-MLX

Text Generation • 0.2B • Updated 6 days ago • 2.1k • 11

mlx-community/gemma-4-e4b-it-OptiQ-4bit

Text Generation • 7B • Updated about 13 hours ago • 13.1k • 22

mlx-community/Qwen3.6-35B-A3B-4bit

Image-Text-to-Text • 6B • Updated Apr 16 • 92.4k • 58

tomasmcm/Darwin-4B-Genesis-mlx-4Bit

Text Generation • 1B • Updated 8 days ago • 73 • 5

Intel/Qwen3.6-27B-int4-AutoRound

6B • Updated 10 days ago • 204k • 39

mlx-community/Qwen3.6-35B-A3B-OptiQ-4bit

Text Generation • 35B • Updated about 15 hours ago • 7.02k • 10

stamsam/Qwen3.6-35B-A3B-Claude-4.7-Opus-Reasoning-Distilled-MLX-oQ4-MTP

Text Generation • 35B • Updated 19 days ago • 7.02k • 10

dawncr0w/Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressive-text-oQ4

Text Generation • 6B • Updated 13 days ago • 2.44k • 4

cHunter789/Qwen3.6-27B-i1-IQ4_KS-GGUF

Text Generation • 27B • Updated 9 days ago • 4.06k • 12

unsloth/mistral-7b-instruct-v0.3-bnb-4bit

Text Generation • 7B • Updated Nov 22, 2024 • 138k • 41

Intel/Qwen3-Coder-Next-int4-AutoRound

Text Generation • 12B • Updated Feb 10 • 34.8k • 38

unsloth/gemma-4-26b-a4b-it-UD-MLX-4bit

Image-Text-to-Text • 5B • Updated Apr 13 • 1.57k • 29

cyankiwi/Qwen3.6-35B-A3B-AWQ-4bit

Image-Text-to-Text • 36B • Updated 1 day ago • 1.18M • 71

unsloth/Qwen3.6-35B-A3B-UD-MLX-4bit

Image-Text-to-Text • 6B • Updated Apr 20 • 121k • 82

froggeric/Qwen3.6-35B-A3B-Uncensored-Heretic-MLX-4bit

Image-Text-to-Text • 6B • Updated 25 days ago • 5.51k • 7

JC1DA/Qwopus3.6-27B-v2-INT4-W4A16-Autoround

6B • Updated 6 days ago • 2.03k • 3

aguken-ai/Qwen-3-TTS-12Hz-0.6B-Base-hi-LoRA-Finetuned-BNB-NF4

Text-to-Speech • 0.9B • Updated 5 days ago • 109 • 8

XReyRobert/Qwopus3.6-27B-v2-GPTQ-Pro-v1

Text Generation • 27B • Updated 6 days ago • 505 • 4

philbert440/Qwen3.6-40B-DeckardUncensored-OpusDistilled-HermesCalibrated-W4A16-AWQ

Image-Text-to-Text • 40B • Updated 5 days ago • 295 • 3

shawnw3i/Qwen3.6-27B-AWQ-MTP

Image-Text-to-Text • 6B • Updated 3 days ago • 402 • 3

mlx-community/LocateAnything-3B-4bit

Image-Text-to-Text • 1B • Updated 2 days ago • 218 • 3

CohereLabs/c4ai-command-r-plus-4bit

Text Generation • 105B • Updated Apr 16, 2025 • 3.88k • 261