Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

47,233

Base only

Active filters: 4-bit

AEON-7/Gemma-4-26B-A4B-it-Uncensored-NVFP4

Text Generation • 15B • Updated 1 day ago • 75.6k • 22

austindixson/glm-4.7-flash-Opus-Reasoning-Q4_KM

Text Generation • 30B • Updated Apr 10 • 23 • 1

thetom-ai/MiniMax-M2.7-ConfigI-MLX

Text Generation • 229B • Updated Apr 13 • 697 • 20

lmstudio-community/Qwen3.6-35B-A3B-MLX-4bit

Image-Text-to-Text • 6B • Updated Apr 16 • 577k • 4

bearzi/Qwen3.6-35B-A3B-oQ4

Text Generation • 6B • Updated Apr 16 • 110 • 5

Youssofal/Qwen3.6-35B-A3B-Abliterated-Heretic-MLX-4bit

Text Generation • 35B • Updated Apr 26 • 2.7k • 19

palmfuture/Qwen3.6-35B-A3B-GPTQ-Int4

Image-Text-to-Text • 36B • Updated 11 days ago • 152k • 27

Jiunsong/supergemma4-e4b-abliterated-mlx

Text Generation • 1B • Updated Apr 17 • 1.56k • 43

prism-ml/Bonsai-8B-AWQ-4-bit

Text Generation • 8B • Updated May 4 • 99 • 5

mlx-community/translategemma-4b-it-4bit_immersive-translate

Text Generation • 0.6B • Updated Apr 19 • 1.12k • 10

mlx-community/Kimi-K2.6-mlx-DQ3_K_M-q8

Text Generation • 1T • Updated Apr 21 • 4.68k • 9

mlx-community/Qwen3.6-27B-4bit

Image-Text-to-Text • 5B • Updated Apr 22 • 43.9k • 47

QuantTrio/Qwen3.6-27B-AWQ

Image-Text-to-Text • 28B • Updated Apr 23 • 1.41M • 20

QuantTrio/Qwen3.6-27B-AWQ-6Bit

Image-Text-to-Text • 28B • Updated Apr 23 • 94.1k • 17

mlx-community/DeepSeek-V4-Flash-4bit

Text Generation • 284B • Updated Apr 25 • 11.4k • 24

mattbucci/Qwen3.6-27B-AWQ

27B • Updated May 1 • 58.3k • 5

mlx-community/gemma-4-26B-A4B-it-OptiQ-4bit

Text Generation • 25B • Updated 2 days ago • 12.8k • 14

mlx-community/gemma-4-31B-it-OptiQ-4bit

Text Generation • 31B • Updated 2 days ago • 15.4k • 9

Intel/DeepSeek-V4-Flash-W4A16-AutoRound

Text Generation • 41B • Updated Jun 15 • 2.05k • 25

ucbye/Qwen3-Coder-Next-NVFP4-GB10

Text Generation • Updated Apr 29 • 33.2k • 4

mlx-community/gemma-4-31B-it-uncensored-heretic-4bit

Image-Text-to-Text • 31B • Updated May 19 • 1.82k • 6

Jackrong/MLX-Qwen3.5-9B-DeepSeek-V4-Flash-4bit

Text Generation • 1B • Updated Apr 30 • 2.84k • 12

AEON-7/Nemotron-3-Nano-Omni-AEON-Ultimate-Uncensored-NVFP4

Any-to-Any • 20B • Updated 1 day ago • 3.13k • 9

mlx-community/gpt-oss-120b-mxfp4-bf16

Text Generation • 117B • Updated Apr 30 • 365 • 1

mlx-community/Qwen3.6-40B-Claude-4.6-Opus-Deckard-Heretic-Uncensored-Thinking-4.5bit-msq

Image-Text-to-Text • 40B • Updated May 1 • 786 • 7

Youssofal/Qwen3.6-27B-MTPLX-Optimized

Text Generation • 27B • Updated May 4 • 1.71k • 9

wasifb/Carnice_V2_27B_INT4_BF16MTP

Text Generation • 7B • Updated May 4 • 4

WaveCut/HiDream-O1-Image-Dev-SDNQ-uint4-svd-r32

Image-Text-to-Image • 6B • Updated May 10 • 1 • 1

Youssofal/Qwen3.6-27B-MTPLX-Optimized-Speed-FP16

5B • Updated 9 days ago • 2.93k • 8

stamsam/Qwen3.6-35B-A3B-Claude-4.7-Opus-Reasoning-Distilled-MLX-oQ4-MTP

Text Generation • 35B • Updated May 12 • 7.3k • 24