Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,914

Base only

Active filters: 5-bit

zerofata/MS3.2-PaintedFantasy-24B_exl3-5bpw

Text Generation • 8B • Updated Jun 26, 2025 • 8

mlx-community/gemma-3n-E4B-it-5bit

Image-Text-to-Text • Updated Jul 12, 2025 • 32

mlx-community/gemma-3n-E2B-it-5bit

Image-Text-to-Text • 2B • Updated Jul 12, 2025 • 22

LibraxisAI/Llama-3_1-Nemotron-Ultra-253B-v1-MLX-Q5

Text Generation • 253B • Updated May 11 • 61

mlx-community/DeepSeek-R1-0528-5bit

Text Generation • 671B • Updated Jul 1, 2025 • 44 • 3

zerofata/MS3.2-PaintedFantasy-Visage-33B_exl3_5bpw

Text Generation • 11B • Updated Jul 3, 2025 • 8

mlx-community/Polaris-4B-Preview-5bit

Text Generation • 0.8B • Updated Jul 3, 2025 • 8

Felladrin/mlx-5bit-Qwen3-4B-Merge-Variant-01

Text Generation • 0.8B • Updated Jul 3, 2025 • 12

mlx-community/Hunyuan-A13B-Instruct-5bit

Text Generation • 80B • Updated Jul 4, 2025 • 86 • 3

mlx-community/ERNIE-4.5-21B-A3B-PT-5bit

Text Generation • 22B • Updated Jul 4, 2025 • 30 • 1

SicariusSicariiStuff/Impish_LLAMA_4B_EXL3_5.0bpw

Text Generation • 2B • Updated Jul 5, 2025 • 7

mlx-community/DeepSeek-V3-0324-5bit

Text Generation • 671B • Updated Jul 6, 2025 • 45 • 1

mlx-community/Dolphin-Mistral-24B-Venice-Edition-5bit

Text Generation • 24B • Updated Jul 6, 2025 • 35

mlx-community/gemma-3n-E2B-5bit

Image-Text-to-Text • 2B • Updated Jul 12, 2025 • 14

mlx-community/gemma-3n-E4B-5bit

Image-Text-to-Text • Updated Jul 12, 2025 • 21

fedora-copr/Mistral-7B-Instruct-v0.3-GGUF

Text Generation • 7B • Updated Jul 9, 2025 • 6

mlx-community/SmolLM3-3B-5bit

Text Generation • 0.6B • Updated Jul 8, 2025 • 11

mlx-community/SmolLM3-3B-Base-5bit

Text Generation • 0.6B • Updated Jul 8, 2025 • 15

mlx-community/Kimi-Dev-72B-5bit

Text Generation • 73B • Updated Jul 11, 2025 • 333 • 2

mlx-community/Devstral-Small-2507-5bit

Text Generation • 24B • Updated Jul 11, 2025 • 19 • 1

mlx-community/LFM2-350M-5bit

Text Generation • 66.5M • Updated Jul 11, 2025 • 10 • 1

mlx-community/LFM2-700M-5bit

Text Generation • 0.1B • Updated Jul 11, 2025 • 15 • 1

mlx-community/LFM2-1.2B-5bit

Text Generation • 0.2B • Updated Jul 12, 2025 • 16 • 1

matatonic/Devstral-Small-2507-5.0bpw-exl2

Text Generation • Updated Jul 20, 2025 • 12

mlx-community/Qwen3-235B-A22B-Instruct-2507-5bit

Text Generation • 235B • Updated Jul 22, 2025 • 24 • 1

nightmedia/LLama-3.1-128k-Darkest-Planet-Uncensored-16.5B-q5-mlx

Text Generation • 17B • Updated Jul 23, 2025 • 50

bullerwins/Qwen3-235B-A22B-Instruct-2507-exl3-5.0bpw

Text Generation • 74B • Updated Jul 24, 2025 • 10

mlx-community/Qwen3-235B-A22B-Thinking-2507-5bit

Text Generation • 235B • Updated Jul 25, 2025 • 18

zerofata/MS3.2-PaintedFantasy-v2-24b-exl3-5bpw

Text Generation • 8B • Updated Jul 31, 2025 • 10

mlx-community/GLM-4.5-Air-5bit

Text Generation • 107B • Updated Jul 28, 2025 • 186