Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

4,522

Base only

Active filters: 6-bit

nightmedia/LFM2-1.2B-Tool-dwq6-mlx

Text Generation • 0.3B • Updated Oct 1, 2025 • 12

nightmedia/LFM2-350M-Extract-dwq6-mlx

Text Generation • 88.7M • Updated Oct 1, 2025 • 24 • 1

nightmedia/LFM2-1.2B-Extract-dwq6-mlx

Text Generation • 0.3B • Updated Oct 1, 2025 • 39 • 1

KCh3dRi4n/llm4decompile-9b-v2

Text Generation • 9B • Updated Oct 2, 2025 • 13

mlx-community/Apriel-1.5-15b-Thinker-6bit-MLX

Image-Text-to-Text • Updated Oct 3, 2025 • 29 • 1

mlx-community/granite-4.0-h-tiny-6bit-MLX

Text Generation • 7B • Updated Oct 3, 2025 • 52 • 1

gg000/Cydonia-R1-24B-v4.1-MLX-6bit

Text Generation • 24B • Updated Oct 3, 2025 • 26

Wwayu/Broken-Tutu-24B-Unslop-v2.0-mlx-6Bit

Text Generation • 24B • Updated Oct 3, 2025 • 21

mlx-community/granite-4.0-h-micro-6bit

Text Generation • 0.7B • Updated Oct 4, 2025 • 9

Wwayu/Fin-R1-mlx-6Bit

8B • Updated Oct 4, 2025 • 6

Wwayu/Medra27B-mlx-6Bit

Text Generation • 27B • Updated Oct 4, 2025

DeathGodlike/Qwen2.5-14B-Styx_EXL3

Text Generation • Updated Oct 4, 2025 • 6

DeathGodlike/Luna-Karcher-12B_EXL3

Text Generation • Updated Oct 5, 2025

DeathGodlike/Harmonic-Moon-12B_EXL3

Text Generation • Updated Oct 5, 2025 • 2

DeathGodlike/KansenSakura-Erosion-RP-12b_EXL3

Text Generation • Updated Oct 5, 2025

Wwayu/remnant-glm4-32b-mlx-6Bit

Text Generation • 33B • Updated Oct 5, 2025 • 9

Wwayu/QwQ-32B-ArliAI-RpR-v4-mlx-6Bit

Text Generation • 33B • Updated Oct 6, 2025 • 6

Wwayu/Huihui-EXAONE-4.0-32B-abliterated-mlx-6Bit

Text Generation • 32B • Updated Oct 6, 2025 • 48

DeathGodlike/MN-14B-Crimson-Veil_EXL3

Text Generation • Updated Oct 6, 2025

DeathGodlike/MN-12B-Azure-Veil_EXL3

Text Generation • Updated Oct 6, 2025 • 3

Wwayu/MedResearcher-R1-32B-mlx-6Bit

Text Generation • 33B • Updated Oct 7, 2025 • 11

Wwayu/QwQ-32B-Snowdrop-v0-mlx-6Bit

Text Generation • 33B • Updated Oct 7, 2025 • 10

gg000/WeirdCompound-v1.6-24b-MLX-6bit

Text Generation • 24B • Updated Oct 7, 2025 • 6

Wwayu/Jinx-Qwen3-30B-A3B-Thinking-2507-mlx-6Bit

Text Generation • 31B • Updated Oct 8, 2025 • 9

mlx-community/LFM2-8B-A1B-6bit-MLX

Text Generation • 8B • Updated Oct 8, 2025 • 29 • 3

mlx-community/LFM2-8B-A1B-6bit

Text Generation • 8B • Updated Oct 8, 2025 • 19

DeathGodlike/Noir-Blossom-12B_EXL3

Text Generation • Updated Oct 9, 2025

mlx-community/UserLM-8b-6bit

Text Generation • 8B • Updated Oct 9, 2025 • 7

DeathGodlike/MN-12B-Mag-Mell-R1-KTO_EXL3

Text Generation • Updated Oct 9, 2025

Wwayu/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored-mlx-6Bit

Text Generation • 8B • Updated Oct 10, 2025 • 127 • 2