Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

4,529

Base only

Active filters: 6-bit

mlx-community/Ministral-3-3B-Reasoning-2512-6bit

1B • Updated Dec 3, 2025 • 29

mlx-community/Ministral-3-8B-Reasoning-2512-6bit

Updated Dec 3, 2025 • 34

introvoyz041/ChemDFM-v1.0-13B-mlx-6bit-mlx-8Bit

Text Generation • 13B • Updated Dec 4, 2025 • 9

introvoyz041/SR-Scientist-30B-qx64-hi-mlx-mlx-8Bit

Text Generation • 31B • Updated Dec 4, 2025 • 7

mlx-community/Ministral-3-14B-Reasoning-2512-6bit

Updated Dec 4, 2025 • 52

introvoyz041/LFM2-350M-Math-dwq6-mlx-mlx-4Bit

Text Generation • 88.7M • Updated Dec 4, 2025 • 13

introvoyz041/Qwen3-Esper3-Reasoning-CODER-Instruct-12B-Brainstorm20x-q6-mlx-mlx-8Bit

Text Generation • 12B • Updated Dec 4, 2025 • 54

introvoyz041/Qwen3-Esper3-Reasoning-CODER-Instruct-21B-Brainstorm20x-128k-ctx-q6-mlx-mlx-8Bit

Text Generation • 21B • Updated Dec 4, 2025 • 49

introvoyz041/Qwen3-Esper3-Reasoning-CODER-Instruct-21B-Brainstorm20x-q6-mlx-mlx-8Bit

Text Generation • 21B • Updated Dec 4, 2025 • 35

DeathGodlike/Kinggaroo-12b-v2_EXL3

Text Generation • Updated Dec 7, 2025 • 2

DeathGodlike/MS3.2-24B-Magnum-Diamond_EXL3

Text Generation • Updated Dec 7, 2025 • 2

DeathGodlike/Soulbound-8B_EXL3

Text Generation • Updated Dec 7, 2025 • 1

DeathGodlike/Mistral-Small-24B-ArliAI-RPMax-v1.4_EXL3

Text Generation • Updated Dec 7, 2025 • 6

MaziyarPanahi/Nemotron-Orchestrator-8B-GGUF

Text Generation • 8B • Updated Dec 6, 2025 • 94k • 6

MaziyarPanahi/Hermes-4.3-36B-GGUF

Text Generation • 36B • Updated Dec 6, 2025 • 331 • 3

introvoyz041/Mistral-Devstral-2507-CODER-Brainstorm40x-44B-q6-mlx-mlx-4Bit

Text Generation • 44B • Updated Dec 7, 2025 • 32

introvoyz041/Mistral-Devstral-2505-CODER-Brainstorm40x-44B-q6-mlx-mlx-6Bit

Text Generation • 44B • Updated Dec 7, 2025 • 31

ep3998/MN-12B-Mag-Mell-R1-mlx-6Bit

Text Generation • 12B • Updated Dec 7, 2025 • 12

DeathGodlike/RP-king-12b_EXL3

Text Generation • Updated Dec 7, 2025 • 3

DeathGodlike/Hollowed-Rose-12B_EXL3

Text Generation • Updated Dec 7, 2025 • 2

DeathGodlike/Shining-Prism-12B_EXL3

Text Generation • Updated Dec 7, 2025

DeathGodlike/L3-TheSpice-8b-v0.8.3_EXL3

Text Generation • Updated Dec 7, 2025 • 1

mlx-community/rnj-1-instruct-6bit

Text Generation • 8B • Updated Dec 8, 2025 • 9

mlx-community/GLM-4.6V-Flash-6bit

Image-Text-to-Text • Updated Dec 8, 2025 • 26 • 1

DeathGodlike/MS3.2-24B-Chaos-Skies_EXL3

Text Generation • Updated Dec 8, 2025 • 3

MaziyarPanahi/GLM-4.6V-Flash-GGUF

Text Generation • 9B • Updated Dec 8, 2025 • 95.6k • 6

lmstudio-community/rnj-1-instruct-MLX-6bit

8B • Updated Dec 8, 2025 • 30

lmstudio-community/GLM-4.6V-Flash-MLX-6bit

Image-Text-to-Text • Updated Dec 8, 2025 • 93.1k

mlx-community/GLM-4.6V-6bit

Image-Text-to-Text • Updated Feb 22 • 30

introvoyz041/Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B-qx64-hi-mlx-mlx-8Bit

Text Generation • 13B • Updated Dec 8, 2025 • 38