Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

4,518

Base only

Active filters: 6-bit

steampunque/MiniCPM-V-4_5-MP-GGUF

8B • Updated Feb 18 • 39 • 1

jesusoctavioas/gpt-oss-120b-mlx-6Bit

Text Generation • 117B • Updated Oct 19, 2025 • 29

DeathGodlike/LunaMaid-12B_EXL3

Text Generation • Updated Oct 19, 2025 • 1

DeathGodlike/Abyssal-Seraph-12B_EXL3

Text Generation • Updated Oct 20, 2025 • 1

DeathGodlike/Velvet-Orchid-12B_EXL3

Text Generation • Updated Oct 20, 2025 • 1

nightmedia/GLM-4.5-Air-REAP-82B-A12B-qx64g-hi-mlx

Text Generation • 82B • Updated Oct 21, 2025 • 18 • 1

DeathGodlike/Vistral-24B-Instruct_EXL3

Text Generation • Updated Oct 21, 2025 • 4

lmstudio-community/Qwen3-VL-32B-Instruct-MLX-6bit

Image-Text-to-Text • Updated Oct 28, 2025 • 524

mlx-community/Qwen3-VL-2B-Instruct-6bit

Image-Text-to-Text • 0.8B • Updated Oct 21, 2025 • 49 • 1

mlx-community/Qwen3-VL-2B-Thinking-6bit

Image-Text-to-Text • 0.8B • Updated Oct 21, 2025 • 9

mlx-community/Qwen3-VL-32B-Instruct-6bit

Image-Text-to-Text • Updated Oct 21, 2025 • 24

DeathGodlike/VerbaMaxima-12B_EXL3

Text Generation • Updated Oct 21, 2025

mlx-community/Qwen3-VL-32B-Thinking-6bit

Image-Text-to-Text • Updated Oct 21, 2025 • 13

mlx-community/chandra-6bit

Image-Text-to-Text • Updated Oct 21, 2025 • 10

steampunque/Ring-mini-2.0-MP-GGUF

16B • Updated Feb 18 • 21

DeathGodlike/KansenSakura-Zero-RP-12b_EXL3

Text Generation • Updated Oct 21, 2025

DeathGodlike/Dark-Quill-12B_EXL3

Text Generation • Updated Oct 22, 2025

mlx-community/LFM2-VL-3B-6bit

Image-Text-to-Text • 1.0B • Updated Jan 15 • 14

DeathGodlike/Scarlet-Ink-12B_EXL3

Text Generation • Updated Oct 23, 2025 • 1

DeathGodlike/Foxfire-Bloom_EXL3

Text Generation • Updated Nov 8, 2025 • 1

steampunque/Ling-mini-2.0-MP-GGUF

16B • Updated Feb 18 • 11

DeathGodlike/Lunar-Abyss-12B_EXL3

Text Generation • Updated Oct 23, 2025 • 8

sjgdr/Llama3-Med42-70B-mlx-6Bit

Text Generation • 71B • Updated Oct 24, 2025 • 22 • 1

DeathGodlike/Luminous-Shadow-12B_EXL3

Text Generation • Updated Oct 24, 2025 • 3

nightmedia/Qwen3-Next-80B-A3B-Instruct-1M-qx64n-mlx

Text Generation • 80B • Updated Oct 25, 2025 • 36 • 2

nightmedia/Qwen3-Next-80B-A3B-Thinking-1M-qx64n-mlx

Text Generation • 80B • Updated Oct 25, 2025 • 31 • 2

DeathGodlike/KansenSakura-Symbiosis-12B_EXL3

Text Generation • Updated Oct 24, 2025

Wwayu/Impish_Nemo_12B-mlx-6Bit

12B • Updated Oct 25, 2025 • 5

mlx-community/olmOCR-2-7B-1025-6bit

Image-Text-to-Text • Updated Oct 25, 2025 • 33

DeathGodlike/Vikhr-Nemo-12B-Instruct-R-21-09-24_EXL3

Text Generation • Updated Oct 25, 2025 • 13