Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

4,517

Base only

Active filters: 6-bit

DeathGodlike/Vikhr-Llama3.1-8B-Instruct-R-21-09-24_EXL3

Text Generation • Updated Oct 25, 2025 • 2

DeathGodlike/Violet-Mist-12B_EXL3

Text Generation • Updated Oct 26, 2025

alkalash/Eurydice-24b-v2-6.0bpw-h8-exl2

Text Generation • Updated Apr 16, 2025 • 5

hobaratio/Josiefied-Qwen3-8B-abliterated-v1-mlx-6Bit

Text Generation • 8B • Updated Oct 26, 2025 • 9

richardyoung/Kimi-K2-Instruct-0905-MLX-6bit

Text Generation • 1T • Updated Nov 26, 2025 • 86

mlx-community/DeepSeek-OCR-6bit

Image-Text-to-Text • 1B • Updated Jan 28 • 48 • 2

DeathGodlike/Crimson-Twilight-12B_EXL3

Text Generation • Updated Oct 27, 2025 • 2

mlx-community/MiniMax-M2-6bit

Text Generation • 229B • Updated Oct 28, 2025 • 17 • 2

DeathGodlike/Impish-LongPen-12B_EXL3

Text Generation • Updated Oct 28, 2025 • 1

mlx-community/granite-4.0-h-1b-6bit

Text Generation • 0.3B • Updated Oct 28, 2025 • 372

mlx-community/granite-4.0-h-1b-base-6bit

Text Generation • 0.3B • Updated Oct 28, 2025 • 9

mlx-community/Josiefied-Hermes-3-Llama-3.2-3B-v1-6bit

Text Generation • 0.7B • Updated Oct 28, 2025 • 20

mlx-community/granite-4.0-1b-base-6bit

Text Generation • 0.4B • Updated Oct 28, 2025 • 8

mlx-community/granite-4.0-1b-6bit

Text Generation • 0.4B • Updated Oct 28, 2025 • 5

mlx-community/granite-4.0-h-350m-6bit

Text Generation • 74.7M • Updated Oct 28, 2025 • 9

mlx-community/granite-4.0-h-350m-base-6bit

Text Generation • 74.7M • Updated Oct 28, 2025 • 12

mlx-community/granite-4.0-350m-6bit

Text Generation • 77.1M • Updated Oct 28, 2025 • 5

mlx-community/granite-4.0-350m-base-6bit

Text Generation • 77.1M • Updated Oct 28, 2025 • 10

DeathGodlike/Harmony-Bird-12B_EXL3

Text Generation • Updated Oct 28, 2025 • 3

DeathGodlike/Violet-Eclipse-12B_EXL3

Text Generation • Updated Oct 29, 2025 • 1

mlx-community/Josiefied-Qwen3-4B-Instruct-2507-abliterated-v1-6bit

Text Generation • 0.9B • Updated Oct 29, 2025 • 33

DeathGodlike/Harmonic-Lumina-12B_EXL3

Text Generation • Updated Oct 29, 2025

DeathGodlike/Darkstar-12B_EXL3

Text Generation • Updated Oct 29, 2025 • 1

lmstudio-community/MiniMax-M2-MLX-6bit

Text Generation • 229B • Updated Nov 6, 2025 • 5.82k

m-i/WebShaper-32B-mlx-6Bit

33B • Updated Oct 29, 2025 • 8

m-i/WebDancer-32B-mlx-6Bit

Text Generation • 33B • Updated Oct 29, 2025 • 13

k8smee/Yi-34B-mlx-6Bit

Text Generation • 34B • Updated Oct 30, 2025 • 10

k8smee/NexusRaven-V2-13B-mlx-6Bit

13B • Updated Mar 20 • 7

DeathGodlike/Vermilion-Sage-12B_EXL3

Text Generation • Updated Oct 30, 2025 • 1

saviochow/Zirel-3-mlx-6Bit

Text Generation • 82B • Updated Oct 30, 2025 • 8 • 1