Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

4,522

Base only

Active filters: 6-bit

tensorbanana/vibevoice-7b-exl3-6bit

3B • Updated Sep 19, 2025 • 10

halley-ai/Qwen3-Next-80B-A3B-Instruct-MLX-6bit-gs64

Text Generation • 80B • Updated Sep 19, 2025 • 31 • 1

bobig/orpheus-finetuned-3b-mlx-6Bit

Text-to-Speech • 0.7B • Updated Sep 19, 2025 • 12

DeathGodlike/BMO-CaptianMaid-12B_EXL3

Text Generation • Updated Sep 19, 2025

DeathGodlike/GodSlayer-12B-ABYSS_EXL3

Text Generation • Updated Sep 19, 2025

DeathGodlike/Irix-mpf-stock_EXL3

Text Generation • Updated Sep 21, 2025 • 4

DeathGodlike/Ollpheist-12B_EXL3

Text Generation • Updated Sep 21, 2025 • 4

DeathGodlike/Lorablated-w2bb-psy-della_EXL3

Text Generation • Updated Sep 22, 2025

DeathGodlike/nemo-sunfall-v0.6.1_EXL3

Text Generation • Updated Sep 22, 2025 • 1

DeathGodlike/Radiant-Shadow-12B_EXL3

Text Generation • Updated Sep 23, 2025

wobondar/instinct-mlx-6Bit

Text Generation • 8B • Updated Sep 24, 2025 • 10

DeathGodlike/Forgotten-directive-Neon-stock_EXL3

Text Generation • Updated Sep 24, 2025 • 1

Wwayu/Skyfall-31B-v4-mlx-6Bit

31B • Updated Sep 24, 2025 • 21

nightmedia/Qwen3-MOE-6x6B-Star-Trek-Universe-Alpha-D-256k-ctx-36B-qx65-mlx

Text Generation • 27B • Updated Sep 25, 2025 • 150 • 1

Wwayu/Llama-3.3-70B-Vulpecula-r1-mlx-6Bit

Text Generation • 71B • Updated Sep 25, 2025 • 25

mlx-community/Huihui-gemma-3n-E4B-it-abliterated-lm-6bit

Text Generation • 7B • Updated Sep 26, 2025 • 72

mlx-community/Huihui-gemma-3-270m-it-abliterated-6bit

Text Generation • 58.7M • Updated Sep 27, 2025 • 20 • 1

bradeenl/cwm-q6-mlx

33B • Updated Sep 27, 2025 • 4

mlx-community/LongWriter-llama3.1-8b-6bit

Text Generation • 8B • Updated Sep 28, 2025 • 28 • 2

DeathGodlike/Crystal-Moon-12B_EXL3

Text Generation • Updated Sep 28, 2025

mlx-community/Falcon-H1-7B-Instruct-6bit

Text Generation • 8B • Updated Sep 29, 2025 • 15

steampunque/Qwen3-4B-Instruct-2507-MP-GGUF

4B • Updated Apr 22 • 14 • 1

steampunque/Qwen3-4B-Thinking-2507-MP-GGUF

4B • Updated Apr 22 • 31 • 2

lmstudio-community/granite-4.0-h-tiny-MLX-6bit

Text Generation • 7B • Updated Sep 29, 2025 • 185

lmstudio-community/granite-4.0-h-small-MLX-6bit

Text Generation • 32B • Updated Sep 29, 2025 • 220 • 1

lmstudio-community/KAT-Dev-MLX-6bit

Text Generation • 33B • Updated Sep 30, 2025 • 292

DeathGodlike/Shisa-K-sakurization_EXL3

Text Generation • Updated Sep 30, 2025

cs2764/GLM-4.6-mlx-6Bit

Text Generation • 353B • Updated Sep 30, 2025 • 10

zerofata/MS3.2-PaintedFantasy-Visage-v4-34b-exl3-6bpw

13B • Updated Oct 2, 2025 • 6

nightmedia/LFM2-350M-Math-dwq6-mlx

Text Generation • 88.7M • Updated Oct 1, 2025 • 8