Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

4,522

Base only

Active filters: 6-bit

zerofata/MS3.2-PaintedFantasy-Visage-v3-34B-exl3-6bpw

13B • Updated Aug 30, 2025 • 4 • 2

DeathGodlike/UltraPatriMerge-12B_EXL3

Text Generation • Updated Aug 25, 2025 • 1

lmstudio-community/Hermes-4-70B-MLX-6bit

71B • Updated Aug 26, 2025 • 63.9k • 1

lmstudio-community/Hermes-4-405B-MLX-6bit

Text Generation • 406B • Updated Aug 26, 2025 • 326

lmstudio-community/Seed-OSS-36B-Instruct-MLX-6bit

Text Generation • 36B • Updated Aug 26, 2025 • 37.9k

mlx-community/Hermes-4-70B-6bit

Text Generation • 71B • Updated Aug 26, 2025 • 43

DeathGodlike/DellaMix-12B_EXL3

Text Generation • Updated Aug 26, 2025

MaziyarPanahi/Qwen3-4B-Instruct-2507-GGUF

Text Generation • 4B • Updated Aug 27, 2025 • 209k • 3

MaziyarPanahi/Qwen3-30B-A3B-Instruct-2507-GGUF

Text Generation • 31B • Updated Nov 20, 2025 • 112k • 4

DeathGodlike/Ultracore-Instruct-12BV2_EXL3

Text Generation • Updated Aug 28, 2025

DeathGodlike/Nemo-12b-Toveri-v0.1_EXL3

Text Generation • Updated Aug 28, 2025

nightmedia/unsloth-GLM-4.5-Air-qx64-mlx

Text Generation • 107B • Updated Sep 8, 2025 • 25 • 1

DeathGodlike/Lumimaid-v0.2-12B_EXL3

Text Generation • Updated Sep 1, 2025

jc2375/MediPhi-Clinical-mlx-6Bit

Text Generation • 0.8B • Updated Sep 1, 2025 • 11

mrtoots/CaptainErisNebula-12B-Chimera-v1.1-mlx-6Bit

12B • Updated Sep 1, 2025 • 7

jc2375/open-bio-med-merge-mlx-6Bit

Text Generation • 8B • Updated Sep 2, 2025 • 30

DeathGodlike/Lunar-Nexus-12B_EXL3

Text Generation • Updated Sep 2, 2025 • 1

mlx-community/Apertus-8B-Instruct-2509-6bit

Text Generation • 8B • Updated Sep 3, 2025 • 57 • 1

DeathGodlike/Moonviolet-12B_EXL3

Text Generation • Updated Sep 3, 2025

mlx-community/Hermes-4-14B-6bit

Text Generation • 15B • Updated Sep 3, 2025 • 184

DeathGodlike/PatriMaidV2-12B_EXL3

Text Generation • Updated Sep 4, 2025

NickMystic/WEBGEN-4B-Preview-mlx-6Bit

Text Generation • 0.9B • Updated Sep 4, 2025 • 22 • 1

mrtoots/Wayfarer-2-12B-mlx-6Bit

Text Generation • 12B • Updated Sep 4, 2025 • 10

mlx-community/lille-130m-instruct-6bit

Text Generation • 27.8M • Updated Sep 5, 2025 • 21

DeathGodlike/Lumimaid-Magnum-v4-12B_EXL3

Text Generation • Updated Sep 5, 2025 • 4

DeathGodlike/Safeword-Casual-V1-12B_EXL3

Text Generation • Updated Sep 5, 2025 • 4

DeathGodlike/Moonbright-12B_EXL3

Text Generation • Updated Sep 6, 2025

DeathGodlike/MN-Mystic-Rune-12B_EXL3

Text Generation • Updated Sep 7, 2025

pierstab71/gpt-oss-120b-mlx-6Bit

Text Generation • 117B • Updated Sep 7, 2025 • 124 • 1

pierstab71/gpt-oss-20b-mlx-6Bit

Text Generation • 21B • Updated Sep 7, 2025 • 15