Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

4,534

Base only

Active filters: 6-bit

CycloneDX/cdx1-nano-mlx-6bit

Text Generation • 0.4B • Updated Aug 11, 2025 • 7

mlx-community/GLM-4.5V-6bit

Updated Aug 11, 2025 • 19

mlx-community/Jan-v1-4B-6bit

Text Generation • 0.9B • Updated Aug 12, 2025 • 13

DeathGodlike/Kitsune-Symphony-V0.0-12B_EXL3

Text Generation • Updated Aug 13, 2025 • 2 • 1

DeathGodlike/DarkCamelot-12B_EXL3

Text Generation • Updated Aug 13, 2025 • 2

DeathGodlike/PatriSlush-DarkRPMax-12B_EXL3

Text Generation • Updated Aug 13, 2025

isogen/Jan-v1-4B-exl3-6bpw

2B • Updated Aug 13, 2025 • 6

cs2764/Qwen2.5-QwQ-37B-Eureka-Triple-Cubed-abliterated-uncensored-mlx-6Bit-gs32

Text Generation • 37B • Updated Aug 14, 2025 • 14

DeathGodlike/KansenSakura-Eclipse-RP-12B_EXL3

Text Generation • Updated Aug 14, 2025

nightmedia/Ling-lite-1.5-2507-q6-hi-mlx

Text Generation • 17B • Updated Aug 14, 2025 • 21 • 1

wobondar/gpt-oss-20b-mlx-6Bit

Text Generation • 21B • Updated Aug 16, 2025 • 13

SicariusSicariiStuff/Impish_Longtail_12B_EXL3_6.0bpw

Text Generation • 5B • Updated Aug 16, 2025 • 7

mlx-community/LFM2-VL-1.6B-6bit

Image-Text-to-Text • 0.7B • Updated Aug 16, 2025 • 23 • 1

mlx-community/Kimi-VL-A3B-Thinking-2506-6bit

Image-Text-to-Text • Updated Jan 27 • 369 • 2

DeathGodlike/MN-Chinofun-12B-4.1_EXL3

Text Generation • Updated Aug 16, 2025

halley-ai/gpt-oss-20b-MLX-6bit-gs32

Text Generation • 21B • Updated Aug 18, 2025 • 37 • 1

DeathGodlike/Nemo-12b-Humanize-SFT-v0.2.5-KTO_EXL3

Text Generation • Updated Aug 17, 2025 • 2

DeathGodlike/Rei-24B-KTO_EXL3

Text Generation • Updated Aug 19, 2025 • 3 • 1

graelo/Magistral-Small-2507-6bits

Text Generation • 24B • Updated Aug 20, 2025 • 9

graelo/Devstral-Small-2507-6bits

Text Generation • 24B • Updated Aug 20, 2025 • 21

DeathGodlike/Impish-Irix-Kitsune_EXL3

Text Generation • Updated Aug 22, 2025 • 1

DeathGodlike/MoonMega-12B_EXL3

Text Generation • Updated Aug 22, 2025 • 2

DeathGodlike/Moonlit-Shadow-12B_EXL3

Text Generation • Updated Aug 23, 2025 • 1

hehua2008/GLM-4.5V-abliterated-MLX-6bit

Updated Aug 24, 2025 • 9

mlx-community/GLM-4.5V-abliterated-6bit

Updated Aug 24, 2025 • 6

warshanks/gpt-oss-120b-6bit

Text Generation • 117B • Updated Aug 24, 2025 • 23

DeathGodlike/Shadow-Crystal-12B_EXL3

Text Generation • Updated Aug 25, 2025 • 1

zerofata/MS3.2-PaintedFantasy-Visage-v3-34B-exl3-6bpw

13B • Updated Aug 30, 2025 • 4 • 2

DeathGodlike/UltraPatriMerge-12B_EXL3

Text Generation • Updated Aug 25, 2025 • 1

lmstudio-community/Hermes-4-70B-MLX-6bit

71B • Updated Aug 26, 2025 • 63.9k • 1