Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

4,537

Base only

Active filters: 6-bit

MaziyarPanahi/MT-Merge9-gemma-2-9B-GGUF

Text Generation • 9B • Updated Mar 24, 2025 • 53 • 1

narpas/Legion-V2.1-LLaMa-70B-6.0bpw-h8-exl2

Text Generation • Updated Mar 27, 2025 • 10

ipetrukha/Llama-3.2-1B-Instruct-6bit

Text Generation • 0.3B • Updated Mar 27, 2025 • 9

Mawdistical/Feline-Clairvoyance-72B_EXL2_6.0bpw_H8

Updated Mar 29, 2025 • 8

mrtoots/Wayfarer_Eris_Noctis-12B-mlx-6Bit

Text Generation • 3B • Updated Aug 28, 2025 • 11

Mawdistical/Wanton-Wolf-70B_EXL2_6.0bpw_H8

Updated Mar 30, 2025 • 8

litmudoc/Qwen2.5-14B-1M-YOYO-V5-MLX-Q6

Text Generation • 3B • Updated Mar 30, 2025 • 9

dong-99/DeepSeek-V2.5-1210-mlx-6Bit

Text Generation • 52B • Updated Mar 30, 2025 • 24

litmudoc/QwQ-coder-32B-MLX-Q6

Text Generation • 7B • Updated Mar 31, 2025 • 12

rdsm/openhands-lm-32b-v0.1-mlx-6bit

Text Generation • 7B • Updated Mar 31, 2025 • 64 • 1

alexgusevski/openhands-lm-32b-v0.1-mlx-6Bit

Text Generation • 7B • Updated Mar 31, 2025 • 7

narpas/UNNAMED-MODEL-B-6.0bpw-h8-exl2

Text Generation • Updated Apr 2, 2025 • 8

narpas/UNNAMED-MODEL-D-6.0bpw-h8-exl2

Text Generation • Updated Apr 2, 2025 • 10

mlx-community/orpheus-3b-0.1-pretrained-6bit

Text Generation • 0.7B • Updated Apr 2, 2025 • 18

narpas/Electranova-70B-v1.0-6.0bpw-h8-exl2

Text Generation • Updated Apr 2, 2025 • 14 • 1

narpas/UNNAMED-MODEL-2A-6.0bpw-h8-exl2

Text Generation • Updated Apr 4, 2025 • 14

Novaciano/SEX_ROLEPLAY-3.2-1B-mlx-6Bit

Text Generation • 0.3B • Updated Apr 5, 2025 • 153

Beridar/ReadyArt-Gaslit-Abomination-24B-v1.0-mlx-6bit

Text Generation • 5B • Updated Apr 5, 2025 • 14

mlx-community/meta-llama-Llama-4-Scout-17B-16E-6bit

Text Generation • 24B • Updated Apr 6, 2025 • 71

Beridar/ReadyArt-Gaslit-Transgression-24B-v1.0-mlx-6bit

Text Generation • 5B • Updated Apr 6, 2025 • 8

alexgusevski/OpenThinker2-32B-mlx-6Bit

Text Generation • 7B • Updated Apr 6, 2025 • 9

Beridar/ReadyArt-Forgotten-Abomination-36B-v4.1-mlx-6bit

Text Generation • 8B • Updated Apr 6, 2025 • 27

mlx-community/Llama-4-Maverick-17B-16E-Instruct-6bit

Text Generation • 88B • Updated Apr 6, 2025 • 133 • 2

Shaund91/dolphin-2.5-mixtral-8x7b-mlx-6Bit

10B • Updated Apr 6, 2025 • 22 • 1

Mawdistical/Draconic-Tease-70B_EXL2_6.0bpw_H8

Updated Apr 7, 2025 • 9

Shaund91/Mixtral_13B_Chat-mlx-6Bit

3B • Updated Apr 7, 2025 • 11

narpas/QwQ-32B-ArliAI-RpR-v1-6.0bpw-h8-exl2

Updated Apr 7, 2025 • 7 • 1

mlx-community/QwQ-0.5B-6bit

Text Generation • 0.1B • Updated Apr 7, 2025 • 38

YuHaaa/QwQ-R1984-32B-mlx-6Bit

Text Generation • 7B • Updated Apr 19, 2025 • 11

Dracones/QwQ-32B-ArliAI-RpR-v1_exl2_6.0bpw

Updated Apr 8, 2025 • 9