Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,474

Base only

Active filters: 3-bit

nanzhang/QuantLRM-Olmo-3-7B-Think-DPO-3-bit

Text Generation • 7B • Updated Feb 11 • 16

nanzhang/QuantLRM-Olmo-3-7B-Think-3-bit

Text Generation • 7B • Updated Feb 11 • 9

FlimsyFox/Mistral-Nemo-Inst-2407-12B-Thinking-Uncensored-HERETIC-HI-Claude-Opus-mlx-3Bit-rk3588-1.1.2

Text Generation • Updated Feb 9 • 86

MaziyarPanahi/Schematron-3B-GGUF

Text Generation • 3B • Updated Feb 10 • 172

MaziyarPanahi/VulnLLM-R-7B-GGUF

Text Generation • 8B • Updated Feb 10 • 257 • 2

MaziyarPanahi/EXAONE-4.0-1.2B-GGUF

Text Generation • 1B • Updated Feb 10 • 129

MaziyarPanahi/Qwen3-Coder-Next-GGUF

Text Generation • 80B • Updated Feb 10 • 88.9k • 1

petergilani/Qwen3-Coder-Next-3bit-g128

Text Generation • 80B • Updated Feb 11 • 15 • 1

namgyu-youn/EXAONE-4.0-1.2B-GPTQ-W3A16

1B • Updated Feb 11 • 5

namgyu-youn/EXAONE-4.0-1.2B-GPTQ-W3A16-EoRA

1B • Updated Feb 12 • 7

badmadrad/Devstral-Small-2-24B-Instruct-2512-MLX-3bit

Text Generation • 24B • Updated Feb 13 • 98

mlx-community/MiniMax-M2.5-3bit

Text Generation • 229B • Updated Feb 13 • 299 • 11

TomLucidor/Qwen3-Coder-Next-REAM-mlx-3Bit

Text Generation • 60B • Updated Feb 13 • 277 • 2

thedarkstar/Magidonia-24B-v4.3-mlx-3Bit

Text Generation • 24B • Updated Feb 21 • 9

NexVeridian/Qwen3.5-35B-A3B-3bit

Text Generation • 35B • Updated Feb 24 • 37 • 2

MaziyarPanahi/LFM2-24B-A2B-GGUF

Text Generation • 24B • Updated Feb 24 • 106 • 2

NexVeridian/Qwen3.5-27B-3bit

Text Generation • 27B • Updated Feb 25 • 45 • 1

dangerusslee/FastApply-1.5B-v1.0-mlx-3Bit

Text Generation • 0.2B • Updated Mar 1 • 13

dangerusslee/FastApply-7B-v1.0-mlx-3Bit

Text Generation • 1.0B • Updated Mar 2 • 14

fifrio/Qwen3-8B-gptq-3bit-calibration-English-128samples

8B • Updated Mar 2 • 7

fifrio/Qwen3-8B-gptq-3bit-calibration-Indonesian-128samples

8B • Updated Mar 2 • 4

fifrio/Qwen3-8B-gptq-3bit-calibration-Tamil-128samples

8B • Updated Mar 2 • 7

fifrio/Qwen3-8B-gptq-3bit-calibration-Swahili-128samples

8B • Updated Mar 2 • 7

fifrio/Qwen3-8B-gptq-3bit-calibration-Chinese-128samples

8B • Updated Mar 2 • 4

mlx-community/Qwen3.5-0.8B-3bit

0.2B • Updated Mar 2 • 25

mlx-community/Qwen3.5-2B-3bit

0.6B • Updated Mar 2 • 17

mlx-community/Qwen3.5-4B-3bit

0.9B • Updated Mar 2 • 118

andrevp/Qwen3.5-35B-A3B-MLX-VLM-3bit

Image-Text-to-Text • 5B • Updated Mar 3 • 139 • 3

MaziyarPanahi/LocoOperator-4B-GGUF

Text Generation • 4B • Updated Mar 3 • 134 • 1

fifrio/aya-expanse-8b-gptq-3bit-calibration-English-128samples

8B • Updated Mar 5 • 6