Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,972

Full-text search

Active filters: 3-bit

NexVeridian/GLM-4.5-Air-REAP-82B-A12B-3bit

Text Generation • 82B • Updated Dec 3, 2025 • 22

NexVeridian/Hermes-4.3-36B-3bit

Text Generation • 36B • Updated Dec 3, 2025 • 6

MaziyarPanahi/Nemotron-Orchestrator-8B-GGUF

Text Generation • 8B • Updated Dec 6, 2025 • 62.7k • 4

MaziyarPanahi/Hermes-4.3-36B-GGUF

Text Generation • 36B • Updated Dec 6, 2025 • 13.7k • 2

shubhamg2208/tomoro-ai-colqwen3-embed-4b-auto-round-w3a16

1B • Updated Dec 9, 2025

Eldadalbajob/Huihui-Qwen3-Next-80B-A3B-Instruct-abliterated-mlx-3Bit

Text Generation • 80B • Updated Dec 9, 2025 • 68

alexgusevski/Ministral-3-3B-Instruct-2512-q3-mlx

Text Generation • 0.4B • Updated Dec 11, 2025 • 11

alexgusevski/Ministral-3-3B-Reasoning-2512-q3-mlx

Text Generation • 0.4B • Updated Dec 11, 2025 • 8

alexgusevski/Ministral-3-8B-Instruct-2512-q3-mlx

Text Generation • 1B • Updated Dec 11, 2025 • 8

alexgusevski/Ministral-3-8B-Reasoning-2512-q3-mlx

Text Generation • 1B • Updated Dec 11, 2025 • 7

alexgusevski/Lightning-1.7B-q3-mlx

Text Generation • 0.2B • Updated Dec 11, 2025 • 3

pj1983/WeirdCompound-v1.5-24b-mlx-3bit

Text Generation • 24B • Updated Dec 12, 2025 • 6

pj1983/Cydonia-Redux-22B-v1.1-mlx-3bit

Text Generation • 22B • Updated Dec 14, 2025 • 9

garrison/Magidonia-24B-v4.3-mlx-3Bit

24B • Updated Dec 17, 2025 • 6

br2835/mistraladaptmerged-mlx-3bit

Text Generation • 24B • Updated Dec 18, 2025 • 6

garrison/Cydonia-24B-v4.3-mlx-3Bit

24B • Updated Dec 18, 2025 • 9

mrtoots/unsloth-GLM-4.7-mlx-3Bit

Text Generation • 353B • Updated Dec 23, 2025 • 297

mlx-community/MiniMax-M2.1-3bit

Text Generation • 229B • Updated 5 days ago • 39.7k • 5

DiscoStew/GLM-4.6V-3Bit

Image-Text-to-Text • Updated Dec 28, 2025 • 25

catalystsec/MiniMax-M2.1-3bit-DWQ

Text Generation • 229B • Updated Dec 27, 2025 • 348 • 1

fifrio/Llama-3.1-8B-Instruct-gptq-3bit-calibration-English-128samples

8B • Updated Dec 30, 2025 • 9

fifrio/Llama-3.1-8B-Instruct-gptq-3bit-calibration-Indonesian-128samples

8B • Updated Dec 30, 2025 • 10

fifrio/Llama-3.1-8B-Instruct-gptq-3bit-calibration-Tamil-128samples

8B • Updated Dec 30, 2025 • 9

fifrio/Llama-3.1-8B-Instruct-gptq-3bit-calibration-Swahili-128samples

8B • Updated Dec 30, 2025 • 9

fifrio/Llama-3.1-8B-Instruct-gptq-3bit-calibration-Chinese-128samples

8B • Updated Dec 30, 2025 • 9

fifrio/aya-expanse-8b-gptq-3bit-calibration-English-128samples

8B • Updated Dec 30, 2025 • 3

fifrio/aya-expanse-8b-gptq-3bit-calibration-Indonesian-128samples

8B • Updated Dec 30, 2025 • 6

fifrio/aya-expanse-8b-gptq-3bit-calibration-Tamil-128samples

8B • Updated Dec 30, 2025 • 4

fifrio/aya-expanse-8b-gptq-3bit-calibration-Swahili-128samples

8B • Updated Dec 30, 2025 • 5

fifrio/aya-expanse-8b-gptq-3bit-calibration-Chinese-128samples

8B • Updated Dec 30, 2025 • 7