Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,959

Full-text search

Active filters: 3-bit

MaziyarPanahi/NVIDIA-Nemotron-Nano-9B-v2-GGUF

Text Generation • 9B • Updated Nov 29, 2025 • 397 • 3

Wwayu/GLM-4.6-REAP-218B-A32B-Derestricted-mlx-3Bit

Text Generation • Updated Nov 30, 2025 • 36

MaziyarPanahi/Ministral-3-3B-Reasoning-2512-GGUF

Text Generation • 3B • Updated Dec 2, 2025 • 107k • 4

MaziyarPanahi/Ministral-3-8B-Reasoning-2512-GGUF

Text Generation • 8B • Updated Dec 2, 2025 • 97 • 1

MaziyarPanahi/Ministral-3-14B-Reasoning-2512-GGUF

Text Generation • 14B • Updated Dec 2, 2025 • 50.6k • 1

MaziyarPanahi/Trinity-Nano-Preview-GGUF

Text Generation • 6B • Updated Dec 2, 2025 • 36 • 1

MaziyarPanahi/Trinity-Mini-GGUF

Text Generation • 26B • Updated Dec 16, 2025 • 55.3k • 1

NexVeridian/Qwen3-Coder-REAP-25B-A3B-3bit

Text Generation • 25B • Updated Jan 25 • 206

NexVeridian/Kimi-Linear-REAP-35B-A3B-Instruct-3bit

Text Generation • 35B • Updated Dec 3, 2025 • 63

NexVeridian/GLM-4.5-Air-REAP-82B-A12B-3bit

Text Generation • 82B • Updated Dec 3, 2025 • 18

MaziyarPanahi/Nemotron-Orchestrator-8B-GGUF

Text Generation • 8B • Updated Dec 6, 2025 • 55.7k • 4

MaziyarPanahi/Hermes-4.3-36B-GGUF

Text Generation • 36B • Updated Dec 6, 2025 • 654 • 2

MaziyarPanahi/GLM-4.6V-Flash-GGUF

Text Generation • 9B • Updated Dec 8, 2025 • 58.1k • 3

shubhamg2208/tomoro-ai-colqwen3-embed-4b-auto-round-w3a16

1B • Updated Dec 9, 2025

Eldadalbajob/Huihui-Qwen3-Next-80B-A3B-Instruct-abliterated-mlx-3Bit

Text Generation • 80B • Updated Dec 9, 2025 • 77

alexgusevski/Ministral-3-3B-Instruct-2512-q3-mlx

Text Generation • 0.4B • Updated Dec 11, 2025 • 13

alexgusevski/Ministral-3-3B-Reasoning-2512-q3-mlx

Text Generation • 0.4B • Updated Dec 11, 2025 • 10

alexgusevski/Ministral-3-8B-Instruct-2512-q3-mlx

Text Generation • 1B • Updated Dec 11, 2025 • 10

alexgusevski/Ministral-3-8B-Reasoning-2512-q3-mlx

Text Generation • 1B • Updated Dec 11, 2025 • 6

alexgusevski/Lightning-1.7B-q3-mlx

Text Generation • 0.2B • Updated Dec 11, 2025 • 3

pj1983/WeirdCompound-v1.5-24b-mlx-3bit

Text Generation • 24B • Updated Dec 12, 2025 • 6

pj1983/Cydonia-Redux-22B-v1.1-mlx-3bit

Text Generation • 22B • Updated Dec 14, 2025 • 10

garrison/Magidonia-24B-v4.3-mlx-3Bit

24B • Updated Dec 17, 2025 • 7

br2835/mistraladaptmerged-mlx-3bit

Text Generation • 24B • Updated Dec 18, 2025 • 7

garrison/Cydonia-24B-v4.3-mlx-3Bit

24B • Updated Dec 18, 2025 • 11

mrtoots/unsloth-GLM-4.7-mlx-3Bit

Text Generation • 353B • Updated Dec 23, 2025 • 291

mlx-community/MiniMax-M2.1-3bit

Text Generation • 229B • Updated 12 days ago • 48.7k • 5

DiscoStew/GLM-4.6V-3Bit

Image-Text-to-Text • Updated Dec 28, 2025 • 26

catalystsec/MiniMax-M2.1-3bit-DWQ

Text Generation • 229B • Updated Dec 27, 2025 • 281 • 1

fifrio/Llama-3.1-8B-Instruct-gptq-3bit-calibration-English-128samples

8B • Updated Dec 30, 2025