Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,483

Base only

Active filters: 3-bit

garrison/GLM-4.5-Air-REAP-82B-A12B-mlx-3Bit

Text Generation • 82B • Updated Nov 18, 2025 • 16

MaziyarPanahi/Qwen3-4B-Thinking-2507-GGUF

Text Generation • 4B • Updated Nov 20, 2025 • 74.4k • 2

MaziyarPanahi/Qwen3-30B-A3B-Thinking-2507-GGUF

Text Generation • 31B • Updated Nov 20, 2025 • 43

garrison/Olmo-3-32B-Think-mlx-3Bit

32B • Updated Nov 21, 2025 • 9

garrison/Snowpiercer-15B-v4-mlx-3Bit

15B • Updated Nov 23, 2025 • 14

mlx-community/Kimi-K2-Thinking-3bit

Text Generation • 1T • Updated Nov 25, 2025 • 167 • 1

garrison/GLM-4.5-Air-Derestricted-mlx-3Bit

Text Generation • 107B • Updated Nov 25, 2025 • 26 • 1

ncls-p/INTELLECT-3-mlx-3Bit

Text Generation • 107B • Updated Nov 27, 2025 • 21 • 1

MaziyarPanahi/NVIDIA-Nemotron-Nano-12B-v2-GGUF

Text Generation • 12B • Updated Nov 28, 2025 • 73.8k • 4

MaziyarPanahi/Olmo-3-32B-Think-GGUF

Text Generation • 32B • Updated Nov 28, 2025 • 58

MaziyarPanahi/Olmo-3-7B-Think-GGUF

Text Generation • 7B • Updated Nov 28, 2025 • 31

MaziyarPanahi/Olmo-3-7B-Instruct-GGUF

Text Generation • 7B • Updated Nov 28, 2025 • 62

MaziyarPanahi/gpt-oss-20b-Derestricted-GGUF

Text Generation • 21B • Updated Nov 28, 2025 • 89.8k • 3

MaziyarPanahi/NVIDIA-Nemotron-Nano-9B-v2-GGUF

Text Generation • 9B • Updated Nov 29, 2025 • 198 • 3

Wwayu/GLM-4.6-REAP-218B-A32B-Derestricted-mlx-3Bit

Text Generation • 218B • Updated Nov 30, 2025 • 27

MaziyarPanahi/Ministral-3-3B-Reasoning-2512-GGUF

Text Generation • 3B • Updated Dec 2, 2025 • 162k • 4

MaziyarPanahi/Ministral-3-8B-Reasoning-2512-GGUF

Text Generation • 8B • Updated Dec 2, 2025 • 60 • 2

MaziyarPanahi/Ministral-3-14B-Reasoning-2512-GGUF

Text Generation • 14B • Updated Dec 2, 2025 • 73.1k • 1

MaziyarPanahi/Trinity-Nano-Preview-GGUF

Text Generation • 6B • Updated Dec 2, 2025 • 37 • 1

MaziyarPanahi/Trinity-Mini-GGUF

Text Generation • 26B • Updated Dec 16, 2025 • 90k • 1

NexVeridian/Qwen3-Coder-REAP-25B-A3B-3bit

Text Generation • 25B • Updated Jan 25 • 39

MaziyarPanahi/Nemotron-Orchestrator-8B-GGUF

Text Generation • 8B • Updated Dec 6, 2025 • 87.9k • 6

MaziyarPanahi/Hermes-4.3-36B-GGUF

Text Generation • 36B • Updated Dec 6, 2025 • 341 • 3

MaziyarPanahi/GLM-4.6V-Flash-GGUF

Text Generation • 9B • Updated Dec 8, 2025 • 89.6k • 6

shubhamg2208/tomoro-ai-colqwen3-embed-4b-auto-round-w3a16

1B • Updated Dec 9, 2025 • 5

alexgusevski/Ministral-3-3B-Instruct-2512-q3-mlx

Text Generation • 0.4B • Updated Dec 11, 2025 • 28

alexgusevski/Ministral-3-3B-Reasoning-2512-q3-mlx

Text Generation • 0.4B • Updated Dec 11, 2025 • 12

alexgusevski/Ministral-3-8B-Instruct-2512-q3-mlx

Text Generation • 1B • Updated Dec 11, 2025 • 12

alexgusevski/Ministral-3-8B-Reasoning-2512-q3-mlx

Text Generation • 1B • Updated Dec 11, 2025 • 19

alexgusevski/Lightning-1.7B-q3-mlx

Text Generation • 0.2B • Updated Dec 11, 2025 • 6