Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,491

Base only

Active filters: 3-bit

MaziyarPanahi/c4ai-command-a-03-2025-GGUF

Text Generation • 111B • Updated Mar 15, 2025 • 259 • 1

Hjgugugjhuhjggg/Jaja-small-mlx-3Bit

Text Generation • 12.6M • Updated Mar 15, 2025 • 10

MaziyarPanahi/OLMo-2-0325-32B-Instruct-GGUF

Text Generation • 32B • Updated Mar 15, 2025 • 121 • 1

Lowkey-Loki/DeepHermes-3-Mistral-24B-Preview-mlx-3bit

3B • Updated Mar 17, 2025 • 9

alexgusevski/gemma-3-text-1b-it-q3-mlx

Text Generation • 0.2B • Updated Mar 17, 2025 • 12

KYUNGYONG/EXAONE-Deep-32B-mlx-3Bit

Text Generation • 4B • Updated Mar 18, 2025 • 15

Lowkey-Loki/Mistral-Small-3.1-24B-Instruct-TextOnly-mlx-3bit

Text Generation • 3B • Updated Mar 18, 2025 • 19

MaziyarPanahi/mistral-small-3.1-24b-instruct-2503-hf-GGUF

Text Generation • 24B • Updated Mar 18, 2025 • 164k • 2

alexgusevski/gemma-3-text-4b-it-q3-mlx

Text Generation • 0.6B • Updated Mar 18, 2025 • 11

alexgusevski/EXAONE-Deep-2.4B-q3-mlx

Text Generation • 0.3B • Updated Mar 18, 2025 • 12

alexgusevski/EXAONE-Deep-7.8B-mlx-3Bit

Text Generation • 1.0B • Updated Mar 18, 2025 • 9

alexgusevski/EXAONE-Deep-32B-mlx-3Bit

Text Generation • 4B • Updated Mar 18, 2025 • 14

mlx-community/Mistral-Small-3.1-Text-24B-Instruct-2503-3bit

3B • Updated Mar 18, 2025 • 14

mlx-community/EXAONE-Deep-2.4B-3bit

Text Generation • 0.3B • Updated Mar 18, 2025 • 16

mlx-community/EXAONE-Deep-32B-3bit

Text Generation • 4B • Updated Mar 18, 2025 • 13

mlx-community/EXAONE-Deep-7.8B-3bit

Text Generation • 1.0B • Updated Mar 18, 2025 • 10

hfl/Qwen2.5-VL-7B-Instruct-GPTQ-Int3

Image-Text-to-Text • 8B • Updated Mar 20, 2025 • 17 • 1

hfl/Qwen2.5-VL-3B-Instruct-GPTQ-Int3

Image-Text-to-Text • 4B • Updated Mar 20, 2025 • 24 • 1

MaziyarPanahi/amoral-gemma3-4B-GGUF

Text Generation • 4B • Updated Mar 20, 2025 • 68

MaziyarPanahi/ByteCraft-GGUF

Text Generation • 8B • Updated Mar 20, 2025 • 69 • 1

MaziyarPanahi/DeepHermes-3-Llama-3-3B-Preview-abliterated-GGUF

Text Generation • 3B • Updated Mar 20, 2025 • 79 • 1

hildaray/gemma-3-12b-it-mlx-3Bit

Image-Text-to-Text • 2B • Updated Mar 21, 2025 • 18 • 1

KYUNGYONG/gemma-3-27b-it-abliterated-mlx-3Bit

Image-Text-to-Text • 4B • Updated Mar 21, 2025 • 33

MaziyarPanahi/Ice0.101-20.03-RP-GGUF

Text Generation • 7B • Updated Mar 21, 2025 • 42

MaziyarPanahi/Qwen2.5-1.5B-YOYO-GGUF

Text Generation • 2B • Updated Mar 21, 2025 • 26

MaziyarPanahi/Qwen2.5-3B-YOYO-GGUF

Text Generation • 3B • Updated Mar 21, 2025 • 30

MaziyarPanahi/Qwen2.5-7B-YOYO-GGUF

Text Generation • 8B • Updated Mar 21, 2025 • 87

MaziyarPanahi/gemma-3-1b-it-abliterated-GGUF

Text Generation • 1.0B • Updated Mar 21, 2025 • 99 • 1

MaziyarPanahi/Qwen2.5-14B-YOYO-GGUF

Text Generation • 15B • Updated Mar 21, 2025 • 12

MaziyarPanahi/Qwen2.5-Coder-14B-YOYO-GGUF

Text Generation • 15B • Updated Mar 21, 2025 • 44