Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,957

Full-text search

Active filters: 3-bit

alexgusevski/OlympicCoder-7B-mlx-3Bit

Text Generation • 1.0B • Updated Mar 12, 2025 • 1

alexgusevski/OlympicCoder-32B-mlx-3Bit

Text Generation • 4B • Updated Mar 12, 2025

MaziyarPanahi/gemma-3-1b-it-GGUF

Text Generation • 1.0B • Updated Mar 12, 2025 • 110k • 11

MaziyarPanahi/gemma-3-4b-it-GGUF

Text Generation • 4B • Updated Mar 12, 2025 • 123k • 17

MaziyarPanahi/gemma-3-27b-it-GGUF

Text Generation • 27B • Updated Mar 16, 2025 • 107k • 8

mlx-community/c4ai-command-a-03-2025-3bit

Text Generation • Updated Mar 18, 2025 • 33 • 1

MaziyarPanahi/c4ai-command-a-03-2025-GGUF

Text Generation • 111B • Updated Mar 15, 2025 • 73 • 1

Hjgugugjhuhjggg/Jaja-small-mlx-3Bit

Text Generation • Updated Mar 15, 2025 • 1

MaziyarPanahi/OLMo-2-0325-32B-Instruct-GGUF

Text Generation • 32B • Updated Mar 15, 2025 • 7 • 1

Lowkey-Loki/DeepHermes-3-Mistral-24B-Preview-mlx-3bit

3B • Updated Mar 17, 2025 • 11

alexgusevski/gemma-3-text-1b-it-q3-mlx

Text Generation • 0.2B • Updated Mar 17, 2025 • 3

KYUNGYONG/EXAONE-Deep-32B-mlx-3Bit

Text Generation • 4B • Updated Mar 18, 2025 • 2

Lowkey-Loki/Mistral-Small-3.1-24B-Instruct-TextOnly-mlx-3bit

Text Generation • 3B • Updated Mar 18, 2025 • 22

MaziyarPanahi/mistral-small-3.1-24b-instruct-2503-hf-GGUF

Text Generation • 24B • Updated Mar 18, 2025 • 108k • 2

alexgusevski/gemma-3-text-4b-it-q3-mlx

Text Generation • 0.6B • Updated Mar 18, 2025 • 4

alexgusevski/EXAONE-Deep-2.4B-q3-mlx

Text Generation • 0.3B • Updated Mar 18, 2025 • 3

alexgusevski/EXAONE-Deep-7.8B-mlx-3Bit

Text Generation • 1.0B • Updated Mar 18, 2025 • 3

alexgusevski/EXAONE-Deep-32B-mlx-3Bit

Text Generation • 4B • Updated Mar 18, 2025 • 3

mlx-community/Mistral-Small-3.1-Text-24B-Instruct-2503-3bit

Updated Mar 18, 2025 • 1

mlx-community/EXAONE-Deep-2.4B-3bit

Text Generation • 0.3B • Updated Mar 18, 2025 • 5

mlx-community/EXAONE-Deep-32B-3bit

Text Generation • 4B • Updated Mar 18, 2025 • 2

mlx-community/EXAONE-Deep-7.8B-3bit

Text Generation • 1.0B • Updated Mar 18, 2025 • 3

hfl/Qwen2.5-VL-7B-Instruct-GPTQ-Int3

Image-Text-to-Text • 8B • Updated Mar 20, 2025 • 9 • 1

hfl/Qwen2.5-VL-3B-Instruct-GPTQ-Int3

Image-Text-to-Text • 4B • Updated Mar 20, 2025 • 3 • 1

MaziyarPanahi/amoral-gemma3-4B-GGUF

Text Generation • 4B • Updated Mar 20, 2025 • 24

MaziyarPanahi/ByteCraft-GGUF

Text Generation • 8B • Updated Mar 20, 2025 • 15 • 1

MaziyarPanahi/DeepHermes-3-Llama-3-3B-Preview-abliterated-GGUF

Text Generation • 3B • Updated Mar 20, 2025 • 33 • 1

hildaray/gemma-3-12b-it-mlx-3Bit

Image-Text-to-Text • 2B • Updated Mar 21, 2025 • 9

KYUNGYONG/gemma-3-27b-it-abliterated-mlx-3Bit

Image-Text-to-Text • 4B • Updated Mar 21, 2025 • 42

MaziyarPanahi/Ice0.101-20.03-RP-GGUF

Text Generation • 7B • Updated Mar 21, 2025 • 11