Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

4,540

Base only

Active filters: 6-bit

JJAnderson/EXAONE-Deep-7.8B-mlx-6Bit

Text Generation • 2B • Updated Mar 18, 2025 • 13

MaziyarPanahi/mistral-small-3.1-24b-instruct-2503-hf-GGUF

Text Generation • 24B • Updated Mar 18, 2025 • 178k • 2

alexgusevski/gemma-3-text-4b-it-q6-mlx

Text Generation • 1.0B • Updated Mar 18, 2025 • 13

alexgusevski/EXAONE-Deep-2.4B-q6-mlx

Text Generation • 0.5B • Updated Mar 18, 2025 • 11

alexgusevski/EXAONE-Deep-7.8B-mlx-6Bit

Text Generation • 2B • Updated Mar 18, 2025 • 13

alexgusevski/EXAONE-Deep-32B-mlx-6Bit

Text Generation • 7B • Updated Mar 18, 2025 • 10

mlx-community/Mistral-Small-3.1-Text-24B-Instruct-2503-6bit

5B • Updated Mar 18, 2025 • 15

Fmuaddib/DeepSeek-R1-Distill-Llama-70B-abliterated-mlx-6Bit

15B • Updated Mar 18, 2025 • 112

mlx-community/EXAONE-Deep-2.4B-6bit

Text Generation • 0.5B • Updated Mar 18, 2025 • 12

mlx-community/EXAONE-Deep-32B-6bit

Text Generation • 7B • Updated Mar 18, 2025 • 10

Fmuaddib/Yi-34B-200K-mlx-6Bit

Text Generation • 8B • Updated Mar 18, 2025 • 8

mlx-community/EXAONE-Deep-7.8B-6bit

Text Generation • 2B • Updated Mar 18, 2025 • 13

gghfez/Mistral-Small-3.1-24B-Instruct-2503-novision-exl2-6bpw

Updated Mar 19, 2025 • 12 • 1

mlx-community/MiniCPM3-4B-6bit

Text Generation • 0.9B • Updated Mar 19, 2025 • 33

SicariusSicariiStuff/Fiendish_LLAMA_3B-6.0bpw

Text Generation • Updated Jul 26, 2025 • 4

sigjhl/reka-flash-3-mlx-6Bit

5B • Updated Mar 20, 2025 • 11

MaziyarPanahi/amoral-gemma3-4B-GGUF

Text Generation • 4B • Updated Mar 20, 2025 • 77

MaziyarPanahi/ByteCraft-GGUF

Text Generation • 8B • Updated Mar 20, 2025 • 78 • 1

MaziyarPanahi/DeepHermes-3-Llama-3-3B-Preview-abliterated-GGUF

Text Generation • 3B • Updated Mar 20, 2025 • 77 • 1

Scotto2025/watt-tool-70B-mlx-6Bit

15B • Updated Mar 20, 2025 • 6

codingmavin/finance-Llama3-8B-mlx-6Bit

2B • Updated Mar 20, 2025 • 141 • 1

codingmavin/OLMo-2-0325-32B-Instruct-mlx-6Bit

Text Generation • 7B • Updated Mar 20, 2025 • 30

narpas/Llama-3.3-70B-Vulpecula-r1-6.0bpw-h8-exl2

Text Generation • Updated Mar 21, 2025 • 9

MaziyarPanahi/Ice0.101-20.03-RP-GGUF

Text Generation • 7B • Updated Mar 21, 2025 • 41

MaziyarPanahi/Qwen2.5-1.5B-YOYO-GGUF

Text Generation • 2B • Updated Mar 21, 2025 • 27

MaziyarPanahi/Qwen2.5-3B-YOYO-GGUF

Text Generation • 3B • Updated Mar 21, 2025 • 29

MaziyarPanahi/Qwen2.5-7B-YOYO-GGUF

Text Generation • 8B • Updated Mar 21, 2025 • 85

MaziyarPanahi/gemma-3-1b-it-abliterated-GGUF

Text Generation • 1.0B • Updated Mar 21, 2025 • 100 • 1

MaziyarPanahi/Qwen2.5-14B-YOYO-GGUF

Text Generation • 15B • Updated Mar 21, 2025 • 11

MaziyarPanahi/Qwen2.5-Coder-14B-YOYO-GGUF

Text Generation • 15B • Updated Mar 21, 2025 • 46