Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

4,534

Base only

Active filters: 6-bit

mlx-community/Llama-3_3-Nemotron-Super-49B-v1-mlx-6bit

Text Generation • 11B • Updated Apr 8, 2025 • 46

mlx-community/deepcogito-cogito-v1-preview-llama-3B-6bit

Text Generation • 0.7B • Updated Apr 8, 2025 • 10

mlx-community/deepcogito-cogito-v1-preview-llama-8B-6bit

Text Generation • 2B • Updated Apr 8, 2025 • 10

mlx-community/deepcogito-cogito-v1-preview-qwen-14B-6bit

Text Generation • 3B • Updated Apr 8, 2025 • 13

mlx-community/deepcogito-cogito-v1-preview-qwen-32B-6bit

Text Generation • 7B • Updated Apr 9, 2025 • 14

mlx-community/deepcogito-cogito-v1-preview-llama-70B-6bit

Text Generation • 15B • Updated Apr 9, 2025 • 21 • 1

janboe91/DeepCoder-1.5B-Preview-mlx-6Bit

Text Generation • 0.4B • Updated Apr 9, 2025 • 14

Mawdistical/Vulpine-Seduction-70B_EXL2_6.0bpw_H8

Updated Apr 9, 2025 • 8

Jellon/Lyra-Gutenberg-12b-exl3-6bpw

Text Generation • 5B • Updated Apr 10, 2025 • 13 • 1

Jellon/Pantheon-RP-1.8-24b-Small-3.1-exl2-6bpw

Updated Apr 11, 2025 • 9

ThijsL202/Pantheon-RP-1.8-24b-Small-3.1-exl3-6.0bpw

9B • Updated Apr 15, 2025 • 8

YuHaaa/Skywork-OR1-32B-Preview-mlx-6Bit

Text Generation • 7B • Updated Apr 16, 2025 • 14

mlx-community/shisa-v2-qwen2.5-32b-6bit

Text Generation • 7B • Updated Apr 15, 2025 • 15

mlx-community/shisa-v2-llama3.3-70b-6bit

Text Generation • 15B • Updated Apr 15, 2025 • 27

sleepdeprived3/Baptist-Christian-Bible-Expert-v2.0-24B_EXL2_6bpw_H8

Text Generation • Updated Apr 15, 2025 • 11

mlx-community/gemma-3-1b-it-qat-6bit

Text Generation • 0.3B • Updated Apr 18, 2025 • 19

Basthen/DeepSeek-V2.5-1210-Q6-GS64

52B • Updated Apr 16, 2025 • 12

mlx-community/ReZero-v0.1-llama-3.2-3b-it-grpo-250404-6bit

Text Generation • 0.7B • Updated Apr 16, 2025 • 10

mlx-community/granite-3.3-8b-instruct-6bit

Text Generation • 2B • Updated Apr 16, 2025 • 13 • 1

mlx-community/granite-3.3-2b-instruct-6bit

Text Generation • 0.6B • Updated Apr 16, 2025 • 22

mlx-community/GLM-4-9B-0414-6bit

Text Generation • 2B • Updated Apr 17, 2025 • 20

narpas/Alkahest-V4-LLaMa-70B-6.0bpw-h8-exl2

Text Generation • Updated May 17, 2025 • 11

sleepdeprived3/Reformed-Christian-Bible-Expert-v2.1-12B_EXL2_6bpw_H8

Text Generation • Updated Apr 20, 2025 • 5

phires/Llama-3.2-1B-Instruct-GGUF-rk3588-1.1.2

Text Generation • Updated Apr 20, 2025 • 9

TeeZee/QwQ-32B-bpw6.0-h8-exl2

Text Generation • Updated May 15, 2025 • 15

MaziyarPanahi/GLM-4-32B-0414-GGUF

Text Generation • 33B • Updated Apr 22, 2025 • 344 • 1

MaziyarPanahi/cogito-v1-preview-llama-3B-GGUF

Text Generation • 4B • Updated Apr 21, 2025 • 126 • 1

MaziyarPanahi/cogito-v1-preview-llama-8B-GGUF

Text Generation • 8B • Updated Apr 21, 2025 • 166 • 1

mlx-community/GLM-Z1-9B-0414-6bit

Text Generation • 2B • Updated Apr 21, 2025 • 16

MaziyarPanahi/cogito-v1-preview-llama-70B-GGUF

Text Generation • 71B • Updated Apr 22, 2025 • 96 • 1