Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,490

Base only

Active filters: 3-bit

tomasmcm/QwQ-R1-Distill-Merge-32B-mlx-3Bit

Text Generation • 4B • Updated Apr 2, 2025 • 9

alexgusevski/Synthia-S1-27b-mlx-3Bit

Image-Text-to-Text • 4B • Updated Apr 4, 2025 • 9

alexgusevski/OpenThinker2-32B-mlx-3Bit

Text Generation • 4B • Updated Apr 5, 2025 • 8

Beridar/ReadyArt-Gaslit-Transgression-24B-v1.0-mlx-3bit

Text Generation • 3B • Updated Apr 6, 2025 • 12

Beridar/ReadyArt-Forgotten-Abomination-36B-v4.1-mlx-3bit

Text Generation • 5B • Updated Apr 6, 2025 • 28

Mawdistical/Draconic-Tease-70B_EXL2_3.0bpw_H8

Updated Apr 7, 2025 • 8

steve329/llama2-7B-gptq-3bits-c4-20GB-20GB

Text Generation • 6B • Updated Apr 7, 2025 • 8

KYUNGYONG/aya-expanse-32b-abliterated-mlx-3Bit

Text Generation • 4B • Updated Apr 9, 2025 • 17 • 1

Mawdistical/Vulpine-Seduction-70B_EXL2_3.0bpw_H8

Updated Apr 9, 2025 • 5

Serione/Llama-3.2-1B-SRLQ-3bit

Updated Apr 9, 2025 • 8

pleasen/phi-4-mlx-3Bit

Text Generation • 2B • Updated Apr 9, 2025 • 12

cnfusion/cogito-v1-preview-qwen-32B-mlx-3Bit

Text Generation • 4B • Updated Apr 10, 2025 • 16

TendernessChen/PromptCoT-QwQ-32B-mlx-3Bit

4B • Updated Apr 11, 2025 • 19

Jellon/Pantheon-RP-1.8-24b-Small-3.1-exl3-3bpw

5B • Updated Apr 12, 2025 • 8 • 1

numen-tech/cogito-v1-preview-llama-70B-w3a16g40sym

Text Generation • Updated Apr 14, 2025

numen-tech/Llama-3.1-8B-UltraMedical-w3a16g40sym

Text Generation • Updated Apr 15, 2025

numen-tech/Medical-Llama3-v2-w3a16g40sym

Text Generation • Updated Apr 15, 2025

numen-tech/Meta-Llama-3.1-8B-SurviveV3-w3a16g40sym

Text Generation • Updated Apr 15, 2025

sleepdeprived3/Baptist-Christian-Bible-Expert-v2.0-24B_EXL2_3bpw_H8

Text Generation • Updated Apr 15, 2025 • 15

YuHaaa/Qwen1.5-110B-Chat-mlx-3Bit

Text Generation • 14B • Updated Apr 17, 2025 • 22 • 1

phires/Llama-3.2-1B-Instruct-GGUF-rk3588-1.1.2

Text Generation • Updated Apr 20, 2025 • 12

MaziyarPanahi/GLM-4-32B-0414-GGUF

Text Generation • 33B • Updated Apr 22, 2025 • 346 • 1

MaziyarPanahi/cogito-v1-preview-llama-3B-GGUF

Text Generation • 4B • Updated Apr 21, 2025 • 150 • 1

MaziyarPanahi/cogito-v1-preview-llama-8B-GGUF

Text Generation • 8B • Updated Apr 21, 2025 • 141 • 1

MaziyarPanahi/cogito-v1-preview-llama-70B-GGUF

Text Generation • 71B • Updated Apr 22, 2025 • 123 • 1

mlx-community/Llama-OuteTTS-1.0-1B-3bit

Text-to-Speech • 0.2B • Updated May 19, 2025 • 20 • 1

isogen/reka-flash-3-exl3-3bpw

5B • Updated Jun 22, 2025 • 6

Erland/softpick-340M-4096-model-GPTQ-3bit

Text Generation • 0.4B • Updated Apr 24, 2025 • 9

Erland/vanilla-340M-4096-model-GPTQ-3bit

Text Generation • 0.4B • Updated Apr 24, 2025 • 9

mlx-community/Dia-1.6B-3bit

Text-to-Speech • 2B • Updated Apr 24, 2025 • 12 • 4