Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,490

Base only

Active filters: 3-bit

MetaphoricalCode/gemma-3-27b-it-abliterated-exl3-3bpw-hb6

Image-Text-to-Text • 7B • Updated Jun 2, 2025 • 11

MetaphoricalCode/gemma3-27b-abliterated-dpo-exl3-3bpw-hb6

Image-Text-to-Text • 7B • Updated Jun 2, 2025 • 8

nhe-ai/Muse-12B-mlx-3Bit

Text Generation • 2B • Updated Jun 3, 2025 • 171

stellaglow1122/llama3.2-1B-lora-exl2-q3

Updated Jun 4, 2025 • 5

PepitaxX/qwen3-0.6b-gptq

Text Generation • 0.6B • Updated Jun 6, 2025 • 4

tomasmcm/KwaiCoder-AutoThink-preview-mlx-3Bit

Text Generation • 5B • Updated Jun 7, 2025 • 35

ekwek/R1-8B-3bit-autogptq

Text Generation • Updated Jun 7, 2025 • 6

ekwek/R1-8B-3bit-gptq-fp16

Text Generation • 8B • Updated Jun 7, 2025 • 7

DeusImperator/L3.3-GeneticLemonade-Unleashed-v3-70B_exl3_3.0bpw_H6

Text Generation • 14B • Updated Jun 9, 2025 • 7

mlx-community/KwaiCoder-AutoThink-preview-3bit

Text Generation • 41B • Updated Jun 9, 2025 • 8

MetaphoricalCode/Gemma-3-Glitter-27B-exl3-3bpw-hb6

Image-Text-to-Text • 7B • Updated Jun 10, 2025 • 4

irish-quant/01-ai-Yi-1.5-6B-Chat-3bit

6B • Updated Jun 10, 2025 • 3

irish-quant/01-ai-Yi-1.5-6B-3bit

6B • Updated Jun 10, 2025 • 5

irish-quant/01-ai-Yi-1.5-9B-Chat-3bit

8B • Updated Jun 10, 2025 • 6

irish-quant/01-ai-Yi-1.5-9B-3bit

8B • Updated Jun 10, 2025 • 6

irish-quant/HuggingFaceTB-SmolLM-1.7B-Instruct-3bit

2B • Updated Jun 10, 2025 • 9

irish-quant/HuggingFaceTB-SmolLM-1.7B-3bit

2B • Updated Jun 10, 2025 • 5

irish-quant/HuggingFaceTB-SmolLM-135M-Instruct-3bit

0.1B • Updated Jun 10, 2025 • 6

irish-quant/HuggingFaceTB-SmolLM-135M-3bit

0.1B • Updated Jun 10, 2025 • 5

irish-quant/HuggingFaceTB-SmolLM-360M-Instruct-3bit

0.3B • Updated Jun 10, 2025 • 5

beezu/StrawberryLemonade-L3-70B-v1-MLX-3Bit

Text Generation • 71B • Updated Jun 11, 2025 • 9

irish-quant/HuggingFaceTB-SmolLM-360M-3bit

0.3B • Updated Jun 11, 2025 • 6

irish-quant/meta-llama-Llama-3.1-8B-Instruct-3bit

8B • Updated Jun 11, 2025 • 4

irish-quant/meta-llama-Llama-3.1-8B-3bit

8B • Updated Jun 11, 2025 • 3

irish-quant/meta-llama-Llama-3.2-1B-Instruct-3bit

1B • Updated Jun 11, 2025 • 4

irish-quant/meta-llama-Llama-3.2-1B-3bit

1B • Updated Jun 11, 2025 • 5

irish-quant/meta-llama-Llama-3.2-3B-Instruct-3bit

3B • Updated Jun 11, 2025 • 5

irish-quant/meta-llama-Llama-3.2-3B-3bit

3B • Updated Jun 11, 2025 • 5

irish-quant/meta-llama-Meta-Llama-3-8B-Instruct-3bit

8B • Updated Jun 11, 2025 • 4

irish-quant/meta-llama-Meta-Llama-3-8B-3bit

8B • Updated Jun 11, 2025 • 5