Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,956

Full-text search

Active filters: 3-bit

mlx-community/sarvam-m-mlx-3Bit

Text Generation • Updated May 31, 2025 • 6 • 1

wei123602/exllama-Llama-3.2-3B-Instruct-3.0bpw

Updated May 31, 2025 • 2

wolfCuanhamaRWS/GuardReasoner-1B_auto_round_best_default_calib_b3_g128_20250531_164223_20250531_164223

0.4B • Updated May 31, 2025

MetaphoricalCode/Synthia-S1-27b-exl3-3bpw-hb6

Image-Text-to-Text • 7B • Updated Jun 1, 2025 • 1

DeusImperator/L3.3-MS-Nevoria-70b_exl3_3.0bpw_H6

Text Generation • 14B • Updated Jun 1, 2025 • 13

MetaphoricalCode/gemma-3-27b-it-abliterated-exl3-3bpw-hb6

Image-Text-to-Text • 7B • Updated Jun 2, 2025 • 7

MetaphoricalCode/gemma3-27b-abliterated-dpo-exl3-3bpw-hb6

Image-Text-to-Text • 7B • Updated Jun 2, 2025 • 1

nhe-ai/Muse-12B-mlx-3Bit

Text Generation • 2B • Updated Jun 3, 2025 • 11

stellaglow1122/llama3.2-1B-lora-exl2-q3

Updated Jun 4, 2025

PepitaxX/qwen3-0.6b-gptq

Text Generation • 0.6B • Updated Jun 6, 2025 • 3

tomasmcm/KwaiCoder-AutoThink-preview-mlx-3Bit

Text Generation • 5B • Updated Jun 7, 2025 • 4

ekwek/R1-8B-3bit-autogptq

Text Generation • Updated Jun 7, 2025 • 1

ekwek/R1-8B-3bit-gptq-fp16

Text Generation • 8B • Updated Jun 7, 2025 • 2

DeusImperator/L3.3-GeneticLemonade-Unleashed-v3-70B_exl3_3.0bpw_H6

Text Generation • 14B • Updated Jun 9, 2025 • 2

mlx-community/KwaiCoder-AutoThink-preview-3bit

Text Generation • 41B • Updated Jun 9, 2025 • 2

MetaphoricalCode/Gemma-3-Glitter-27B-exl3-3bpw-hb6

Image-Text-to-Text • 7B • Updated Jun 10, 2025

irish-quant/01-ai-Yi-1.5-6B-Chat-3bit

6B • Updated Jun 10, 2025

irish-quant/01-ai-Yi-1.5-6B-3bit

6B • Updated Jun 10, 2025

irish-quant/01-ai-Yi-1.5-9B-Chat-3bit

8B • Updated Jun 10, 2025

irish-quant/01-ai-Yi-1.5-9B-3bit

8B • Updated Jun 10, 2025

irish-quant/HuggingFaceTB-SmolLM-1.7B-Instruct-3bit

2B • Updated Jun 10, 2025

irish-quant/HuggingFaceTB-SmolLM-1.7B-3bit

2B • Updated Jun 10, 2025

irish-quant/HuggingFaceTB-SmolLM-135M-Instruct-3bit

0.1B • Updated Jun 10, 2025

irish-quant/HuggingFaceTB-SmolLM-135M-3bit

0.1B • Updated Jun 10, 2025

irish-quant/HuggingFaceTB-SmolLM-360M-Instruct-3bit

0.3B • Updated Jun 10, 2025

beezu/StrawberryLemonade-L3-70B-v1-MLX-3Bit

Text Generation • 71B • Updated Jun 11, 2025 • 4

irish-quant/HuggingFaceTB-SmolLM-360M-3bit

0.3B • Updated Jun 11, 2025

irish-quant/meta-llama-Llama-3.1-8B-Instruct-3bit

8B • Updated Jun 11, 2025

irish-quant/meta-llama-Llama-3.1-8B-3bit

8B • Updated Jun 11, 2025

irish-quant/meta-llama-Llama-3.2-1B-Instruct-3bit

1B • Updated Jun 11, 2025