Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,720

Base only

Active filters: 2-bit

mlx-community-staging/gemma-3-1b-it-mlx-4Bit-dynamic

Text Generation • Updated Jun 4, 2025 • 15

mlx-community-staging/gemma-3-1b-it-mlx-6Bit-dynamic

Text Generation • Updated Jun 4, 2025 • 11

MetaphoricalCode/gemma3-27b-abliterated-dpo-exl3-2bpw-hb6

Image-Text-to-Text • 6B • Updated Jun 6, 2025 • 5

PepitaxX/qwen3-0.6b-gptq_2bit

Text Generation • 0.6B • Updated Jun 6, 2025 • 4

PepitaxX/qwen3-0.6B-openQA_prefinetune_deepseek210k_2bit

Text Generation • 0.6B • Updated Jun 6, 2025 • 6

TheS3b/Qwen3-EfficientQAT-w2g64

0.6B • Updated Jun 8, 2025 • 3

irish-quant/01-ai-Yi-1.5-6B-Chat-2bit

6B • Updated Jun 10, 2025 • 1

irish-quant/01-ai-Yi-1.5-6B-2bit

6B • Updated Jun 10, 2025 • 1

irish-quant/01-ai-Yi-1.5-9B-Chat-2bit

9B • Updated Jun 10, 2025 • 2

irish-quant/01-ai-Yi-1.5-9B-2bit

9B • Updated Jun 10, 2025 • 2

irish-quant/HuggingFaceTB-SmolLM-1.7B-Instruct-2bit

2B • Updated Jun 10, 2025 • 3

irish-quant/HuggingFaceTB-SmolLM-1.7B-2bit

2B • Updated Jun 10, 2025 • 1

irish-quant/HuggingFaceTB-SmolLM-135M-2bit

0.1B • Updated Jun 10, 2025 • 1

irish-quant/HuggingFaceTB-SmolLM-360M-Instruct-2bit

0.4B • Updated Jun 10, 2025 • 4

irish-quant/HuggingFaceTB-SmolLM-360M-2bit

0.4B • Updated Jun 10, 2025 • 1

irish-quant/meta-llama-Llama-3.1-8B-Instruct-2bit

8B • Updated Jun 11, 2025 • 1

irish-quant/meta-llama-Llama-3.1-8B-2bit

8B • Updated Jun 11, 2025

irish-quant/meta-llama-Llama-3.2-1B-Instruct-2bit

1B • Updated Jun 11, 2025 • 1

irish-quant/meta-llama-Llama-3.2-1B-2bit

1B • Updated Jun 11, 2025 • 1

irish-quant/meta-llama-Llama-3.2-3B-Instruct-2bit

3B • Updated Jun 11, 2025 • 1

irish-quant/meta-llama-Llama-3.2-3B-2bit

3B • Updated Jun 11, 2025 • 1

irish-quant/meta-llama-Meta-Llama-3-8B-Instruct-2bit

8B • Updated Jun 11, 2025 • 1

irish-quant/meta-llama-Meta-Llama-3-8B-2bit

8B • Updated Jun 11, 2025 • 1

irish-quant/microsoft-Phi-3-mini-128k-instruct-2bit

4B • Updated Jun 11, 2025 • 1

irish-quant/microsoft-Phi-3-mini-4k-instruct-2bit

4B • Updated Jun 11, 2025 • 3

irish-quant/microsoft-Phi-3.5-mini-instruct-2bit

4B • Updated Jun 11, 2025 • 2

irish-quant/meta-llama-Meta-Llama-Guard-2-8B-2bit

8B • Updated Jun 11, 2025 • 1

irish-quant/mistralai-Mistral-Small-24B-Instruct-2501-2bit

24B • Updated Jun 11, 2025 • 1

irish-quant/mistralai-Mistral-Small-Instruct-2409-2bit

22B • Updated Jun 11, 2025 • 1

irish-quant/mistral-community-Mistral-7B-v0.2-2bit

7B • Updated Jun 11, 2025 • 2