Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,549

Base only

Active filters: 2-bit

alexgusevski/Phi-4-mini-instruct-Q2-mlx

Text Generation • 0.4B • Updated Mar 4, 2025 • 1

Dessicated/Hermes-3-Llama-3.1-405B-Uncensored-Q2-mlx

38B • Updated Mar 5, 2025

KYUNGYONG/DeepSeek-llama3.3-Bllossom-70B-Q2-mlx

Text Generation • 7B • Updated Mar 5, 2025 • 214

MaziyarPanahi/granite-3.2-8b-instruct-abliterated-GGUF

Text Generation • 8B • Updated Mar 5, 2025 • 51

MaziyarPanahi/BeyondRP-8B-GGUF

Text Generation • 8B • Updated Mar 5, 2025 • 8

MaziyarPanahi/granite-3.2-2b-instruct-abliterated-GGUF

Text Generation • 3B • Updated Mar 5, 2025 • 62

Chillarmo/QwQ-32B-2bit

Text Generation • 3B • Updated Mar 5, 2025 • 5

Koutouzov1973/mistral_small_24b_instruct_2501_2b_quantized

3B • Updated Mar 6, 2025 • 1

Koutouzov1973/mistral_small_24b_instruct_2501_3b_2bit_quantized

3B • Updated Mar 6, 2025

MaziyarPanahi/QwQ-32B-GGUF

Text Generation • 33B • Updated Mar 7, 2025 • 158k • 4

kaitchup/QwQ-32B-AutoRoundGPTQ-2bit

Text Generation • 33B • Updated Mar 7, 2025 • 3 • 1

MaziyarPanahi/Qwen-1M-DeepSeek-R1-14B-GGUF

Text Generation • 15B • Updated Mar 8, 2025 • 31 • 1

luna-kiwigod/Midnight-Miqu-70B-v1.5-exl2-2.0bpw

Text Generation • Updated Mar 8, 2025

MaziyarPanahi/EmojiLlama-3.1-8B-GGUF

Text Generation • 8B • Updated Mar 8, 2025 • 21

MaziyarPanahi/Messier-Opus-14B-Elite12-GGUF

Text Generation • 15B • Updated Mar 8, 2025 • 49

MaziyarPanahi/Goppa-LogiLlama-GGUF

Text Generation • 1B • Updated Mar 8, 2025 • 5

MaziyarPanahi/Glowing-Forest-12B-GGUF

Text Generation • 12B • Updated Mar 8, 2025 • 26 • 1

MaziyarPanahi/MT-Gen8-gemma-2-9B-GGUF

Text Generation • 9B • Updated Mar 9, 2025 • 45

MaziyarPanahi/MT3-Gen8-gemma-2-9B-GGUF

Text Generation • 9B • Updated Mar 9, 2025 • 53

MaziyarPanahi/gemma-2-2b-fa-v2-GGUF

Text Generation • 3B • Updated Mar 9, 2025 • 23 • 1

MaziyarPanahi/tempestissimo-14b-0309-GGUF

Text Generation • 15B • Updated Mar 9, 2025 • 51

MaziyarPanahi/Hush-Qwen2.5-7B-v1.3-GGUF

Text Generation • 8B • Updated Mar 9, 2025 • 24

MaziyarPanahi/Hush-Qwen2.5-7B-RP-v1.4-1M-GGUF

Text Generation • 8B • Updated Mar 9, 2025 • 44

TheDrewBenson/DeepSeek-R1-Distill-Qwen-7B-2bits-MLX

Text Generation • 0.7B • Updated Mar 11, 2025 • 6

KYUNGYONG/EXAONE-3.5-32B-Instruct-abliterated-2bit

Text Generation • 3B • Updated Mar 11, 2025 • 14

MaziyarPanahi/Llama-3.2-3B-ToxicKod-GGUF

Text Generation • 3B • Updated Mar 11, 2025 • 99 • 1

MaziyarPanahi/Llama-3.1-8B-RainbowLight-EtherealMix-GGUF

Text Generation • 8B • Updated Mar 11, 2025 • 33 • 1

MaziyarPanahi/Llama-3.1-8B-SuperNova-EtherealHermes-GGUF

Text Generation • 8B • Updated Mar 11, 2025 • 43 • 1

MaziyarPanahi/Llama-3.1-8B-SuperTulu-LexiNova-GGUF

Text Generation • 8B • Updated Mar 11, 2025 • 42

MaziyarPanahi/Peach-2.0-9B-8k-Roleplay-GGUF

Text Generation • 9B • Updated Mar 11, 2025 • 123 • 1