Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,741

Base only

Active filters: 2-bit

MaziyarPanahi/tempestissimo-14b-0309-GGUF

Text Generation • 15B • Updated Mar 9, 2025 • 5

MaziyarPanahi/Hush-Qwen2.5-7B-v1.3-GGUF

Text Generation • 8B • Updated Mar 9, 2025 • 30

MaziyarPanahi/Hush-Qwen2.5-7B-RP-v1.4-1M-GGUF

Text Generation • 8B • Updated Mar 9, 2025 • 46

TheDrewBenson/DeepSeek-R1-Distill-Qwen-7B-2bits-MLX

Text Generation • 0.7B • Updated Mar 11, 2025 • 19

KYUNGYONG/EXAONE-3.5-32B-Instruct-abliterated-2bit

Text Generation • 3B • Updated Mar 11, 2025 • 26

MaziyarPanahi/Llama-3.2-3B-ToxicKod-GGUF

Text Generation • 3B • Updated Mar 11, 2025 • 16 • 1

MaziyarPanahi/Llama-3.1-8B-RainbowLight-EtherealMix-GGUF

Text Generation • 8B • Updated Mar 11, 2025 • 8 • 1

MaziyarPanahi/Llama-3.1-8B-SuperNova-EtherealHermes-GGUF

Text Generation • 8B • Updated Mar 11, 2025 • 7 • 1

MaziyarPanahi/Llama-3.1-8B-SuperTulu-LexiNova-GGUF

Text Generation • 8B • Updated Mar 11, 2025 • 38

MaziyarPanahi/Peach-2.0-9B-8k-Roleplay-GGUF

Text Generation • 9B • Updated Mar 11, 2025 • 205 • 1

MaziyarPanahi/Deductive-Reasoning-Qwen-32B-GGUF

Text Generation • Updated Mar 11, 2025 • 63 • 1

MaziyarPanahi/Deductive-Reasoning-Qwen-14B-GGUF

Text Generation • Updated Mar 11, 2025 • 20 • 1

MaziyarPanahi/s1.1-7B-GGUF

Text Generation • 8B • Updated Mar 11, 2025 • 17 • 1

Koutouzov1973/Falcon3-Mamba-7B-Instruct-2bits_generex

1B • Updated Mar 11, 2025 • 2

MaziyarPanahi/gemma-3-1b-it-GGUF

Text Generation • 1.0B • Updated Mar 12, 2025 • 80.4k • 12

MaziyarPanahi/gemma-3-4b-it-GGUF

Text Generation • 4B • Updated Mar 12, 2025 • 94.8k • 19

MaziyarPanahi/gemma-3-12b-it-GGUF

Text Generation • 12B • Updated Mar 12, 2025 • 81.6k • 19

MaziyarPanahi/gemma-3-27b-it-GGUF

Text Generation • 27B • Updated Mar 16, 2025 • 80k • 8

alexgusevski/OlympicCoder-32B-mlx-2Bit

Text Generation • 3B • Updated Mar 13, 2025 • 1

alexgusevski/OlympicCoder-7B-mlx-2Bit

Text Generation • 0.7B • Updated Mar 13, 2025 • 3

alexgusevski/Goppa-LogiLlama-mlx-2Bit

Text Generation • 0.1B • Updated Mar 13, 2025 • 1

alexgusevski/Fallen-Llama-3.3-R1-70B-v1-mlx-2Bit

7B • Updated Mar 13, 2025 • 11

nhe-ai/QwQ-32B-mlx-2Bit

Text Generation • 3B • Updated Mar 13, 2025

MaziyarPanahi/c4ai-command-a-03-2025-GGUF

Text Generation • 111B • Updated Mar 15, 2025 • 328 • 1

Hjgugugjhuhjggg/xddd-mlx-2Bit

Text Generation • 0.3B • Updated Mar 15, 2025 • 6

MaziyarPanahi/OLMo-2-0325-32B-Instruct-GGUF

Text Generation • 32B • Updated Mar 15, 2025 • 50 • 1

Hjgugugjhuhjggg/Jaja-small-mlx-2Bit

Text Generation • 8.44M • Updated Mar 16, 2025 • 11

Kfjjdjdjdhdhd/xddd-mlx-2Bit

Text Generation • 0.3B • Updated Mar 17, 2025 • 4

MaziyarPanahi/mistral-small-3.1-24b-instruct-2503-hf-GGUF

Text Generation • 24B • Updated Mar 18, 2025 • 79.6k • 2

MaziyarPanahi/amoral-gemma3-4B-GGUF

Text Generation • 4B • Updated Mar 20, 2025 • 32