Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,745

Base only

Active filters: 2-bit

mlx-community/DeepSeek-R1-2bit

Text Generation • 84B • Updated Mar 6, 2025 • 178 • 9

MaziyarPanahi/IFeelSoSprunki-8B-Llama3.1-GGUF

Text Generation • 8B • Updated Feb 10, 2025 • 14

MaziyarPanahi/DeepSeek-Grand-Horror-SMB-R1-Distill-Llama-3.1-16B-GGUF

Text Generation • 16B • Updated Feb 10, 2025 • 27

MaziyarPanahi/Captain-Eris_Violet_Toxic-Magnum-12B-GGUF

Text Generation • 12B • Updated Feb 10, 2025 • 47 • 4

MaziyarPanahi/Qwen-2.5-7B-Exp-Sce-GGUF

Text Generation • 8B • Updated Feb 10, 2025 • 12

MaziyarPanahi/Slush-ChatWaifu-Chronos-GGUF

Text Generation • 12B • Updated Feb 10, 2025 • 21 • 1

MaziyarPanahi/Qwen2.5-7B-Gordion-v0.1-Prose-GGUF

Text Generation • 8B • Updated Feb 10, 2025 • 16

MaziyarPanahi/Llama-Krikri-8B-Instruct-GGUF

Text Generation • 8B • Updated Feb 10, 2025 • 20

roleplaiapp/mistralai_Mistral-Small-Instruct-2409-exl2-2.0bpw

Updated Feb 12, 2025 • 2

MaziyarPanahi/DarkIdol-LongWriter-8B-Uncensored-1048k-GGUF

Text Generation • 8B • Updated Feb 12, 2025 • 104 • 1

MaziyarPanahi/QVikhr-2.5-1.5B-Instruct-r-GGUF

Text Generation • 2B • Updated Feb 12, 2025 • 25

MaziyarPanahi/S1_4o_mini-GGUF

Text Generation • 8B • Updated Feb 12, 2025 • 32

MaziyarPanahi/Intelligence-Agent-7B-GGUF

Text Generation • 8B • Updated Feb 12, 2025 • 4

MaziyarPanahi/german-r1-GGUF

Text Generation • 3B • Updated Feb 12, 2025 • 25 • 1

MaziyarPanahi/SAXON-0-GGUF

Text Generation • 8B • Updated Feb 12, 2025 • 46

Siddharth63/Qwen2.5-14B-Instruct-AutoRound-GPTQ-2bit

15B • Updated Feb 14, 2025 • 2

MaziyarPanahi/Gemma-9B-Base-GGUF

Text Generation • 9B • Updated Feb 12, 2025 • 19

OPEA/DeepSeek-R1-int2-mixed-sym-inc

59B • Updated Jul 11, 2025 • 8 • 12

Siddharth63/Qwen2.5-32B-Instruct-AutoRound-GPTQ-2bit

33B • Updated Feb 14, 2025 • 4

MaziyarPanahi/Hiber-Multi-10B-Instruct-GGUF

Text Generation • 11B • Updated Feb 14, 2025 • 22

MaziyarPanahi/LlamaThink-8B-instruct-GGUF

Text Generation • 8B • Updated Feb 14, 2025 • 32

MaziyarPanahi/MT-Merge6-gemma-2-9B-GGUF

Text Generation • 9B • Updated Feb 14, 2025 • 10 • 1

MaziyarPanahi/Korean-QWEN-Coder2.5-14B-GGUF

Text Generation • 15B • Updated Feb 14, 2025 • 119

MaziyarPanahi/Viper-Coder-v1.1-GGUF

Text Generation • 15B • Updated Feb 14, 2025 • 10

MaziyarPanahi/DeepSeek-llama3.1-Bllossom-8B-GGUF

Text Generation • 8B • Updated Feb 14, 2025 • 26 • 1

MaziyarPanahi/Magellanic-Opus-14B-Exp-GGUF

Text Generation • 15B • Updated Feb 14, 2025 • 23

MaziyarPanahi/Kyro-n1-3B-GGUF

Text Generation • 3B • Updated Feb 14, 2025 • 11

MaziyarPanahi/MrRoboto-BASE-Unholy-8b-64k-GGUF

Text Generation • 8B • Updated Feb 14, 2025 • 9

MaziyarPanahi/Fino1-8B-GGUF

Text Generation • 8B • Updated Feb 14, 2025 • 23

MaziyarPanahi/To-the-end-of-this-earth-MN-12B-GGUF

Text Generation • 12B • Updated Feb 14, 2025 • 2 • 1