Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,570

Base only

Active filters: 2-bit

MaziyarPanahi/MN-GRAND-Gutenberg-Lyra4-Lyra-12B-MADNESS-GGUF

Text Generation • 12B • Updated Nov 7, 2024 • 101

MaziyarPanahi/Mistral-Nemo-Kurdish-Instruct-GGUF

Text Generation • 12B • Updated Nov 7, 2024 • 79

MaziyarPanahi/calme-3.1-instruct-3b-GGUF

Text Generation • 3B • Updated Nov 15, 2024 • 106 • 1

MaziyarPanahi/calme-3.2-instruct-3b-GGUF

Text Generation • 3B • Updated Nov 15, 2024 • 202

MaziyarPanahi/calme-3.3-instruct-3b-GGUF

Text Generation • 3B • Updated Nov 15, 2024 • 181 • 3

MaziyarPanahi/calme-3.1-baguette-3b-GGUF

Text Generation • 3B • Updated Nov 15, 2024 • 149

MaziyarPanahi/calme-3.2-baguette-3b-GGUF

Text Generation • 3B • Updated Nov 15, 2024 • 152

MaziyarPanahi/calme-3.3-baguette-3b-GGUF

Text Generation • 3B • Updated Nov 15, 2024 • 196

MaziyarPanahi/calme-3.1-qwenloi-3b-GGUF

Text Generation • 3B • Updated Nov 15, 2024 • 223 • 1

MaziyarPanahi/calme-3.2-qwenloi-3b-GGUF

Text Generation • 3B • Updated Nov 15, 2024 • 79

MaziyarPanahi/calme-3.3-qwenloi-3b-GGUF

Text Generation • 3B • Updated Nov 15, 2024 • 122

MaziyarPanahi/calme-3.1-llamaloi-3b-GGUF

Text Generation • 3B • Updated Nov 15, 2024 • 883

MaziyarPanahi/calme-3.2-llamaloi-3b-GGUF

Text Generation • 3B • Updated Nov 15, 2024 • 882 • 1

MaziyarPanahi/calme-3.3-llamaloi-3b-GGUF

Text Generation • 3B • Updated Nov 15, 2024 • 863

DrNicefellow/Qwen2.5-Coder-32B-Instruct-2.0bpw-exl2

Updated Nov 12, 2024 • 1

kaitchup/Qwen2.5-72B-Instruct-AutoRound-GPTQ-2bit

Text Generation • 73B • Updated Nov 26, 2024 • 15 • 4

DrNicefellow/Qwen2.5-Coder-14B-Instruct-2.0bpw-exl2

Updated Nov 13, 2024 • 3

async0x42/Qwen2.5-Coder-0.5B-Instruct-exl2_2.0bpw

Text Generation • Updated Nov 14, 2024 • 2

DrNicefellow/Qwen2.5-7B-O1-Journey-1-2.0bpw-exl2

Updated Nov 17, 2024 • 2

MaziyarPanahi/NuExtract-1.5-smol-GGUF

Text Generation • 2B • Updated Nov 15, 2024 • 171 • 7

async0x42/Qwen2.5-0.5B-Instruct-exl2_2.0bpw

Text Generation • Updated Nov 16, 2024 • 2

Xu-Ouyang/FloatLM_99M-int2-GPTQ-wikitext2

Text Generation • 99.8M • Updated Nov 16, 2024 • 3

Xu-Ouyang/FloatLM_190M-int2-GPTQ-wikitext2

Text Generation • 0.2B • Updated Nov 16, 2024 • 7

Xu-Ouyang/FloatLM_390M-int2-GPTQ-wikitext2

Text Generation • 0.4B • Updated Nov 16, 2024 • 3

Xu-Ouyang/FloatLM_560M-int2-GPTQ-wikitext2

Text Generation • 0.6B • Updated Nov 16, 2024 • 3

Xu-Ouyang/FloatLM_830M-int2-GPTQ-wikitext2

Text Generation • 0.8B • Updated Nov 16, 2024 • 3

Xu-Ouyang/FloatLM_1.1B-int2-GPTQ-wikitext2

Text Generation • 1B • Updated Nov 16, 2024 • 8

Xu-Ouyang/FloatLM_1.5B-int2-GPTQ-wikitext2

Text Generation • 2B • Updated Nov 16, 2024 • 2

Xu-Ouyang/FloatLM_3.9B-int2-GPTQ-wikitext2

Text Generation • 4B • Updated Nov 16, 2024 • 3

Xu-Ouyang/FloatLM_2.4B-int2-GPTQ-wikitext2

Text Generation • 2B • Updated Nov 16, 2024 • 3 • 1