Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,901

Base only

Active filters: 5-bit

roleplaiapp/AceInstruct-1.5B-Q5_0-GGUF

Text Generation • 2B • Updated Jan 19, 2025 • 2

roleplaiapp/AceInstruct-1.5B-Q5_K_S-GGUF

Text Generation • 2B • Updated Jan 19, 2025 • 7

roleplaiapp/AceInstruct-1.5B-Q5_K_M-GGUF

Text Generation • 2B • Updated Jan 19, 2025 • 5

roleplaiapp/AceInstruct-7B-Q5_0-GGUF

Text Generation • 8B • Updated Jan 19, 2025 • 2

roleplaiapp/AceInstruct-7B-Q5_K_S-GGUF

Text Generation • 8B • Updated Jan 19, 2025

roleplaiapp/AceInstruct-7B-Q5_K_M-GGUF

Text Generation • 8B • Updated Jan 19, 2025 • 4

roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q5_K_M-GGUF

Text Generation • 71B • Updated Jan 19, 2025 • 24

matatonic/DeepSeek-R1-Distill-Qwen-1.5B-5.0bpw-exl2

Updated Jan 20, 2025 • 8

adamo1139/DeepSeek-R1-Distill-Qwen-1.5B-5bpw-exl2

Updated Jan 20, 2025 • 4

SicariusSicariiStuff/Eximius_Persona_5B-5.0bpw

Text Generation • Updated Jul 26, 2025 • 7

roleplaiapp/ALIA-40b-Q5_0-GGUF

Text Generation • 40B • Updated Jan 23, 2025 • 4

MaziyarPanahi/SuperThoughts-CoT-14B-16k-o1-QwQ-GGUF

Text Generation • 15B • Updated Jan 24, 2025 • 10

MaziyarPanahi/Phi-4-Empathetic-GGUF

Text Generation • 15B • Updated Jan 24, 2025 • 91

MaziyarPanahi/Phi-4-QwQ-GGUF

Text Generation • 15B • Updated Jan 24, 2025 • 48

SicariusSicariiStuff/Wingless_Imp_8B-5.0bpw

Text Generation • Updated Jul 26, 2025 • 5

MaziyarPanahi/Llama-8B-Distill-CoT-GGUF

Text Generation • 8B • Updated Jan 24, 2025 • 16

MaziyarPanahi/DeepSeek-R1-Distill-Llama-8B-GGUF

Text Generation • 8B • Updated Jan 24, 2025 • 90

MaziyarPanahi/xLAM-7b-fc-r-GGUF

Text Generation • 7B • Updated Jan 24, 2025 • 21

MaziyarPanahi/xLAM-1b-fc-r-GGUF

Text Generation • 1B • Updated Jan 24, 2025 • 66

roleplaiapp/Qwen2.5-7B-Instruct-Uncensored-Q5_K_M-GGUF

Text Generation • 8B • Updated Jan 27, 2025 • 91 • 2

roleplaiapp/Qwen2.5-7B-Instruct-Uncensored-Q5_K_S-GGUF

Text Generation • 8B • Updated Jan 27, 2025 • 27

SicariusSicariiStuff/Impish_QWEN_14B-1M-5.0bpw

Text Generation • Updated Jul 26, 2025 • 7

roleplaiapp/MN-12B-Mag-Mell-R1-Q5_K_M-GGUF

Text Generation • 12B • Updated Jan 27, 2025 • 52 • 1

roleplaiapp/MN-12B-Mag-Mell-R1-Q5_K_S-GGUF

Text Generation • 12B • Updated Jan 27, 2025

roleplaiapp/SILMA-Kashif-2B-Instruct-v1.0-i1-Q5_K_M-GGUF

Text Generation • 3B • Updated Jan 28, 2025 • 2

roleplaiapp/SILMA-Kashif-2B-Instruct-v1.0-i1-Q5_K_S-GGUF

Text Generation • 3B • Updated Jan 28, 2025 • 6

roleplaiapp/DeepSeek-R1-Distill-Qwen-32B-Uncensored-Q5_K_M-GGUF

Text Generation • 33B • Updated Jan 29, 2025 • 33

roleplaiapp/14B-Qwen2.5-Kunou-v1-Q5_K_M-GGUF

Text Generation • 15B • Updated Jan 29, 2025 • 15

roleplaiapp/14B-Qwen2.5-Kunou-v1-Q5_K_S-GGUF

Text Generation • 15B • Updated Jan 29, 2025 • 1

roleplaiapp/q-2.5-deepseek-r1-veltha-v0.3-Q5_K_M-GGUF

Text Generation • 15B • Updated Jan 29, 2025 • 8