Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,901

Base only

Active filters: 5-bit

cpchan/YuE-s1-7B-anneal-jp-kr-icl-5.0bpw

Text Generation • Updated Feb 9, 2025 • 7 • 1

MaziyarPanahi/IFeelSoSprunki-8B-Llama3.1-GGUF

Text Generation • 8B • Updated Feb 10, 2025 • 58

MaziyarPanahi/DeepSeek-Grand-Horror-SMB-R1-Distill-Llama-3.1-16B-GGUF

Text Generation • 16B • Updated Feb 10, 2025 • 17

MaziyarPanahi/Captain-Eris_Violet_Toxic-Magnum-12B-GGUF

Text Generation • 12B • Updated Feb 10, 2025 • 112 • 4

MaziyarPanahi/Qwen-2.5-7B-Exp-Sce-GGUF

Text Generation • 8B • Updated Feb 10, 2025 • 45

MaziyarPanahi/Slush-ChatWaifu-Chronos-GGUF

Text Generation • 12B • Updated Feb 10, 2025 • 38 • 1

MaziyarPanahi/Qwen2.5-7B-Gordion-v0.1-Prose-GGUF

Text Generation • 8B • Updated Feb 10, 2025 • 37

MaziyarPanahi/Llama-Krikri-8B-Instruct-GGUF

Text Generation • 8B • Updated Feb 10, 2025 • 104

ruslanmv/granite-3.1-2b-Reasoning-GGUF

Text Generation • 3B • Updated Feb 12, 2025 • 40

MaziyarPanahi/DarkIdol-LongWriter-8B-Uncensored-1048k-GGUF

Text Generation • 8B • Updated Feb 12, 2025 • 90 • 1

MaziyarPanahi/QVikhr-2.5-1.5B-Instruct-r-GGUF

Text Generation • 2B • Updated Feb 12, 2025 • 34

MaziyarPanahi/S1_4o_mini-GGUF

Text Generation • 8B • Updated Feb 12, 2025 • 43

MaziyarPanahi/Intelligence-Agent-7B-GGUF

Text Generation • 8B • Updated Feb 12, 2025 • 126

ruslanmv/granite-3.1-8b-Reasoning-GGUF

Text Generation • 8B • Updated Feb 12, 2025 • 48

MaziyarPanahi/german-r1-GGUF

Text Generation • 3B • Updated Feb 12, 2025 • 155 • 1

MaziyarPanahi/SAXON-0-GGUF

Text Generation • 8B • Updated Feb 12, 2025 • 159

MaziyarPanahi/Gemma-9B-Base-GGUF

Text Generation • 9B • Updated Feb 12, 2025 • 63

SicariusSicariiStuff/Phi-lthy4-5.0bpw

Text Generation • Updated Jul 26, 2025 • 8

MaziyarPanahi/Hiber-Multi-10B-Instruct-GGUF

Text Generation • 11B • Updated Feb 14, 2025 • 31

MaziyarPanahi/LlamaThink-8B-instruct-GGUF

Text Generation • 8B • Updated Feb 14, 2025 • 162

MaziyarPanahi/MT-Merge6-gemma-2-9B-GGUF

Text Generation • 9B • Updated Feb 14, 2025 • 58 • 1

MaziyarPanahi/Korean-QWEN-Coder2.5-14B-GGUF

Text Generation • 15B • Updated Feb 14, 2025 • 167

MaziyarPanahi/Viper-Coder-v1.1-GGUF

Text Generation • 15B • Updated Feb 14, 2025 • 63

MaziyarPanahi/DeepSeek-llama3.1-Bllossom-8B-GGUF

Text Generation • 8B • Updated Feb 14, 2025 • 72 • 1

MaziyarPanahi/Magellanic-Opus-14B-Exp-GGUF

Text Generation • 15B • Updated Feb 14, 2025 • 93

MaziyarPanahi/Kyro-n1-3B-GGUF

Text Generation • 3B • Updated Feb 14, 2025 • 69

MaziyarPanahi/MrRoboto-BASE-Unholy-8b-64k-GGUF

Text Generation • 8B • Updated Feb 14, 2025 • 149

MaziyarPanahi/Fino1-8B-GGUF

Text Generation • 8B • Updated Feb 14, 2025 • 85

MaziyarPanahi/To-the-end-of-this-earth-MN-12B-GGUF

Text Generation • 12B • Updated Feb 14, 2025 • 11 • 1

MaziyarPanahi/Llama_3.2_3b_Kermes_v2-GGUF

Text Generation • 3B • Updated Feb 14, 2025 • 54