Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

11,687

Base only

Active filters: quantized

MaziyarPanahi/MN-Tiramisu-12B-GGUF

Text Generation • 12B • Updated Nov 7, 2024 • 215 • 1

MaziyarPanahi/magnum-v4-12b-GGUF

Text Generation • 12B • Updated Nov 7, 2024 • 182

MaziyarPanahi/MN-GRAND-Gutenberg-Lyra4-Lyra-12B-MADNESS-GGUF

Text Generation • 12B • Updated Nov 7, 2024 • 8

MaziyarPanahi/Mistral-Nemo-Kurdish-Instruct-GGUF

Text Generation • 12B • Updated Nov 7, 2024 • 16

MaziyarPanahi/calme-3.1-instruct-3b-GGUF

Text Generation • 3B • Updated Nov 15, 2024 • 12 • 1

MaziyarPanahi/calme-3.2-instruct-3b-GGUF

Text Generation • 3B • Updated Nov 15, 2024 • 52

MaziyarPanahi/calme-3.3-instruct-3b-GGUF

Text Generation • 3B • Updated Nov 15, 2024 • 137 • 3

MaziyarPanahi/calme-3.1-baguette-3b-GGUF

Text Generation • 3B • Updated Nov 15, 2024 • 55

MaziyarPanahi/calme-3.2-baguette-3b-GGUF

Text Generation • 3B • Updated Nov 15, 2024 • 202

MaziyarPanahi/calme-3.3-baguette-3b-GGUF

Text Generation • 3B • Updated Nov 15, 2024 • 188

MaziyarPanahi/calme-3.1-qwenloi-3b-GGUF

Text Generation • 3B • Updated Nov 15, 2024 • 100 • 1

MaziyarPanahi/calme-3.2-qwenloi-3b-GGUF

Text Generation • 3B • Updated Nov 15, 2024 • 39

MaziyarPanahi/calme-3.3-qwenloi-3b-GGUF

Text Generation • 3B • Updated Nov 15, 2024 • 123

MaziyarPanahi/calme-3.1-llamaloi-3b-GGUF

Text Generation • 3B • Updated Nov 15, 2024 • 318

MaziyarPanahi/calme-3.2-llamaloi-3b-GGUF

Text Generation • 3B • Updated Nov 15, 2024 • 336 • 1

MaziyarPanahi/calme-3.3-llamaloi-3b-GGUF

Text Generation • 3B • Updated Nov 15, 2024 • 478

shreyasmeher/ConflLlama

Text Classification • 8B • Updated Jul 8, 2025 • 114 • 4

dwikitheduck/gen-try1-Q4_K_M-GGUF

15B • Updated Nov 11, 2024

fahmizainal17/Meta-Llama-3-8B-Instruct-fine-tuned

Text Generation • 8B • Updated Nov 13, 2024 • 2

AstroMLab/AstroSage-8B-GGUF

Text Generation • 8B • Updated Nov 16, 2024 • 66 • 3

RedHatAI/Sparse-Llama-3.1-8B-gsm8k-2of4-FP8-dynamic

Text Generation • 8B • Updated Dec 19, 2024 • 22 • 3

shreyasmeher/ConflLlama-Alt

Text Classification • 8B • Updated Nov 19, 2024 • 15 • 1

MaziyarPanahi/NuExtract-1.5-smol-GGUF

Text Generation • 2B • Updated Nov 15, 2024 • 143 • 7

Guchyos/gemma-2b-elyza-task

Text Generation • 3B • Updated Nov 18, 2024

TheMelonGod/Llama-3.1-8B-ArliAI-RPMax-v1.3-exl2

Text Generation • Updated Dec 28, 2024 • 28

dwikitheduck/gen-sql-1-Q4_K_M-GGUF

8B • Updated Nov 18, 2024 • 1

MaziyarPanahi/Mistral-Large-Instruct-2411-GGUF

Text Generation • 123B • Updated Nov 20, 2024 • 95.8k • 2

argmaxinc/whisperkit-pro

Automatic Speech Recognition • Updated Oct 30, 2025 • 25k • 18

jsjeon/SummLlama3.2-3B-Q4_K_M-GGUF

Updated Nov 19, 2024

TheMelonGod/dolphin-2.9.4-llama3.1-8b-exl2

Text Generation • Updated Dec 28, 2024 • 34