Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

11,726

Base only

Active filters: quantized

shreyasmeher/ConflLlama-Alt

Text Classification • 8B • Updated Nov 19, 2024 • 15 • 1

MaziyarPanahi/NuExtract-1.5-smol-GGUF

Text Generation • 2B • Updated Nov 15, 2024 • 145 • 7

Guchyos/gemma-2b-elyza-task

Text Generation • 3B • Updated Nov 18, 2024

TheMelonGod/Llama-3.1-8B-ArliAI-RPMax-v1.3-exl2

Text Generation • Updated Dec 28, 2024 • 28

dwikitheduck/gen-sql-1-Q4_K_M-GGUF

8B • Updated Nov 18, 2024 • 1

MaziyarPanahi/Mistral-Large-Instruct-2411-GGUF

Text Generation • 123B • Updated Nov 20, 2024 • 95.3k • 2

argmaxinc/whisperkit-pro

Automatic Speech Recognition • Updated Oct 30, 2025 • 24.9k • 18

jsjeon/SummLlama3.2-3B-Q4_K_M-GGUF

Updated Nov 19, 2024

TheMelonGod/dolphin-2.9.4-llama3.1-8b-exl2

Text Generation • Updated Dec 28, 2024 • 34

RedHatAI/Sparse-Llama-3.1-8B-gsm8k-2of4-quantized.w4a16

Text Generation • 2B • Updated Dec 19, 2024 • 5

TheMelonGod/Llama-3.1-SuperNova-8B-Lite_TIES_with_Base-exl2

Text Generation • Updated Nov 23, 2024 • 2

TheMelonGod/NaturalLM-exl2

Text Generation • Updated Nov 24, 2024 • 1

TheMelonGod/dolphin-2.9.3-mistral-7B-32k-exl2

Text Generation • Updated Dec 17, 2024 • 35

dwikitheduck/gen-inst-1-Q4_K_M-GGUF

15B • Updated Nov 25, 2024

argmaxinc/speakerkit-pro

Automatic Speech Recognition • Updated Apr 8 • 40.5k • 19

RedHatAI/Qwen2.5-7B-Instruct-FP8-dynamic

Text Generation • 8B • Updated Jun 9 • 9.67k • 1

namannn/llama2-13b-hyperbolic-cluster-pruned

Text Generation • 10B • Updated Dec 2, 2024 • 3

SultanR/SmolTulu-1.7b-Instruct-GGUF

Text Generation • 2B • Updated Dec 1, 2024 • 4 • 2

TheMelonGod/MN-12B-Lyra-v4-exl2

Text Generation • Updated Dec 5, 2024 • 30

MaziyarPanahi/Sailor2-1B-Chat-GGUF

Text Generation • 1.0B • Updated Dec 3, 2024 • 160 • 4

MaziyarPanahi/Sailor2-8B-Chat-GGUF

Text Generation • 9B • Updated Dec 4, 2024 • 71 • 3

MaziyarPanahi/Sailor2-20B-Chat-GGUF

Text Generation • 19B • Updated Dec 4, 2024 • 271 • 2

MaziyarPanahi/magnum-twilight-12b-GGUF

Text Generation • 12B • Updated Dec 6, 2024 • 58

MaziyarPanahi/patricide-12B-Unslop-Mell-GGUF

Text Generation • 12B • Updated Dec 6, 2024 • 201

MaziyarPanahi/Capt-Dark-Science-12B-GGUF

Text Generation • 12B • Updated Dec 6, 2024 • 56

MaziyarPanahi/Ninja-V3-nsfw-enhance-GGUF

Text Generation • 7B • Updated Dec 6, 2024 • 352 • 1

MaziyarPanahi/Dark-Science-12B-GGUF

Text Generation • 12B • Updated Dec 6, 2024 • 26

MaziyarPanahi/SAINEMO-reMIX-GGUF

Text Generation • 12B • Updated Dec 6, 2024 • 11 • 1

MaziyarPanahi/RP-SAINEMO-GGUF

Text Generation • 12B • Updated Dec 6, 2024 • 17

MaziyarPanahi/UnslopNemo-v4.1-Magnum-v4-12B-GGUF

Text Generation • 12B • Updated Dec 6, 2024 • 80