Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

11,693

Base only

Active filters: quantized

TheMelonGod/Llama-3.1-SuperNova-8B-Lite_TIES_with_Base-exl2

Text Generation • Updated Nov 23, 2024 • 2

TheMelonGod/NaturalLM-exl2

Text Generation • Updated Nov 24, 2024 • 1

TheMelonGod/dolphin-2.9.3-mistral-7B-32k-exl2

Text Generation • Updated Dec 17, 2024 • 35

dwikitheduck/gen-inst-1-Q4_K_M-GGUF

15B • Updated Nov 25, 2024

argmaxinc/speakerkit-pro

Automatic Speech Recognition • Updated Apr 8 • 40.5k • 19

RedHatAI/Qwen2.5-7B-Instruct-FP8-dynamic

Text Generation • 8B • Updated Jun 9 • 9.67k • 1

namannn/llama2-13b-hyperbolic-cluster-pruned

Text Generation • 10B • Updated Dec 2, 2024 • 3

SultanR/SmolTulu-1.7b-Instruct-GGUF

Text Generation • 2B • Updated Dec 1, 2024 • 4 • 2

TheMelonGod/MN-12B-Lyra-v4-exl2

Text Generation • Updated Dec 5, 2024 • 30

MaziyarPanahi/Sailor2-1B-Chat-GGUF

Text Generation • 1.0B • Updated Dec 3, 2024 • 160 • 4

MaziyarPanahi/Sailor2-8B-Chat-GGUF

Text Generation • 9B • Updated Dec 4, 2024 • 71 • 3

MaziyarPanahi/Sailor2-20B-Chat-GGUF

Text Generation • 19B • Updated Dec 4, 2024 • 271 • 2

MaziyarPanahi/magnum-twilight-12b-GGUF

Text Generation • 12B • Updated Dec 6, 2024 • 58

MaziyarPanahi/patricide-12B-Unslop-Mell-GGUF

Text Generation • 12B • Updated Dec 6, 2024 • 201

MaziyarPanahi/Capt-Dark-Science-12B-GGUF

Text Generation • 12B • Updated Dec 6, 2024 • 56

MaziyarPanahi/Ninja-V3-nsfw-enhance-GGUF

Text Generation • 7B • Updated Dec 6, 2024 • 352 • 1

MaziyarPanahi/Dark-Science-12B-GGUF

Text Generation • 12B • Updated Dec 6, 2024 • 26

MaziyarPanahi/SAINEMO-reMIX-GGUF

Text Generation • 12B • Updated Dec 6, 2024 • 11 • 1

MaziyarPanahi/RP-SAINEMO-GGUF

Text Generation • 12B • Updated Dec 6, 2024 • 17

MaziyarPanahi/UnslopNemo-v4.1-Magnum-v4-12B-GGUF

Text Generation • 12B • Updated Dec 6, 2024 • 80

MaziyarPanahi/Llama-3.3-70B-Instruct-GGUF

Text Generation • 71B • Updated Dec 7, 2024 • 105k • 21

MaziyarPanahi/IceDrunkenCherryRP-7b-GGUF

Text Generation • 7B • Updated Dec 6, 2024 • 13

MaziyarPanahi/MN-SlushoMix-GGUF

Text Generation • 12B • Updated Dec 6, 2024 • 24

MaziyarPanahi/Chatty-Harry_V3.0-GGUF

Text Generation • 12B • Updated Dec 6, 2024 • 13

MaziyarPanahi/MN-Slush-GGUF

Text Generation • 12B • Updated Dec 6, 2024 • 27

MaziyarPanahi/AbominationScience-12B-v4-GGUF

Text Generation • 12B • Updated Dec 7, 2024 • 33

MaziyarPanahi/NaturalLM-GGUF

Text Generation • 12B • Updated Dec 7, 2024 • 10

MaziyarPanahi/MN-Violet-Lotus-12B-GGUF

Text Generation • 12B • Updated Dec 7, 2024 • 354 • 1

MaziyarPanahi/Prismatic-12b-v0.1-Experimental-1115-GGUF

Text Generation • 12B • Updated Dec 7, 2024 • 20

MaziyarPanahi/Mistral-2.5-Prima-Hercules-Fusion-7B-GGUF

Text Generation • 7B • Updated Dec 7, 2024 • 5