Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,648

Base only

Active filters: bfloat16

ctranslate2-4you/whisper-large-v3-ct2-bfloat16

Automatic Speech Recognition • Updated Feb 28 • 31

DavidAU/MN-Rocinante-18.5B-v1.1-Story-Wizard-ED1-Instruct-GGUF

Text Generation • 19B • Updated Jul 28, 2025 • 349 • 9

DavidAU/MN-Magnum-v2.5-18.5B-kto-Story-Wizard-ED1-Instruct-GGUF

Text Generation • 19B • Updated Nov 14, 2024 • 204 • 5

DavidAU/MN-WORDSTORM-pt3-RCM-POV-Nightmare-18.5B-Instruct-GGUF

Text Generation • 19B • Updated Nov 14, 2024 • 554 • 6

John6666/flux-dev2pro-bf16-flux

Text-to-Image • 12B • Updated Aug 31, 2024 • 11 • 7

DavidAU/MN-WORDSTORM-pt4-RCM-Cliffhanger-18.5B-Instruct-GGUF

Text Generation • 19B • Updated Nov 14, 2024 • 200 • 7

DavidAU/MN-WORDSTORM-pt5-RCM-Extra-Intense-18.5B-Instruct-GGUF

Text Generation • 19B • Updated Jul 28, 2025 • 201 • 11

DavidAU/L3-Dark-Planet-8B-NEO-Imatrix-GGUF

Text Generation • 8B • Updated Jul 28, 2025 • 365 • 9

DavidAU/L3-Dark-Planet-Horror-City-8B-NEO-Imatrix-GGUF

Text Generation • 8B • Updated Jul 28, 2025 • 429 • 15

mradermacher/L3-Dark-Planet-8B-GGUF

8B • Updated Jun 3, 2025 • 70 • 2

mradermacher/L3-Dark-Planet-8B-i1-GGUF

8B • Updated Jun 3, 2025 • 188 • 3

John6666/sumeshiflux1s-v002e-bf16-flux

Text-to-Image • 12B • Updated Sep 8, 2024 • 4

DavidAU/Gemma-The-Writer-9B-GGUF

Text Generation • 9B • Updated Dec 18, 2025 • 900 • 52

DavidAU/Mistral-Small-Instruct-2409-22B-NEO-Imatrix-GGUF

Text Generation • 22B • Updated Jul 28, 2025 • 626 • 10

DriveHabits/FluxDev2

Text-to-Image • 12B • Updated Sep 23, 2024 • 1

DavidAU/Llama-3.2-1B-Instruct-NEO-SI-FI-GGUF

Text Generation • 1B • Updated Jul 28, 2025 • 1.29k • 15

DavidAU/Llama-3.2-3B-Instruct-NEO-WEE-HORROR-GGUF

Text Generation • 3B • Updated May 28, 2025 • 240 • 2

DavidAU/MN-GRAND-Gutenberg-Lyra4-Lyra-23.5B-GGUF

Text Generation • 23B • Updated Jun 12 • 2.58k • 29

DavidAU/MN-GRAND-Gutenberg-Lyra4-Lyra-23B-V2-GGUF

Text Generation • 23B • Updated Jul 28, 2025 • 263 • 22

DavidAU/MN-GRAND-Gutenberg-Lyra4-Lyra-12B-MADNESS-GGUF

Text Generation • 12B • Updated Jul 28, 2025 • 287 • 24

DavidAU/L3-DARKEST-PLANET-16.5B-GGUF

Text Generation • 17B • Updated Jun 12 • 1.97k • 93

DavidAU/L3-DARKEST-PLANET-16.5B

Text Generation • 17B • Updated Jun 2, 2025 • 16 • 6

mradermacher/L3-DARKEST-PLANET-16.5B-GGUF

17B • Updated Jun 3, 2025 • 108 • 2

mradermacher/L3-DARKEST-PLANET-16.5B-i1-GGUF

17B • Updated Jun 3, 2025 • 179 • 2

DavidAU/Gemma-The-Writer-J.GutenBerg-10B-GGUF

Text Generation • 10B • Updated Jul 28, 2025 • 395 • 13

ZeroXClem/Llama3.1-DarkStorm-Aspire-8B

Text Generation • 8B • Updated Oct 24, 2024 • 14 • 3

ZeroXClem/Llama3.1-DarkStorm-Aspire-8B-Q8_0-GGUF

Text Generation • 8B • Updated Oct 24, 2024 • 4 • 3

ZeroXClem/Llama3.1-DarkStorm-Aspire-8B-Q6_K-GGUF

Text Generation • 8B • Updated Oct 24, 2024 • 12 • 3

ZeroXClem/Llama3.1-DarkStorm-Aspire-8B-Q5_K_M-GGUF

Text Generation • 8B • Updated Oct 24, 2024 • 26 • 3

ZeroXClem/Llama3.1-DarkStorm-Aspire-8B-Q5_K_S-GGUF

Text Generation • 8B • Updated Oct 24, 2024 • 6 • 3