Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

27

Base only

Active filters: fp8-kv-cache

minima-ai/mnma_qwen3.8_27b_nvfp4

Text Generation • 27B • Updated 13 days ago • 782 • 11

AEON-7/Gemma-4-26B-A4B-it-Uncensored-NVFP4

Text Generation • 15B • Updated Jul 15 • 38.4k • 24

AEON-7/Gemma-4-31B-it-DECKARD-HERETIC-Uncensored-NVFP4

Text Generation • 18B • Updated Jul 15 • 779 • 14

AEON-7/Nemotron-3-Nano-Omni-AEON-Ultimate-Uncensored-NVFP4

Any-to-Any • 20B • Updated Jul 15 • 690 • 9

namgyu-youn/EXAONE-4.0-1.2B-LLMC-AWQ-W4

1B • Updated Feb 18 • 3

rhoninseiei/Qwen3.5-27B-Claude-4.6-Opus-Reasoning-Distilled-ModelOpt-NVFP4

Image-Text-to-Text • 17B • Updated Mar 21 • 12 • 1

AEON-7/Gemma-4-31B-it-DECKARD-HERETIC-Uncensored-NVFP4-SVDQuant

Text Generation • 19B • Updated Jul 15 • 138 • 2

AEON-7/DFlash-Qwen3.5-27B-Uncensored-NVFP4

Text Generation • 17B • Updated Jun 28 • 122 • 2

AEON-7/supergemma4-26b-abliterated-multimodal-nvfp4

Text Generation • 15B • Updated Jul 15 • 133 • 6

AEON-7/Gemma-4-E4B-DECKARD-HERETIC-NVFP4

Text Generation • 6B • Updated Jun 21 • 159 • 1

AEON-7/Gemma-4-E4B-it-Uncensored-NVFP4

Text Generation • 6B • Updated Jul 15 • 939 • 4

AEON-7/Gemma-4-E4B-DECKARD-HERETIC-Uncensored-NVFP4

Text Generation • 6B • Updated Jul 15 • 94 • 1

AEON-7/gemma-4-31B-it-speculator.eagle3-NVFP4

Text Generation • 2B • Updated Jun 21 • 60 • 5

AEON-7/Qwen3.6-35B-A3B-heretic-NVFP4

Image-Text-to-Text • 21B • Updated Jul 15 • 526k • 73

murilonwt/granite-4.1-8b-NVFP4

Text Generation • 5B • Updated May 19

AEON-7/Gemma-4-12B-it-AEON-Abliterated-K4-NVFP4

Text Generation • 8B • Updated Jul 15 • 846 • 1

AEON-7/Gemma-4-12B-it-AEON-Abliterated-K4-NVFP4-FP8

Text Generation • 8B • Updated Jul 15 • 477

amanwalksdownthestreet/Hermes-4-70B-MXFP8-KV8

Text Generation • 73B • Updated Jul 3 • 9

spellbound-eng/hy3-spellbound-simpo-step151-nvfp4-c8

170B • Updated Jul 9

Ishowbackup/Nemotron-3-Nano-Omni-AEON-Ultimate-Uncensored-NVFP4

Any-to-Any • 18B • Updated Aug 13 • 16

SinclairSchneider/Apertus-v1.5-8B-W4A16-KV8-de

Text Generation • 9B • Updated 29 days ago • 558

SinclairSchneider/Apertus-v1.5-70B-FP8-KV8

Text Generation • 72B • Updated 27 days ago • 58

SinclairSchneider/Apertus-v1.5-70B-W4A16-KV8

Text Generation • 13B • Updated 27 days ago • 210

SinclairSchneider/Mistral-Medium-3.5-128B-W4A16-KV8

Text Generation • 22B • Updated 27 days ago • 850

abhishekchohan/Qwen3.8-27B-GPTQ-INT4-FP8KV

Image-Text-to-Text • 28B • Updated 21 days ago • 71.4k • 2

abhishekchohan/Qwen3.8-27B-AWQ-INT4-FP8KV

Image-Text-to-Text • 28B • Updated 21 days ago • 5.37k • 1

emee-ai/mnma_qwen3.8_27b_nvfp4

Text Generation • 27B • Updated 12 days ago • 292