Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

weight-quantization

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

24

Base only

Active filters: weight-quantization

AEON-7/Qwen3.6-35B-A3B-heretic-NVFP4

Image-Text-to-Text • 21B • Updated about 8 hours ago • 219k • 60

AEON-7/Gemma-4-26B-A4B-it-Uncensored-NVFP4

Text Generation • 15B • Updated about 8 hours ago • 74.8k • 22

AEON-7/Gemma-4-31B-it-DECKARD-HERETIC-Uncensored-NVFP4

Text Generation • 18B • Updated about 8 hours ago • 2.54k • 11

AEON-7/Nemotron-3-Nano-Omni-AEON-Ultimate-Uncensored-NVFP4

Any-to-Any • 20B • Updated about 8 hours ago • 3.09k • 9

osmapi/sarvam-30b-TQ3_1S-GGUF

Text Generation • Updated Apr 2 • 15 • 2

AEON-7/Gemma-4-31B-it-DECKARD-HERETIC-Uncensored-NVFP4-SVDQuant

Text Generation • 19B • Updated about 8 hours ago • 590 • 2

AEON-7/DFlash-Qwen3.5-27B-Uncensored-NVFP4

Text Generation • 17B • Updated 18 days ago • 641 • 2

majentik/Leanstral-TurboQuant-MLX-2bit

Text Generation • 23B • Updated 1 day ago • 158

majentik/Leanstral-RotorQuant-MLX-2bit

Text Generation • 23B • Updated 1 day ago • 86

majentik/Leanstral-TurboQuant-MLX-8bit

Text Generation • 34B • Updated 1 day ago • 85

majentik/Leanstral-RotorQuant-MLX-8bit

Text Generation • 34B • Updated 1 day ago • 35

AEON-7/supergemma4-26b-abliterated-multimodal-nvfp4

Text Generation • 15B • Updated about 8 hours ago • 353 • 6

AEON-7/Gemma-4-E4B-DECKARD-HERETIC-NVFP4

Text Generation • 6B • Updated 25 days ago • 60.7k • 1

AEON-7/Gemma-4-E4B-it-Uncensored-NVFP4

Text Generation • 6B • Updated about 8 hours ago • 164 • 3

AEON-7/Gemma-4-E4B-DECKARD-HERETIC-Uncensored-NVFP4

Text Generation • 6B • Updated about 8 hours ago • 141 • 1

majentik/Qwen3.5-397B-A17B-TurboQuant-MLX-4bit

Image-Text-to-Text • 62B • Updated 1 day ago • 65

majentik/Qwen3.5-397B-A17B-TurboQuant-MLX-2bit

Image-Text-to-Text • 38B • Updated Apr 16 • 82

majentik/Qwen3.5-397B-A17B-RotorQuant-MLX-2bit

Image-Text-to-Text • 38B • Updated Apr 16 • 100

majentik/Qwen3.5-397B-A17B-TurboQuant-MLX-8bit

Image-Text-to-Text • 112B • Updated 1 day ago • 71 • 1

majentik/Qwen3.5-397B-A17B-RotorQuant-MLX-8bit

Image-Text-to-Text • 112B • Updated 1 day ago • 48

AEON-7/gemma-4-31B-it-speculator.eagle3-NVFP4

Text Generation • 2B • Updated 25 days ago • 335 • 5

AEON-7/Step-3.7-Flash-AEON-Ultimate-Abliterated-NVFP4

Image-Text-to-Text • 104B • Updated 25 days ago • 84 • 5

AEON-7/Gemma-4-12B-it-AEON-Abliterated-K4-NVFP4

Text Generation • 8B • Updated about 8 hours ago • 413 • 1

AEON-7/Gemma-4-12B-it-AEON-Abliterated-K4-NVFP4-FP8

Text Generation • 8B • Updated about 8 hours ago • 3.3k