Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

weight-quantization

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

13

Base only

Active filters: weight-quantization

osmapi/sarvam-30b-TQ3_1S-GGUF

Text Generation • Updated Apr 2 • 10 • 2

AEON-7/Gemma-4-31B-it-DECKARD-HERETIC-Uncensored-NVFP4

Text Generation • 18B • Updated about 1 month ago • 2.71k • 10

AEON-7/Gemma-4-31B-it-DECKARD-HERETIC-Uncensored-NVFP4-SVDQuant

Text Generation • 19B • Updated about 1 month ago • 1.32k • 1

majentik/Leanstral-TurboQuant-MLX-2bit

23B • Updated 25 days ago • 126

majentik/Leanstral-RotorQuant-MLX-2bit

23B • Updated 25 days ago • 100

majentik/Leanstral-TurboQuant-MLX-8bit

Text Generation • 34B • Updated 25 days ago • 96

majentik/Leanstral-RotorQuant-MLX-8bit

Text Generation • 34B • Updated 25 days ago • 73

AEON-7/supergemma4-26b-abliterated-multimodal-nvfp4

Text Generation • 15B • Updated about 1 month ago • 513 • 4

majentik/Qwen3.5-397B-A17B-TurboQuant-MLX-4bit

Image-Text-to-Text • 62B • Updated Apr 16 • 162

majentik/Qwen3.5-397B-A17B-TurboQuant-MLX-2bit

Image-Text-to-Text • 38B • Updated Apr 16 • 120

majentik/Qwen3.5-397B-A17B-RotorQuant-MLX-2bit

Image-Text-to-Text • 38B • Updated Apr 16 • 101

majentik/Qwen3.5-397B-A17B-TurboQuant-MLX-8bit

Image-Text-to-Text • 112B • Updated Apr 16 • 123

majentik/Qwen3.5-397B-A17B-RotorQuant-MLX-8bit

Image-Text-to-Text • 112B • Updated Apr 16 • 140