Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

kv-cache-quantization

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

285

Base only

Active filters: kv-cache-quantization

majentik/gpt-oss-20b-RotorQuant-GGUF-Q2_K

Text Generation • Updated 25 days ago • 185

majentik/gpt-oss-20b-RotorQuant-GGUF-IQ4_XS

Text Generation • Updated 25 days ago • 199

majentik/gpt-oss-120b-TurboQuant-MLX-2bit

Text Generation • Updated 25 days ago

majentik/gpt-oss-120b-RotorQuant-MLX-4bit

Text Generation • 117B • Updated 25 days ago • 260

majentik/gpt-oss-120b-RotorQuant-GGUF-Q4_K_M

Text Generation • Updated 25 days ago • 268

majentik/gpt-oss-120b-RotorQuant-MLX-2bit

Text Generation • Updated 25 days ago

majentik/gpt-oss-120b-TurboQuant

Text Generation • Updated 25 days ago

majentik/gpt-oss-120b-RotorQuant

Text Generation • Updated 25 days ago

majentik/gpt-oss-120b-RotorQuant-GGUF-Q5_K_M

Text Generation • Updated 25 days ago • 198

majentik/gpt-oss-120b-RotorQuant-GGUF-Q8_0

Text Generation • Updated 25 days ago • 37

majentik/gpt-oss-120b-RotorQuant-GGUF-Q3_K_M

Text Generation • Updated 25 days ago • 200

majentik/gpt-oss-120b-RotorQuant-GGUF-Q2_K

Text Generation • Updated 25 days ago • 195

majentik/gpt-oss-120b-RotorQuant-GGUF-IQ4_XS

Text Generation • Updated 25 days ago • 195

majentik/Nemotron-3-Super-120B-A12B-TurboQuant-GGUF-Q8_0

Text Generation • 121B • Updated Apr 21 • 45

majentik/Qwen3.5-397B-A17B-TurboQuant

Image-Text-to-Text • Updated Apr 21

majentik/Qwen3.5-397B-A17B-RotorQuant

Image-Text-to-Text • Updated Apr 21

majentik/MiniMax-M2.7-TurboQuant-MLX-3bit

Text Generation • 229B • Updated 25 days ago • 562

majentik/MiniMax-M2.7-RotorQuant-MLX-3bit

Text Generation • 229B • Updated 25 days ago • 407

majentik/MiniMax-M2.7-TurboQuant-MLX-4bit

Text Generation • 229B • Updated 25 days ago • 516

majentik/MiniMax-M2.7-RotorQuant-MLX-4bit

Text Generation • 229B • Updated 25 days ago • 247

majentik/MiniMax-M2.7-TurboQuant-MLX-5bit

Text Generation • 229B • Updated 25 days ago • 854 • 1

majentik/MiniMax-M2.7-RotorQuant-MLX-5bit

Text Generation • 229B • Updated 25 days ago • 354

majentik/MiniMax-M2.7-TurboQuant

Text Generation • Updated 25 days ago

majentik/MiniMax-M2.7-RotorQuant

Text Generation • Updated 25 days ago

majentik/MiniMax-M2.7-TurboQuant-MLX-2bit

Text Generation • Updated 25 days ago

haifeng1976/gemma-4-E2B-it-RotorQuant-GGUF-Q3_K_M

Image-Text-to-Text • 5B • Updated Apr 16 • 64

haifeng1976/gemma-4-E2B-it-RotorQuant-GGUF-Q2_K

Image-Text-to-Text • 5B • Updated Apr 16 • 68

majentik/gemma-4-26B-A4B-it-RotorQuant-AWQ-4bit

Image-Text-to-Text • Updated 25 days ago

majentik/gemma-4-26B-A4B-it-RotorQuant-AWQ-8bit

Image-Text-to-Text • Updated 25 days ago

majentik/gemma-4-26B-A4B-it-TurboQuant-AWQ-4bit

Image-Text-to-Text • Updated 25 days ago • 1