Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

kv-cache-quantization

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

144

Base only

Active filters: kv-cache-quantization

majentik/gpt-oss-20b-RotorQuant-GGUF-Q3_K_M

Text Generation • 21B • Updated 10 days ago • 84

majentik/gpt-oss-20b-RotorQuant-GGUF-Q2_K

Text Generation • 21B • Updated 10 days ago • 141

majentik/gpt-oss-20b-RotorQuant-GGUF-IQ4_XS

Text Generation • 21B • Updated 10 days ago • 146

majentik/Nemotron-3-Super-120B-A12B-TurboQuant-GGUF-Q8_0

Text Generation • 121B • Updated Jul 20 • 13

majentik/MiniMax-M2.7-TurboQuant-MLX-3bit

Text Generation • 29B • Updated 10 days ago • 403

majentik/MiniMax-M2.7-TurboQuant-MLX-4bit

Text Generation • 36B • Updated 10 days ago • 154

majentik/MiniMax-M2.7-TurboQuant-MLX-5bit

Text Generation • 43B • Updated 10 days ago • 299 • 1

haifeng1976/gemma-4-E2B-it-RotorQuant-GGUF-Q3_K_M

Image-Text-to-Text • 5B • Updated Apr 16 • 6

haifeng1976/gemma-4-E2B-it-RotorQuant-GGUF-Q2_K

Image-Text-to-Text • 5B • Updated Apr 16 • 13

majentik/garden

Text Generation • Updated 20 days ago

majentik/Qwen3.6-35B-A3B-TurboQuant-MLX-4bit

Text Generation • 6B • Updated 10 days ago • 986 • 16

majentik/Qwen3.6-35B-A3B-RotorQuant-MLX-8bit

Text Generation • 10B • Updated 10 days ago • 243

majentik/Qwen3.6-35B-A3B-RotorQuant-GGUF-Q8_0

Image-Text-to-Text • 35B • Updated 10 days ago • 188

majentik/Qwen3.6-35B-A3B-RotorQuant-GGUF-Q3_K_M

Image-Text-to-Text • 35B • Updated 10 days ago • 297 • 1

majentik/Qwen3.6-35B-A3B-RotorQuant-GGUF-Q2_K

Image-Text-to-Text • 35B • Updated 10 days ago • 493

majentik/Qwen3.6-35B-A3B-RotorQuant-GGUF-Q5_K_M

Image-Text-to-Text • 35B • Updated 10 days ago • 156 • 1

majentik/Qwen3.6-35B-A3B-RotorQuant-GGUF-IQ4_XS

Image-Text-to-Text • 35B • Updated 10 days ago • 181 • 5

majentik/Qwen3.6-35B-A3B-RotorQuant-GGUF-Q4_K_M

Image-Text-to-Text • 35B • Updated 10 days ago • 371 • 3

majentik/Qwen3.6-35B-A3B-RotorQuant-MLX-6bit

Text Generation • 8B • Updated 10 days ago • 354

majentik/Qwen3.6-35B-A3B-RotorQuant-MLX-5bit

Text Generation • 7B • Updated 10 days ago • 264

majentik/Qwen3.6-35B-A3B-TurboQuant-MLX-3bit

Text Generation • 5B • Updated 10 days ago • 555 • 6

BananaMind/BananaMind-KV1-8M-2Bit-Experimental

Text Generation • 8.13M • Updated Jul 3 • 27 • 4

Ddavidich/LOMONOSOV-ZENIT-27B-1M-INDEV

Text Generation • 16B • Updated Jul 30 • 113 • 1

VAREQON/Nemotron-3-Nano-4B-RotorQuant-GGUF-Q2_K

Text Generation • 4B • Updated Jul 30 • 55 • 1