Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

kv-cache-quantization

Mixture of Experts

4-bit precision

8-bit precision

Carbon Emissions

Models

142

Base only

Active filters: kv-cache-quantization

majentik/Nemotron-3-Nano-30B-A3B-RotorQuant-GGUF-Q2_K

Text Generation • 32B • Updated about 1 month ago • 30

majentik/Nemotron-3-Nano-30B-A3B-RotorQuant-GGUF-IQ4_XS

Text Generation • 32B • Updated about 1 month ago • 57

majentik/Nemotron-3-Nano-4B-RotorQuant-GGUF-Q3_K_M

Text Generation • 4B • Updated about 1 month ago • 59

majentik/Nemotron-3-Nano-4B-RotorQuant-GGUF-Q2_K

Text Generation • 4B • Updated about 1 month ago • 64

majentik/Nemotron-3-Nano-4B-RotorQuant-GGUF-IQ4_XS

Text Generation • 4B • Updated about 1 month ago • 48 • 1

majentik/Nemotron-3-Nano-30B-A3B-TurboQuant-GGUF-Q4_K_M

Text Generation • 32B • Updated about 1 month ago • 68 • 1

majentik/Nemotron-3-Nano-4B-TurboQuant-GGUF-Q4_K_M

Text Generation • 4B • Updated about 1 month ago • 201

majentik/Nemotron-3-Super-120B-A12B-TurboQuant-GGUF-Q2_K

Text Generation • 121B • Updated about 1 month ago • 114

majentik/Nemotron-3-Super-120B-A12B-TurboQuant-GGUF-Q3_K_M

Text Generation • 121B • Updated about 1 month ago • 97 • 1

majentik/Nemotron-3-Super-120B-A12B-TurboQuant-GGUF-Q4_K_M

Text Generation • 121B • Updated about 1 month ago • 87 • 1

majentik/Nemotron-3-Super-120B-A12B-TurboQuant-GGUF-Q5_K_M

Text Generation • 121B • Updated about 1 month ago • 51

majentik/Nemotron-3-Super-120B-A12B-RotorQuant-GGUF-Q6_K

Text Generation • 121B • Updated about 1 month ago • 44

majentik/gpt-oss-20b-TurboQuant-MLX-4bit

Text Generation • 21B • Updated Aug 20 • 376 • 2

majentik/gpt-oss-20b-TurboQuant-MLX-8bit

Text Generation • 21B • Updated Aug 20 • 238

majentik/gpt-oss-20b-TurboQuant-MLX-2bit

Text Generation • 21B • Updated Aug 20 • 256

majentik/gpt-oss-20b-RotorQuant-GGUF-Q4_K_M

Text Generation • 21B • Updated about 1 month ago • 169

majentik/gpt-oss-120b-TurboQuant-MLX-4bit

Text Generation • 117B • Updated Aug 22 • 524 • 1

majentik/gpt-oss-20b-RotorQuant-GGUF-Q5_K_M

Text Generation • 21B • Updated about 1 month ago • 106

majentik/gpt-oss-20b-RotorQuant-GGUF-Q8_0

Text Generation • 21B • Updated about 1 month ago • 84

majentik/gpt-oss-20b-RotorQuant-GGUF-Q3_K_M

Text Generation • 21B • Updated about 1 month ago • 107

majentik/gpt-oss-20b-RotorQuant-GGUF-Q2_K

Text Generation • 21B • Updated about 1 month ago • 53

majentik/gpt-oss-20b-RotorQuant-GGUF-IQ4_XS

Text Generation • 21B • Updated about 1 month ago • 175

majentik/Nemotron-3-Super-120B-A12B-TurboQuant-GGUF-Q8_0

Text Generation • 121B • Updated about 1 month ago • 60

majentik/MiniMax-M2.7-TurboQuant-MLX-3bit

Text Generation • 229B • Updated Aug 20 • 110

majentik/MiniMax-M2.7-TurboQuant-MLX-4bit

Text Generation • 229B • Updated Aug 20 • 58

majentik/MiniMax-M2.7-TurboQuant-MLX-5bit

Text Generation • 229B • Updated Aug 20 • 64 • 1

haifeng1976/gemma-4-E2B-it-RotorQuant-GGUF-Q3_K_M

Image-Text-to-Text • 5B • Updated Apr 16 • 34

haifeng1976/gemma-4-E2B-it-RotorQuant-GGUF-Q2_K

Image-Text-to-Text • 5B • Updated Apr 16 • 34

majentik/garden

Text Generation • Updated 11 days ago

majentik/Qwen3.6-35B-A3B-TurboQuant-MLX-4bit

Text Generation • 35B • Updated Aug 20 • 421 • 16