Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

123

Base only

Active filters: rotorquant

majentik/Qwen3.6-35B-A3B-RotorQuant-MLX-8bit

Text Generation • 10B • Updated 10 days ago • 243

majentik/Qwen3.6-35B-A3B-RotorQuant-GGUF-Q8_0

Image-Text-to-Text • 35B • Updated 10 days ago • 188

majentik/Qwen3.6-35B-A3B-RotorQuant-GGUF-Q3_K_M

Image-Text-to-Text • 35B • Updated 10 days ago • 297 • 1

majentik/Qwen3.6-35B-A3B-RotorQuant-GGUF-Q2_K

Image-Text-to-Text • 35B • Updated 10 days ago • 493

majentik/Qwen3.6-35B-A3B-RotorQuant-GGUF-Q5_K_M

Image-Text-to-Text • 35B • Updated 10 days ago • 156 • 1

majentik/Qwen3.6-35B-A3B-RotorQuant-GGUF-IQ4_XS

Image-Text-to-Text • 35B • Updated 10 days ago • 181 • 5

majentik/Qwen3.6-35B-A3B-RotorQuant-GGUF-Q4_K_M

Image-Text-to-Text • 35B • Updated 10 days ago • 371 • 3

majentik/Qwen3.6-35B-A3B-RotorQuant-MLX-6bit

Text Generation • 8B • Updated 10 days ago • 354

majentik/Qwen3.6-35B-A3B-RotorQuant-MLX-5bit

Text Generation • 7B • Updated 10 days ago • 264

majentik/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-RotorQuant-GGUF-Q2_K

Image-Text-to-Text • 32B • Updated Jul 20 • 40 • 1

majentik/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-RotorQuant-MLX-MXFP4

Text Generation • 7B • Updated Jul 20 • 66

Semaj90/gemma4-legal-iq4xs-direct-gguf

8B • Updated Jun 30 • 20

majentik/gemma-4-12B-it-RotorQuant-MLX-MXFP4

Image-Text-to-Text • 2B • Updated Jul 17 • 16

majentik/gemma-4-12B-RotorQuant-MLX-8bit

Image-Text-to-Text • 3B • Updated Jul 20 • 71 • 1

majentik/gemma-4-12B-it-RotorQuant-GGUF-Q3_K_M

Text Generation • 12B • Updated Jul 20 • 2.08k • 1

majentik/gemma-4-12B-it-RotorQuant-GGUF-Q4_K_M

Text Generation • 12B • Updated Jul 20 • 97

majentik/gemma-4-12B-it-RotorQuant-GGUF-Q5_K_M

Text Generation • 12B • Updated Jul 20 • 431

majentik/gemma-4-12B-RotorQuant-GGUF-Q3_K_M

Text Generation • 12B • Updated Jul 20 • 49

majentik/Nemotron-Cascade-2-30B-A3B-RotorQuant-MLX-3bit

Text Generation • 32B • Updated Jul 18 • 23

majentik/Nemotron-Cascade-2-30B-A3B-RotorQuant-GGUF-Q8_0

Text Generation • 32B • Updated Jul 20 • 86

majentik/MiniCPM5-1B-RotorQuant-MLX-4bit

Text Generation • 0.2B • Updated Jul 18 • 10

majentik/MiniCPM5-1B-RotorQuant-MLX-8bit

Text Generation • 0.3B • Updated Jul 18 • 6

majentik/MiniCPM5-1B-RotorQuant-MLX-6bit

Text Generation • 0.2B • Updated Jul 18 • 10

majentik/MiniCPM5-1B-SFT-RotorQuant-MLX-6bit

Text Generation • 0.2B • Updated Jul 18 • 7

majentik/MiniCPM5-1B-SFT-RotorQuant-MLX-MXFP4

Text Generation • 0.2B • Updated Jul 18 • 5

majentik/MiniCPM5-1B-Base-RotorQuant-MLX-4bit

Text Generation • 0.2B • Updated Jul 18 • 9

majentik/MiniCPM5-1B-Base-RotorQuant-MLX-6bit

Text Generation • 0.2B • Updated Jul 18 • 7

majentik/MiniCPM5-1B-RotorQuant-GGUF-IQ4_XS

Text Generation • 1B • Updated Jul 20 • 11

majentik/MiniCPM5-1B-Base-RotorQuant-GGUF-Q8_0

Text Generation • 1B • Updated Jul 20 • 19

majentik/MiniCPM5-1B-Base-RotorQuant-GGUF-Q5_K_M

Text Generation • 1B • Updated Jul 20 • 9