majentik/Nemotron-3-Nano-30B-A3B-RotorQuant-GGUF-IQ4_XS
Text Generation • 32B • Updated • 22
Nemotron — quantized
Quantized GGUF and MLX packs of the Nemotron 3 model family (Nano, Nano-Omni, Super).
-
-
majentik/Nemotron-3-Nano-30B-A3B-RotorQuant-GGUF-Q2_K
Text Generation • 32B • Updated • 28 -
majentik/Nemotron-3-Nano-30B-A3B-RotorQuant-GGUF-Q3_K_M
Text Generation • 32B • Updated • 22 -
majentik/Nemotron-3-Nano-30B-A3B-RotorQuant-GGUF-Q5_K_M
Text Generation • 32B • Updated • 20 -
majentik/Nemotron-3-Nano-30B-A3B-RotorQuant-GGUF-Q8_0
Text Generation • 32B • Updated • 32 -
majentik/Nemotron-3-Nano-30B-A3B-RotorQuant-MLX-4bit
Text Generation • 5B • Updated • 92 -
majentik/Nemotron-3-Nano-30B-A3B-RotorQuant-MLX-8bit
Text Generation • 9B • Updated • 44 -
majentik/Nemotron-3-Nano-30B-A3B-TurboQuant-GGUF-Q4_K_M
Text Generation • 32B • Updated • 9 • 1 -
majentik/Nemotron-3-Nano-30B-A3B-TurboQuant-MLX-2bit
Text Generation • 3B • Updated • 532 -
majentik/Nemotron-3-Nano-4B-RotorQuant-GGUF-IQ4_XS
Text Generation • 4B • Updated • 23 • 1 -
majentik/Nemotron-3-Nano-4B-RotorQuant-GGUF-Q2_K
Text Generation • 4B • Updated • 20 -
majentik/Nemotron-3-Nano-4B-RotorQuant-GGUF-Q3_K_M
Text Generation • 4B • Updated • 11 -
majentik/Nemotron-3-Nano-4B-RotorQuant-MLX-2bit
Text Generation • 0.4B • Updated • 437 -
majentik/Nemotron-3-Nano-4B-TurboQuant-GGUF-Q4_K_M
Text Generation • 4B • Updated • 56 -
majentik/Nemotron-3-Nano-4B-TurboQuant-MLX-4bit
Text Generation • 0.6B • Updated • 101 -
majentik/Nemotron-3-Nano-4B-TurboQuant-MLX-8bit
Text Generation • 1B • Updated • 93 -
majentik/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-RotorQuant-GGUF-Q2_K
Image-Text-to-Text • 32B • Updated • 40 • 1 -
majentik/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-RotorQuant-MLX-MXFP4
Text Generation • 7B • Updated • 66 -
majentik/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-TurboQuant-GGUF-IQ4_XS
Image-Text-to-Text • 32B • Updated • 44 • 1 -
majentik/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-TurboQuant-GGUF-MXFP4_MOE
Image-Text-to-Text • 32B • Updated • 87 -
majentik/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-TurboQuant-GGUF-Q3_K_M
Image-Text-to-Text • 32B • Updated • 41 -
majentik/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-TurboQuant-GGUF-Q4_K_M
Image-Text-to-Text • 32B • Updated • 37 -
majentik/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-TurboQuant-GGUF-Q5_K_M
Image-Text-to-Text • 32B • Updated • 34 -
majentik/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-TurboQuant-GGUF-Q8_0
Image-Text-to-Text • 32B • Updated • 72 • 1 -
majentik/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-TurboQuant-MLX-2bit
Text Generation • 4B • Updated • 332 -
majentik/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-TurboQuant-MLX-3bit
Text Generation • 5B • Updated • 319 -
majentik/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-TurboQuant-MLX-4bit
Text Generation • 6B • Updated • 89 -
majentik/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-TurboQuant-MLX-5bit
Text Generation • 7B • Updated • 333 -
majentik/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-TurboQuant-MLX-6bit
Text Generation • 8B • Updated • 374 -
majentik/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-TurboQuant-MLX-8bit
Text Generation • 10B • Updated • 244 -
majentik/Nemotron-3-Super-120B-A12B-RotorQuant-GGUF-Q6_K
Text Generation • 121B • Updated • 23 -
majentik/Nemotron-3-Super-120B-A12B-TurboQuant-GGUF-Q2_K
Text Generation • 121B • Updated • 40 -
majentik/Nemotron-3-Super-120B-A12B-TurboQuant-GGUF-Q3_K_M
Text Generation • 121B • Updated • 16