majentik/Nemotron-3-Nano-30B-A3B-RotorQuant-GGUF-IQ4_XS
Text Generation • 32B • Updated • 217
Nemotron — quantized
Quantized GGUF and MLX packs of the Nemotron 3 model family (Nano, Nano-Omni, Super).
-
-
majentik/Nemotron-3-Nano-30B-A3B-RotorQuant-GGUF-Q2_K
Text Generation • 32B • Updated • 67 -
majentik/Nemotron-3-Nano-30B-A3B-RotorQuant-GGUF-Q3_K_M
Text Generation • 32B • Updated • 84 -
majentik/Nemotron-3-Nano-30B-A3B-RotorQuant-GGUF-Q5_K_M
Text Generation • 32B • Updated • 90 -
majentik/Nemotron-3-Nano-30B-A3B-RotorQuant-GGUF-Q8_0
Text Generation • 32B • Updated • 117 -
majentik/Nemotron-3-Nano-30B-A3B-RotorQuant-MLX-4bit
Text Generation • 5B • Updated • 35 -
majentik/Nemotron-3-Nano-30B-A3B-RotorQuant-MLX-8bit
Text Generation • 9B • Updated • 22 -
majentik/Nemotron-3-Nano-30B-A3B-TurboQuant-GGUF-Q4_K_M
Text Generation • 32B • Updated • 114 • 1 -
majentik/Nemotron-3-Nano-30B-A3B-TurboQuant-MLX-2bit
Text Generation • 3B • Updated • 103 -
majentik/Nemotron-3-Nano-4B-RotorQuant-GGUF-IQ4_XS
Text Generation • 4B • Updated • 210 • 1 -
majentik/Nemotron-3-Nano-4B-RotorQuant-GGUF-Q2_K
Text Generation • 4B • Updated • 128 -
majentik/Nemotron-3-Nano-4B-RotorQuant-GGUF-Q3_K_M
Text Generation • 4B • Updated • 100 -
majentik/Nemotron-3-Nano-4B-RotorQuant-MLX-2bit
Text Generation • 4B • Updated • 45 -
majentik/Nemotron-3-Nano-4B-TurboQuant-GGUF-Q4_K_M
Text Generation • 4B • Updated • 247 -
majentik/Nemotron-3-Nano-4B-TurboQuant-MLX-4bit
Text Generation • 4B • Updated • 49 -
majentik/Nemotron-3-Nano-4B-TurboQuant-MLX-8bit
Text Generation • 4B • Updated • 108 -
majentik/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-RotorQuant-GGUF-Q2_K
Image-Text-to-Text • 32B • Updated • 263 • 1 -
majentik/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-RotorQuant-MLX-MXFP4
Text Generation • 33B • Updated • 30 -
majentik/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-TurboQuant-GGUF-IQ4_XS
Image-Text-to-Text • 32B • Updated • 280 • 1 -
majentik/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-TurboQuant-GGUF-MXFP4_MOE
Image-Text-to-Text • 32B • Updated • 412 • 1 -
majentik/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-TurboQuant-GGUF-Q3_K_M
Image-Text-to-Text • 32B • Updated • 247 -
majentik/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-TurboQuant-GGUF-Q4_K_M
Image-Text-to-Text • 32B • Updated • 246 -
majentik/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-TurboQuant-GGUF-Q5_K_M
Image-Text-to-Text • 32B • Updated • 264 -
majentik/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-TurboQuant-GGUF-Q8_0
Image-Text-to-Text • 32B • Updated • 249 • 1 -
majentik/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-TurboQuant-MLX-2bit
Text Generation • 33B • Updated • 39 -
majentik/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-TurboQuant-MLX-3bit
Text Generation • 33B • Updated • 41 -
majentik/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-TurboQuant-MLX-4bit
Text Generation • 33B • Updated • 56 -
majentik/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-TurboQuant-MLX-5bit
Text Generation • 33B • Updated • 38 -
majentik/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-TurboQuant-MLX-6bit
Text Generation • 33B • Updated • 41 -
majentik/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-TurboQuant-MLX-8bit
Text Generation • 33B • Updated • 42 -
majentik/Nemotron-3-Super-120B-A12B-RotorQuant-GGUF-Q6_K
Text Generation • 121B • Updated • 93 -
majentik/Nemotron-3-Super-120B-A12B-TurboQuant-GGUF-Q2_K
Text Generation • 121B • Updated • 157 -
majentik/Nemotron-3-Super-120B-A12B-TurboQuant-GGUF-Q3_K_M
Text Generation • 121B • Updated • 140 • 1