Nemotron 3 MLX Quantizations

DreamFoundries 's Collections

updated 8 days ago

MLX-LM affine quantizations for Nemotron 3; see each model card for details.

DreamFoundries/NVIDIA-Nemotron-3-Super-120B-A12B-BF16-4bit

Text Generation • 121B • Updated 9 days ago • 139

Note 4-bit MLX-LM affine quantization of nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16. No comparative benchmarks yet.
DreamFoundries/NVIDIA-Nemotron-3-Super-120B-A12B-BF16-6bit

Text Generation • 121B • Updated 9 days ago • 156

Note 6-bit MLX-LM affine quantization of nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16. No comparative benchmarks yet.
DreamFoundries/NVIDIA-Nemotron-3-Super-120B-A12B-BF16-8bit

Text Generation • 121B • Updated 8 days ago • 545

Note 8-bit MLX-LM affine quantization of nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16. No comparative benchmarks yet.
DreamFoundries/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16-4bit

Text Generation • 32B • Updated 8 days ago • 103

Note 4-bit MLX-LM affine quantization of nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16. No comparative benchmarks yet.
DreamFoundries/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16-6bit

Text Generation • 32B • Updated 8 days ago • 98

Note 6-bit MLX-LM affine quantization of nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16. No comparative benchmarks yet.
DreamFoundries/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16-8bit

Text Generation • 32B • Updated 8 days ago • 200

Note 8-bit MLX-LM affine quantization of nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16. No comparative benchmarks yet.