DreamFoundries/Laguna-S-2.1-4bit
Text Generation • 18B • Updated • 56
Laguna S 2.1 MLX Quantizations
MLX-LM Laguna S 2.1 quantizations. No comparative benchmarks are available yet. · Get MLXHub: mlxhub.app
Note Uniform 4-bit affine quantization. No comparative benchmarks available yet.
DreamFoundries/Laguna-S-2.1-6bit
Text Generation • 26B • Updated • 54Note Uniform 6-bit affine quantization. No comparative benchmarks available yet.
DreamFoundries/Laguna-S-2.1-8bit
Text Generation • 33B • Updated • 43Note Uniform 8-bit affine quantization. No comparative benchmarks available yet.
DreamFoundries/Laguna-S-2.1-8bit-Att-4bit-Ex
Text Generation • 19B • Updated • 50Note 8-bit attention/base weights with 4-bit routed experts. No comparative benchmarks available yet.
DreamFoundries/Laguna-S-2.1-8bit-Att-6bit-Ex
Text Generation • 26B • Updated • 99Note 8-bit attention/base weights with 6-bit routed experts. No comparative benchmarks available yet.