imadreamerboy/antares-350m-bf16-mlx
Text Generation • 0.4B • Updated • 3
Antares MLX
Directly loadable Apple silicon MLX-LM conversions of Antares-350M and Antares-1B in BF16, 8-bit, 6-bit, 4-bit, and 3-bit formats.
Note Antares-350M BF16 MLX.
imadreamerboy/antares-350m-8bit-mlx
Text Generation • 99.1M • Updated • 7Note Antares-350M 8-bit affine MLX, group size 64.
imadreamerboy/antares-350m-6bit-mlx
Text Generation • 77.1M • Updated • 3Note Antares-350M 6-bit affine MLX, group size 64.
imadreamerboy/antares-350m-4bit-mlx
Text Generation • 55.1M • Updated • 8Note Antares-350M 4-bit affine MLX, group size 64.
imadreamerboy/antares-350m-3bit-mlx
Text Generation • 44.1M • Updated • 3Note Antares-350M 3-bit affine MLX, group size 64.
imadreamerboy/antares-1b-bf16-mlx
Text Generation • 2B • Updated • 3Note Antares-1B BF16 MLX.
imadreamerboy/antares-1b-8bit-mlx
Text Generation • 0.5B • Updated • 3Note Antares-1B 8-bit affine MLX, group size 64.
imadreamerboy/antares-1b-6bit-mlx
Text Generation • 0.4B • Updated • 3Note Antares-1B 6-bit affine MLX, group size 64.
imadreamerboy/antares-1b-4bit-mlx
Text Generation • 0.3B • Updated • 3Note Antares-1B 4-bit affine MLX, group size 64.
imadreamerboy/antares-1b-3bit-mlx
Text Generation • 0.2B • Updated • 3Note Antares-1B 3-bit affine MLX, group size 64.