MLX conversions of IFM K2-Horizon model family
mlx-community/K2-Horizon-MoVA-36B-A4B-bf16
Text Generation • 37B • Updated • 154
Note Unquantized bf16, 70 GB. For 128 GB Macs.
mlx-community/K2-Horizon-MoVA-36B-A4B-8bit
Text Generation • 37B • Updated • 187
• 1
Note 8-bit, 37 GB, effectively lossless (+0.04% ppl).
mlx-community/K2-Horizon-MoVA-36B-A4B-4bit
Text Generation • 37B • Updated • 388
• 5
Note Mixed 4-bit, 25 GB (+1.2% ppl). For 48 GB+ Macs.
mlx-community/K2-Horizon-7B-bf16
Text Generation • 9B • Updated • 100
Note 7B dense, unquantized bf16, 18 GB. For 32 GB+ Macs.
mlx-community/K2-Horizon-7B-8bit
Text Generation • 9B • Updated • 116
• 1
Note 7B dense, 8-bit, 9.6 GB, effectively lossless (+0.2% ppl).
mlx-community/K2-Horizon-7B-4bit
Text Generation • 9B • Updated • 416
• 1
Note 7B dense, mixed 4-bit, 7.2 GB (+4.5% ppl). For 16 GB+ Macs.
mlx-community/K2-Horizon-3.7B-bf16
Text Generation • 5B • Updated • 106
Note 3.7B dense, unquantized bf16, 10 GB. For 24 GB+ Macs.
mlx-community/K2-Horizon-3.7B-8bit
Text Generation • 5B • Updated • 122
Note 3.7B dense, 8-bit, 5.4 GB, effectively lossless (-0.04% ppl).
mlx-community/K2-Horizon-3.7B-4bit
Text Generation • 5B • Updated • 508
Note 3.7B dense, mixed 4-bit, 4.2 GB (+4.4% ppl). For 16 GB+ Macs.
mlx-community/K2-Horizon-0.9B-bf16
Text Generation • 1B • Updated • 67
Note 0.9B dense (YaRN, 128K context), unquantized bf16, 2.2 GB.
mlx-community/K2-Horizon-0.9B-8bit
Text Generation • 1B • Updated • 127
Note 0.9B dense, 8-bit, 1.2 GB, effectively lossless (+0.3% ppl).
mlx-community/K2-Horizon-0.9B-4bit
Text Generation • 1B • Updated • 71
Note 0.9B dense, mixed 4-bit, 0.9 GB (+5.6% ppl).