pipenetwork/Inkling-Small-MLX-8bit
Image-Text-to-Text • 74B • Updated • 66
Inkling-Small · MLX
276B-A12B multimodal MoE on Apple Silicon. Same code path as Inkling 975B. REAP-25 is free: github.com/PipeNetwork/inkling-mlx
Note 280 GB · ppl 5.569 · near-lossless
pipenetwork/Inkling-Small-MLX-6bit
Image-Text-to-Text • 58B • Updated • 58Note 214 GB · ppl 5.569 · no gain over 4-bit here
pipenetwork/Inkling-Small-MLX-4bit
Image-Text-to-Text • 41B • Updated • 112 • 1Note 148 GB · ppl 5.452 · RECOMMENDED — no measurable loss vs 8-bit
pipenetwork/Inkling-Small-MLX-REAP25-4bit
Image-Text-to-Text • 31B • Updated • 81 • 1Note 112 GB · 192/256 experts · FREE — no measurable text cost, vision 6/6, audio 0.896 vs 0.874 unpruned. Best build for a 128 GB Mac.
pipenetwork/Inkling-Small-MLX-3bit
Image-Text-to-Text • 33B • Updated • 83Note 116 GB · ppl 6.706 · +20% — experimental; loops and emits stray glyphs. Prefer REAP25 at this size.