pipenetwork/Inkling-MLX-8bit
Image-Text-to-Text • 266B • Updated • 700
975B-A41B multimodal MoE on Apple Silicon. Text+image+audio. Ported from scratch: github.com/PipeNetwork/inkling-mlx
Note 937 GB · near-lossless · needs ~1 TB
Note 717 GB · high quality
Note 496 GB · RECOMMENDED unpruned build; runs on a 512 GB M3 Ultra, though near the memory cliff
Note 470 GB · 225/256 experts · ppl 3.806 vs 3.830 unpruned — free, vision 6/6, audio 0.88
Note 402 GB · 192/256 experts · +3.0% ppl · clears the 512 GB memory cliff with room to spare; vision 6/6, audio 0.87
Note 272 GB · 128/256 experts · +22% ppl, vision 5/6 — experimental