Paris99 commited on
Commit
f31a3d0
·
verified ·
1 Parent(s): 9bba054

Card: builds table and memory guidance

Browse files
Files changed (1) hide show
  1. README.md +1 -0
README.md CHANGED
@@ -29,6 +29,7 @@ Inkling 2 Mini is Thinking Machines' looped mixture-of-experts model: 26.4B para
29
  |---|---|---|---|---|---|
30
  | [netprojects/Inkling-2-Mini-MLX-4-8bit](https://huggingface.co/netprojects/Inkling-2-Mini-MLX-4-8bit) (recommended) | 20.2 GB + 0.64 GB draft | 98.6% | 0.0018 | 47/50 | 27.8 GB |
31
  | [netprojects/Inkling-2-Mini-MLX-3bit](https://huggingface.co/netprojects/Inkling-2-Mini-MLX-3bit) | 14.7 GB + 0.64 GB draft | 95.7% | 0.0421 | 48/50 | 21.2 GB |
 
32
 
33
  "Thinking Machines' code" is their Transformers implementation of Inkling 2 Mini, run on the released weights; the
34
  columns are explained under "What was checked".
 
29
  |---|---|---|---|---|---|
30
  | [netprojects/Inkling-2-Mini-MLX-4-8bit](https://huggingface.co/netprojects/Inkling-2-Mini-MLX-4-8bit) (recommended) | 20.2 GB + 0.64 GB draft | 98.6% | 0.0018 | 47/50 | 27.8 GB |
31
  | [netprojects/Inkling-2-Mini-MLX-3bit](https://huggingface.co/netprojects/Inkling-2-Mini-MLX-3bit) | 14.7 GB + 0.64 GB draft | 95.7% | 0.0421 | 48/50 | 21.2 GB |
32
+ | [netprojects/Inkling-2-Mini-MLX-2.5bit](https://huggingface.co/netprojects/Inkling-2-Mini-MLX-2.5bit) | 11.5 GB + 0.64 GB draft | 87.3% | 0.1904 | 45/50 | 18.2 GB |
33
 
34
  "Thinking Machines' code" is their Transformers implementation of Inkling 2 Mini, run on the released weights; the
35
  columns are explained under "What was checked".