nklockiewicz commited on
Commit
11f9ad8
·
verified ·
1 Parent(s): 981b730

Add LFM3-1.7B MLX build (int4, Apple GPU) and update the notice

Browse files
.gitattributes CHANGED
@@ -52,3 +52,4 @@ sam3/coreml/sam3_vision2_672_coreml.pte filter=lfs diff=lfs merge=lfs -text
52
  sam3/coreml/sam3_vision3_672_coreml.pte filter=lfs diff=lfs merge=lfs -text
53
  lfm3/tokenizer.json filter=lfs diff=lfs merge=lfs -text
54
  lfm3/xnnpack/lfm3_1_7b_xnnpack_8da4w.pte filter=lfs diff=lfs merge=lfs -text
 
 
52
  sam3/coreml/sam3_vision3_672_coreml.pte filter=lfs diff=lfs merge=lfs -text
53
  lfm3/tokenizer.json filter=lfs diff=lfs merge=lfs -text
54
  lfm3/xnnpack/lfm3_1_7b_xnnpack_8da4w.pte filter=lfs diff=lfs merge=lfs -text
55
+ lfm3/mlx/lfm3_1_7b_mlx_4w.pte filter=lfs diff=lfs merge=lfs -text
lfm3/NOTICE.md CHANGED
@@ -1,5 +1,6 @@
1
  These files are modified derivatives of LiquidAI/LFM3-1.7B (LFM Open License v1.0, see LICENSE in this folder):
2
 
3
- - `xnnpack/lfm3_1_7b_xnnpack_8da4w.pte`: the weights re-implemented for ExecuTorch export and quantized (linear layers int8 dynamic activations / int4 weights, group 128; embedding int8).
 
4
  - `tokenizer_config.json`: Liquid's tokenizer config with the contents of `chat_template.jinja` embedded as `chat_template`, unchanged otherwise.
5
  - `tokenizer.json`: unchanged.
 
1
  These files are modified derivatives of LiquidAI/LFM3-1.7B (LFM Open License v1.0, see LICENSE in this folder):
2
 
3
+ - `xnnpack/lfm3_1_7b_xnnpack_8da4w.pte`: the weights re-implemented for ExecuTorch export and quantized (linear layers int8 dynamic activations / int4 weights, group 128; embedding int8). CPU, iOS and Android.
4
+ - `mlx/lfm3_1_7b_mlx_4w.pte`: same export for the MLX backend (Apple GPU), bf16 compute with int4 weight-only linears and embedding, group 64.
5
  - `tokenizer_config.json`: Liquid's tokenizer config with the contents of `chat_template.jinja` embedded as `chat_template`, unchanged otherwise.
6
  - `tokenizer.json`: unchanged.
lfm3/mlx/lfm3_1_7b_mlx_4w.pte ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:96df77d94a70194e619c4aa0e871662f724bf9836e85bfeec9d2d737550c6dcc
3
+ size 1066865408