nklockiewicz's picture
Add LFM3-1.7B MLX build (int4, Apple GPU) and update the notice
11f9ad8 verified
|
Raw History Blame Contribute Delete
643 Bytes
These files are modified derivatives of LiquidAI/LFM3-1.7B (LFM Open License v1.0, see LICENSE in this folder):
- `xnnpack/lfm3_1_7b_xnnpack_8da4w.pte`: the weights re-implemented for ExecuTorch export and quantized (linear layers int8 dynamic activations / int4 weights, group 128; embedding int8). CPU, iOS and Android.
- `mlx/lfm3_1_7b_mlx_4w.pte`: same export for the MLX backend (Apple GPU), bf16 compute with int4 weight-only linears and embedding, group 64.
- `tokenizer_config.json`: Liquid's tokenizer config with the contents of `chat_template.jinja` embedded as `chat_template`, unchanged otherwise.
- `tokenizer.json`: unchanged.