nklockiewicz's picture
Add LFM3-1.7B MLX build (int4, Apple GPU) and update the notice
11f9ad8 verified
|
Raw History Blame Contribute Delete
643 Bytes

These files are modified derivatives of LiquidAI/LFM3-1.7B (LFM Open License v1.0, see LICENSE in this folder):

  • xnnpack/lfm3_1_7b_xnnpack_8da4w.pte: the weights re-implemented for ExecuTorch export and quantized (linear layers int8 dynamic activations / int4 weights, group 128; embedding int8). CPU, iOS and Android.
  • mlx/lfm3_1_7b_mlx_4w.pte: same export for the MLX backend (Apple GPU), bf16 compute with int4 weight-only linears and embedding, group 64.
  • tokenizer_config.json: Liquid's tokenizer config with the contents of chat_template.jinja embedded as chat_template, unchanged otherwise.
  • tokenizer.json: unchanged.