Files changed (1) hide show
  1. README.md +49 -16
README.md CHANGED
@@ -10,17 +10,25 @@ tags:
10
  - edge
11
  - lfm2
12
  - text-generation
 
 
13
  pipeline_tag: text-generation
14
  ---
15
 
16
- # LFM2.5-230M — Torq build (Synaptics SL2619 NPU)
17
 
18
- Pre-compiled **Torq VMFB** build of LiquidAI's LFM2.5 230M text language model, ready
19
- to run on the Synaptics **SL2619** edge NPU. LFM2 is a hybrid architecture that
20
- combines short convolutions with grouped-query attention. The transformer runs on the
21
- NPU in bf16; the token embeddings run on the host CPU.
22
 
23
- ## Contents
 
 
 
 
 
 
 
 
24
 
25
  | File | Size | Role |
26
  |---|--:|---|
@@ -45,7 +53,7 @@ the 461 MB monolithic build):
45
 
46
  The `onnx/` export is provided for reference / portability to other runtimes.
47
 
48
- ## Model details
49
 
50
  - **Architecture:** LFM2 (`Lfm2ForCausalLM`) — hybrid short-convolution + grouped-query attention.
51
  - **Hidden size:** 1024 · **Layers:** 14 · **Attention heads:** 16 (8 KV heads, GQA) · **Intermediate size:** 2560.
@@ -53,16 +61,41 @@ The `onnx/` export is provided for reference / portability to other runtimes.
53
  - **Precision:** bf16 on the NPU.
54
  - **Target:** Synaptics SL2619, compiled with the Torq compiler.
55
 
56
- ## Quick start
 
 
 
 
 
 
 
 
 
 
 
57
 
58
- Runs on the Synaptics Torq runtime via
59
- [synaptics-torq/torq-examples](https://github.com/synaptics-torq/torq-examples). Place
60
- the model files in a directory and invoke the Torq LLM runner with either `model.vmfb`
61
- (monolithic) or `body.vmfb` + `lm_head.vmfb` (split, lower TTFT), alongside
62
- `token_embeddings.npy`, `config.json`, and `tokenizer.json`.
 
 
 
 
 
 
 
 
 
63
 
64
  ## License
65
 
66
- Derived from LiquidAI's LFM2.5 230M and distributed under LiquidAI's **LFM Open License
67
- v1.0** — see [LiquidAI on Hugging Face](https://huggingface.co/LiquidAI) for the full
68
- terms.
 
 
 
 
 
 
10
  - edge
11
  - lfm2
12
  - text-generation
13
+ base_model:
14
+ - LiquidAI/LFM2.5-230M
15
  pipeline_tag: text-generation
16
  ---
17
 
18
+ # LFM2.5-230M — Torq build (Synaptics SL2610-Series Torq NPU)
19
 
20
+ This repository provides compiled model files for LiquidAI's LFM2.5 230M text language model, ready
21
+ to run on the **Synaptics SL2610-series Torq NPU**.
 
 
22
 
23
+ ## Model Overview
24
+
25
+ LFM2.5-230M is a general-purpose text-only model. It is a hybrid architecture that combines short convolutions with grouped-query attention.
26
+
27
+ The transformer runs on the Torq NPU in bf16; the token embeddings run on the host CPU.
28
+
29
+ ## Model Features
30
+
31
+ ### Contents
32
 
33
  | File | Size | Role |
34
  |---|--:|---|
 
53
 
54
  The `onnx/` export is provided for reference / portability to other runtimes.
55
 
56
+ ### Model Details
57
 
58
  - **Architecture:** LFM2 (`Lfm2ForCausalLM`) — hybrid short-convolution + grouped-query attention.
59
  - **Hidden size:** 1024 · **Layers:** 14 · **Attention heads:** 16 (8 KV heads, GQA) · **Intermediate size:** 2560.
 
61
  - **Precision:** bf16 on the NPU.
62
  - **Target:** Synaptics SL2619, compiled with the Torq compiler.
63
 
64
+ ## Tested Platforms
65
+
66
+ - [Synaptics Astra™ Machina SL2619 2GB](https://www.synaptics.com/products/embedded-processors/astra-machina-foundation-series)
67
+
68
+ ## Metrics
69
+
70
+ | Platform | Model / Stage | Environment | NPU Clock | Inference Time | Infer / s |
71
+ | --------- | --------- | --------- | --------- | --------- | --------- |
72
+ | SL2619 2GB | LFM2.5-230M | Torq v2.0.0 | 1 GHz | TBD | 7.1 |
73
+
74
+
75
+ ## Deployment
76
 
77
+ The models have been tested with the following environment.
78
+
79
+ - Torq Compiler: *v2.0.0*
80
+ - Torq Runtime: *v2.0.0* included in Astra SDK release *scarthgap_6.12_v2.4.0*
81
+
82
+
83
+ ### Usage Tutorials / Example Apps
84
+
85
+ A usage example is provided in the [Torq Examples / LiquidAI-VLM](https://github.com/synaptics-torq/torq-examples/tree/main/liquidAI-VLM).
86
+
87
+ Check out the [README](https://github.com/synaptics-torq/torq-examples/blob/main/liquidAI-VLM/README.md) for instructions.
88
+
89
+ Usage Notes:
90
+ - Place the model files in a directory and invoke the Torq LLM runner with either `model.vmfb` (monolithic) or `body.vmfb` + `lm_head.vmfb` (split, lower TTFT), alongside `token_embeddings.npy`, `config.json`, and `tokenizer.json`.
91
 
92
  ## License
93
 
94
+ Thie files herein were derived from LiquidAI's LFM2.5 230M and distributed under LiquidAI's **LFM Open License v1.0** — see [LiquidAI on Hugging Face](https://huggingface.co/LiquidAI) for the full terms.
95
+
96
+ ## Learn More
97
+
98
+ - [Synaptics AI Developer Zone](https://developer.synaptics.com?utm_source=hf): Get started with documentation, tutorials and resources for your Edge AI journey.
99
+ - [Torq Compiler Documentation](https://synaptics-torq.github.io/torq-compiler/v/latest/): Learn more about the Torq compiler based on MLIR and IREE.
100
+ - [Synaptics Astra SDK](https://synaptics-astra.github.io/doc/v/latest/): Learn more about the Yocto Project-based Linux software available for Astra SL processors.
101
+ - [Astra Support Portal](https://synacsm.atlassian.net/servicedesk/customer/portal/543?utm_source=hf): Connect with our engineering team and community.