msluszniak commited on
Commit
7cceb50
·
verified ·
1 Parent(s): f084973

Apply the model card standard

Browse files
Files changed (1) hide show
  1. README.md +69 -4
README.md CHANGED
@@ -13,12 +13,77 @@ tags:
13
  library_name: executorch
14
  ---
15
 
16
- # Introduction
17
 
18
- This repository hosts the **LFM2.5** model family for the [React Native ExecuTorch](https://www.npmjs.com/package/react-native-executorch) library. It includes a **quantized** version in `.pte` format, ready for use in the **ExecuTorch** runtime.
 
 
19
 
20
- If you'd like to run these models in your own ExecuTorch runtime, refer to the [official documentation](https://pytorch.org/executorch/stable/index.html) for setup instructions.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
21
 
22
  ## Compatibility
23
 
24
- If you intend to use this model outside of React Native ExecuTorch, make sure your runtime is compatible with the **ExecuTorch** version used to export the `.pte` files. For more details, see the compatibility note in the [ExecuTorch GitHub repository](https://github.com/pytorch/executorch/blob/11d1742fdeddcf05bc30a6cfac321d2a2e3b6768/runtime/COMPATIBILITY.md?plain=1#L4). If you work with React Native ExecuTorch, the constants from the library will guarantee compatibility with the runtime used behind the scenes.
 
 
 
 
 
 
 
 
 
 
 
13
  library_name: executorch
14
  ---
15
 
16
+ # lfm-2.5
17
 
18
+ This repository hosts the **lfm-2.5** models exported for the
19
+ [React Native ExecuTorch](https://www.npmjs.com/package/react-native-executorch)
20
+ library as ExecuTorch `.pte` programs, ready to run on device.
21
 
22
+ ## Variants
23
+
24
+ | Path | Backend | Precision |
25
+ | --- | --- | --- |
26
+ | `1_2b/mlx/lfm_2_5_1_2b_mlx_int4.pte` | mlx | 4w |
27
+ | `1_2b/xnnpack/lfm_2_5_1_2b_xnnpack_8da4w.pte` | xnnpack | 8da4w |
28
+ | `1_2b/xnnpack/lfm_2_5_1_2b_xnnpack_fp16.pte` | xnnpack | fp16 |
29
+ | `350m/mlx/lfm_2_5_350m_mlx_int4.pte` | mlx | 4w |
30
+ | `350m/xnnpack/lfm_2_5_350m_xnnpack_8da4w.pte` | xnnpack | 8da4w |
31
+ | `350m/xnnpack/lfm_2_5_350m_xnnpack_fp16.pte` | xnnpack | fp16 |
32
+ | `vl_1_6b/mlx/lfm_2_5_vl_1_6b_mlx_int4.pte` | mlx | int4 |
33
+ | `vl_1_6b/mlx/lfm_2_5_vl_1_6b_mlx_int8.pte` | mlx | int8 |
34
+ | `vl_1_6b/vulkan/lfm_2_5_vl_1_6b_vulkan_8da4w.pte` | vulkan | 8da4w |
35
+ | `vl_1_6b/xnnpack/lfm_2_5_vl_1_6b_xnnpack_8da4w.pte` | xnnpack | 8da4w |
36
+ | `vl_450m/mlx/lfm_2_5_vl_450m_mlx_int4.pte` | mlx | int4 |
37
+ | `vl_450m/vulkan/lfm_2_5_vl_450m_vulkan_8da4w.pte` | vulkan | 8da4w |
38
+ | `vl_450m/xnnpack/lfm_2_5_vl_450m_xnnpack_8da4w.pte` | xnnpack | 8da4w |
39
+
40
+ ## Repository structure
41
+
42
+ ```
43
+ 1_2b/mlx/config.json 1.2 kB
44
+ 1_2b/mlx/lfm_2_5_1_2b_mlx_int4.pte 849 MB
45
+ 1_2b/tokenizer.json 4.5 MB
46
+ 1_2b/tokenizer_config.json 92.4 kB
47
+ 1_2b/xnnpack/config.json 2.1 kB
48
+ 1_2b/xnnpack/lfm_2_5_1_2b_xnnpack_8da4w.pte 759 MB
49
+ 1_2b/xnnpack/lfm_2_5_1_2b_xnnpack_fp16.pte 2.4 GB
50
+ 350m/mlx/config.json 1.2 kB
51
+ 350m/mlx/lfm_2_5_350m_mlx_int4.pte 308 MB
52
+ 350m/tokenizer.json 4.5 MB
53
+ 350m/tokenizer_config.json 2.9 kB
54
+ 350m/xnnpack/config.json 2.1 kB
55
+ 350m/xnnpack/lfm_2_5_350m_xnnpack_8da4w.pte 265 MB
56
+ 350m/xnnpack/lfm_2_5_350m_xnnpack_fp16.pte 806 MB
57
+ config.json 29 B
58
+ vl_1_6b/mlx/config.json 1.7 kB
59
+ vl_1_6b/mlx/lfm_2_5_vl_1_6b_mlx_int4.pte 1.4 GB
60
+ vl_1_6b/mlx/lfm_2_5_vl_1_6b_mlx_int8.pte 2.0 GB
61
+ vl_1_6b/tokenizer.json 4.5 MB
62
+ vl_1_6b/tokenizer_config.json 3.2 kB
63
+ vl_1_6b/vulkan/config.json 2.1 kB
64
+ vl_1_6b/vulkan/lfm_2_5_vl_1_6b_vulkan_8da4w.pte 2.4 GB
65
+ vl_1_6b/xnnpack/config.json 2.1 kB
66
+ vl_1_6b/xnnpack/lfm_2_5_vl_1_6b_xnnpack_8da4w.pte 2.3 GB
67
+ vl_450m/mlx/config.json 1.0 kB
68
+ vl_450m/mlx/lfm_2_5_vl_450m_mlx_int4.pte 376 MB
69
+ vl_450m/tokenizer.json 4.5 MB
70
+ vl_450m/tokenizer_config.json 3.2 kB
71
+ vl_450m/vulkan/config.json 2.1 kB
72
+ vl_450m/vulkan/lfm_2_5_vl_450m_vulkan_8da4w.pte 626 MB
73
+ vl_450m/xnnpack/config.json 2.1 kB
74
+ vl_450m/xnnpack/lfm_2_5_vl_450m_xnnpack_8da4w.pte 619 MB
75
+ ```
76
 
77
  ## Compatibility
78
 
79
+ These files are published for the **ExecuTorch v1.4.1** runtime. ExecuTorch
80
+ gives no forward compatibility guarantee, so an older runtime may fail to load
81
+ them.
82
+
83
+ To use them in React Native ExecuTorch, pass the model constant shipped in the
84
+ library's model registry to the corresponding task pipeline. See the
85
+ [documentation](https://docs.swmansion.com/react-native-executorch/docs/fundamentals/loading-models).
86
+
87
+ To load these files in your own ExecuTorch runtime, read the
88
+ [compatibility note](https://github.com/pytorch/executorch/blob/main/runtime/COMPATIBILITY.md)
89
+ first.