software-mansion/react-native-executorch-lfm2.5-1.2B-instruct

Introduction

This repository hosts the LFM2.5-1.2B-Instruct model for the React Native ExecuTorch library. It includes quantized version of it in .pte format, ready for use in the ExecuTorch runtime.

If you'd like to run these models in your own ExecuTorch runtime, refer to the official documentation for setup instructions.

Compatibility

If you intend to use this model outside of React Native ExecuTorch, make sure your runtime is compatible with the ExecuTorch version used to export the .pte files. For more details, see the compatibility note in the ExecuTorch GitHub repository. If you work with React Native ExecuTorch, the constants from the library will guarantee compatibility with runtime used behind the scenes.

Repository Structure

The repository is organized as follows:

• The .pte file should be passed to the modelSource parameter.
• The tokenizer for the models is available within the repo root, under tokenizer.json and tokenizer_config.json