Instructions to use mlboydaisuke/OLMo-2-1B-Instruct-LiteRT with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- LiteRT-LM
How to use mlboydaisuke/OLMo-2-1B-Instruct-LiteRT with LiteRT-LM:
# LiteRT-LM runs on various platforms (Android, iOS, Windows, Linux, macOS, IoT, Web/WASM) # and supports many APIs (C++, Python, Kotlin, Swift, JavaScript, Flutter). # For platform-specific integration guides, please refer to the official developer website: # https://ai.google.dev/edge/litert-lm # To try LiteRT-LM, the easiest way is to use our CLI tool. # 1. Install the LiteRT-LM CLI tool: pip install -U litert-lm # 2. Download and run this model locally: # See: https://ai.google.dev/edge/litert-lm/cli litert-lm run \ --from-huggingface-repo=mlboydaisuke/OLMo-2-1B-Instruct-LiteRT \ --prompt="Write me a poem"
- LiteRT
How to use mlboydaisuke/OLMo-2-1B-Instruct-LiteRT with LiteRT:
# No code snippets available yet for this library. # To use this model, check the repository files and the library's documentation. # Want to help? PRs adding snippets are welcome at: # https://github.com/huggingface/huggingface.js
- Notebooks
- Google Colab
- Kaggle
Document Gallery 1.0.16 direct Hugging Face import + desktop LiteRT-LM CLI (serve/run)
Browse files
README.md
CHANGED
|
@@ -49,6 +49,8 @@ so no separate tokenizer files are needed.
|
|
| 49 |
|
| 50 |
## Run on Android
|
| 51 |
|
|
|
|
|
|
|
| 52 |
The easiest way to try this model on a phone is the official
|
| 53 |
**[Google AI Edge Gallery](https://github.com/google-ai-edge/gallery)** app:
|
| 54 |
|
|
@@ -67,6 +69,19 @@ See the Gallery
|
|
| 67 |
guide for details. To embed it in **your own** Android app, use the LiteRT-LM Kotlin API
|
| 68 |
(`com.google.ai.edge.litertlm:litertlm-android`).
|
| 69 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 70 |
## Quality — GSM8K
|
| 71 |
|
| 72 |
Measured on GSM8K (n=100, greedy, 0-shot chain-of-thought, identical prompt and
|
|
|
|
| 49 |
|
| 50 |
## Run on Android
|
| 51 |
|
| 52 |
+
> **Update (July 2026):** [Google AI Edge Gallery](https://github.com/google-ai-edge/gallery) **v1.0.16+** can import litert-lm models **directly from Hugging Face** inside the app (tap **+**) — no computer or `adb` needed. The manual steps below are only required on older builds or for sideloading a local file.
|
| 53 |
+
|
| 54 |
The easiest way to try this model on a phone is the official
|
| 55 |
**[Google AI Edge Gallery](https://github.com/google-ai-edge/gallery)** app:
|
| 56 |
|
|
|
|
| 69 |
guide for details. To embed it in **your own** Android app, use the LiteRT-LM Kotlin API
|
| 70 |
(`com.google.ai.edge.litertlm:litertlm-android`).
|
| 71 |
|
| 72 |
+
## Run on desktop (LiteRT-LM CLI)
|
| 73 |
+
|
| 74 |
+
The same `.litertlm` bundle runs on macOS / Linux / Windows with the official
|
| 75 |
+
[LiteRT-LM CLI](https://github.com/google-ai-edge/LiteRT-LM) — including as a
|
| 76 |
+
local **OpenAI-compatible API server**:
|
| 77 |
+
|
| 78 |
+
```bash
|
| 79 |
+
pip install litert-lm
|
| 80 |
+
litert-lm import --from-huggingface-repo mlboydaisuke/OLMo-2-1B-Instruct-LiteRT model.litertlm olmo-2-1b-instruct-litert
|
| 81 |
+
litert-lm run olmo-2-1b-instruct-litert # interactive chat in the terminal
|
| 82 |
+
litert-lm serve # local OpenAI-compatible API server
|
| 83 |
+
```
|
| 84 |
+
|
| 85 |
## Quality — GSM8K
|
| 86 |
|
| 87 |
Measured on GSM8K (n=100, greedy, 0-shot chain-of-thought, identical prompt and
|