mlboydaisuke commited on
Commit
09ea7f9
·
verified ·
1 Parent(s): 7d5fd86

Document Gallery 1.0.16 direct Hugging Face import + desktop LiteRT-LM CLI (serve/run)

Browse files
Files changed (1) hide show
  1. README.md +15 -0
README.md CHANGED
@@ -49,6 +49,8 @@ so no separate tokenizer files are needed.
49
 
50
  ## Run on Android
51
 
 
 
52
  The easiest way to try this model on a phone is the official
53
  **[Google AI Edge Gallery](https://github.com/google-ai-edge/gallery)** app:
54
 
@@ -67,6 +69,19 @@ See the Gallery
67
  guide for details. To embed it in **your own** Android app, use the LiteRT-LM Kotlin API
68
  (`com.google.ai.edge.litertlm:litertlm-android`).
69
 
 
 
 
 
 
 
 
 
 
 
 
 
 
70
  ## Quality — GSM8K
71
 
72
  Measured on GSM8K (n=100, greedy, 0-shot chain-of-thought, identical prompt and
 
49
 
50
  ## Run on Android
51
 
52
+ > **Update (July 2026):** [Google AI Edge Gallery](https://github.com/google-ai-edge/gallery) **v1.0.16+** can import litert-lm models **directly from Hugging Face** inside the app (tap **+**) — no computer or `adb` needed. The manual steps below are only required on older builds or for sideloading a local file.
53
+
54
  The easiest way to try this model on a phone is the official
55
  **[Google AI Edge Gallery](https://github.com/google-ai-edge/gallery)** app:
56
 
 
69
  guide for details. To embed it in **your own** Android app, use the LiteRT-LM Kotlin API
70
  (`com.google.ai.edge.litertlm:litertlm-android`).
71
 
72
+ ## Run on desktop (LiteRT-LM CLI)
73
+
74
+ The same `.litertlm` bundle runs on macOS / Linux / Windows with the official
75
+ [LiteRT-LM CLI](https://github.com/google-ai-edge/LiteRT-LM) — including as a
76
+ local **OpenAI-compatible API server**:
77
+
78
+ ```bash
79
+ pip install litert-lm
80
+ litert-lm import --from-huggingface-repo mlboydaisuke/OLMo-2-1B-Instruct-LiteRT model.litertlm olmo-2-1b-instruct-litert
81
+ litert-lm run olmo-2-1b-instruct-litert # interactive chat in the terminal
82
+ litert-lm serve # local OpenAI-compatible API server
83
+ ```
84
+
85
  ## Quality — GSM8K
86
 
87
  Measured on GSM8K (n=100, greedy, 0-shot chain-of-thought, identical prompt and