LiteRT
Collection
LiteRT is Google's on-device framework for high-performance ML & GenAI deployment on edge platforms. • 5 items • Updated • 1
How to use NeuML/gemma-4-tiny-random-litert-lm with LiteRT-LM:
# LiteRT-LM runs on various platforms (Android, iOS, Windows, Linux, macOS, IoT, Web/WASM) # and supports many APIs (C++, Python, Kotlin, Swift, JavaScript, Flutter). # For platform-specific integration guides, please refer to the official developer website: # https://ai.google.dev/edge/litert-lm # To try LiteRT-LM, the easiest way is to use our CLI tool. # 1. Install the LiteRT-LM CLI tool: pip install -U litert-lm # 2. Download and run this model locally: # See: https://ai.google.dev/edge/litert-lm/cli litert-lm run \ --from-huggingface-repo=NeuML/gemma-4-tiny-random-litert-lm \ --prompt="Write me a poem"
Tiny randomly initialized Gemma 4 LiteRT-LM model for testing.
Created using the following code.
# pip install litert-torch
from litert_torch.generative.export_hf.export import export
export(
model="optimum-intel-internal-testing/tiny-random-gemma4",
output_dir="output",
externalize_embedder=True,
# Disable quantization, None still defaults to a value
quantization_recipe="",
use_jinja_template=False,
)