| --- |
| license: gemma |
| base_model: google/codegemma-7b-it |
| library_name: litert |
| tags: |
| - litert |
| - litertlm |
| - codegemma |
| - int4 |
| - android |
| - on-device |
| pipeline_tag: text-generation |
| --- |
| |
| # CodeGemma 7B IT (INT4 LiteRT LM Model for Android) |
|
|
| This repository contains Google's **CodeGemma 7B Instruction-Tuned (`google/codegemma-7b-it`)** quantized to **INT4** and packaged into the **`.litertlm`** format for on-device execution on Android using Google's LiteRT runtime. |
|
|
| ## Model Details |
| - **Base Model**: [google/codegemma-7b-it](https://huggingface.co/google/codegemma-7b-it) |
| - **Format**: `.litertlm` (LiteRT LM Model Bundle) |
| - **Quantization**: INT4 (`dynamic_wi4_afp32`) |
| - **Target Runtime**: Android LiteRT C++/Kotlin SDK |
|
|
| ## Usage on Android |
|
|
| Download the `.litertlm` bundle into your Android app's assets or internal storage and load it via LiteRT-LM: |
|
|
| ```kotlin |
| val modelPath = File(context.filesDir, "codegemma-7b-it-int4.litertlm").absolutePath |
| val options = ModelOptions.builder() |
| .setModelPath(modelPath) |
| .build() |
| |
| val engine = LiteRtLmEngine.create(options) |
| val response = engine.generate("Write a Kotlin function to check prime numbers.") |
| println(response) |
| ``` |
|
|
