Document multimodal TranslateGemma artifact

CLAUDE.md

@@ -6,6 +6,9 @@ This file provides guidance to Claude Code (claude.ai/code) when working with co
 
 Python toolkit that converts Google's TranslateGemma 4B IT model (HuggingFace) into on-device inference bundles for Android. Google's official TFLite files only support WebGPU — this project produces CPU/XNNPACK-compatible `.litertlm` (LiteRT-LM) and `.task` (MediaPipe) files with proper KV-cache prefill/decode signatures.
 
+The primary Hugging Face app artifact is the multimodal image+text LiteRT-LM bundle:
+`artifacts/int4-multimodal/translategemma-4b-it-int4-multimodal.litertlm` (~2.76 GB). It supports structured text translation and image translation through LiteRT-LM vision, and is intended for PrivateAITranslate. If this file is absent from the Hugging Face repo, the app download URL for the multimodal model will 404.
+
 ## Common Commands
 
 ### Single quantization conversion (produces `.task`)
@@ -109,6 +112,7 @@ In Google AI Edge Gallery **Prompt Lab** mode, paste this as the System Prompt w
 - `conv-venv/` — virtualenv with all deps (`litert-torch==0.8.0`, `mediapipe`, `ai_edge_torch`, `transformers`)
 - `/tmp/litert-lm-pkg/` — manually assembled package from cloned LiteRT-LM repo with compiled FlatBuffer (`flatc -p --gen-onefile`) and proto (`protoc`) Python bindings; required by `bundle_litertlm.py` at runtime; NOT persistent across reboots
 - `/tmp/litert-lm/` — cloned `google-ai-edge/LiteRT-LM` repo (schema source for rebuilding the package)
-- Conversion requires ~128 GB RAM; 4B model loads ~46 GB
+- Multimodal conversion observed peak RSS around 73.9 GiB; require 96 GB minimum RAM, with 128 GB preferred. Ideal builder is a Vast.ai PyTorch image or Ubuntu-based NVIDIA/PyTorch image rather than a bare CUDA runtime image.
+- CPU real-device validation has passed on Pixel 10 and Galaxy S22 / S22 Ultra-class targets. GPU initialization currently fails during validation and should be considered experimental and not validated.
 - `translategemma-4b-it/tokenizer.model` is the SentencePiece binary used by both `.task` and `.litertlm` bundlers; `ensure_tokenizer_model()` auto-converts from `tokenizer.json` if missing
 - HuggingFace repo: `barakplasma/translategemma-4b-it-android-task-quantized`; upload token in `HF_TOKEN` env var

README.md

@@ -19,7 +19,7 @@ On-device translation model for Android using [Google AI Edge](https://ai.google
 Converts [google/translategemma-4b-it](https://huggingface.co/google/translategemma-4b-it) (55 languages, 4B params)
 into formats that run locally on Android without internet or cloud APIs.
 
-Google only publishes WebGPU-only TFLite files. This repo bridges that gap with CPU/XNNPACK-compatible `.litertlm` bundles (LiteRT-LM format) with embedded chat template.
+Google only publishes WebGPU-only TFLite files. This repo bridges that gap with CPU/XNNPACK-compatible `.litertlm` bundles (LiteRT-LM format) with embedded chat template, including a multimodal image+text Android bundle for PrivateAITranslate.
 
 ---
 
@@ -29,9 +29,11 @@ Google only publishes WebGPU-only TFLite files. This repo bridges that gap with
 |------|------|-------|
 | `artifacts/int4-generic/translategemma-4b-it-int4-generic.litertlm` | ~2 GB | INT4 blockwise quant — faster, lower RAM |
 | `artifacts/dynamic_int8-generic/translategemma-4b-it-dynamic_int8-generic.litertlm` | ~4 GB | Dynamic INT8 — better quality |
-| `artifacts/int4-multimodal/translategemma-4b-it-int4-multimodal.litertlm` | ~2.6 GB | INT4 multimodal bundle with image translation support |
+| `artifacts/int4-multimodal/translategemma-4b-it-int4-multimodal.litertlm` | ~2.76 GB | INT4 multimodal image+text bundle for structured text translation and LiteRT-LM vision image translation |
 
-**Start with INT4** if you're unsure — it loads faster and uses less RAM. Use dynamic_int8 for better translation quality.
+**Start with INT4** if you're unsure — it loads faster and uses less RAM. Use dynamic_int8 for better text translation quality.
+
+The multimodal artifact is the bundle expected by PrivateAITranslate for image translation. If `artifacts/int4-multimodal/translategemma-4b-it-int4-multimodal.litertlm` is not present in this Hugging Face repo, the app download URL for that model will return 404.
 
 ---
 
@@ -69,6 +71,10 @@ Use standard ISO 639-1 language codes: `en`, `he`, `fr`, `es`, `de`, `ar`, `zh`,
 
 Plain text (no tags) is also accepted — the model will attempt translation based on context.
 
+### Image translation
+
+The multimodal `.litertlm` bundle uses LiteRT-LM vision support for image+text translation flows in PrivateAITranslate. It is intended for structured text translation and image translation, not general image captioning.
+
 ---
 
 ## Device Requirements
@@ -80,6 +86,8 @@ Plain text (no tags) is also accepted — the model will attempt translation bas
 | OS | Android 10+ |
 | Runtime | Google AI Edge Gallery or LiteRT-LM SDK |
 
+CPU real-device validation passed on Pixel 10 and Galaxy S22 / S22 Ultra-class targets. GPU execution currently fails initialization in validation and should be treated as experimental and not validated.
+
 ---
 
 ## What's Different From Google's Official Files