Safetensors to tflite

#3
by salmankhanpm - opened
LiteRT Community (FKA TFLite) org

Hi, Is there any Documentation or code on how to convert a model to LiteRT. I am planning to do sft and inference on edge ( mobile ) via Edge Gallery.

Thank you

Hi
P.M.SALMAN KHAN, Did you find any solution so far. I too looking for the same for quite sometime but couldnt find anything yet

LiteRT Community (FKA TFLite) org

There's a guide to LiteRT fine-tuning available here: https://developers.googleblog.com/own-your-ai-fine-tune-gemma-3-270m-for-on-device/. For mobile or Edge Gallery, this is probably what you want.

Small caveat: this will not work for larger models on web yet; see my post in the other thread for guidance on "-web.task" Gemma3 models.

Sign up or log in to comment