Edge Gallery Can't Load Qwen3-0.6B.mediatek.mt6993.litertlm

#1
by helloluosj - opened

Device: VIVO X300 (PD2509) (SW:16.0.21.8)
SOC: MTK Dimensity 9500(MT6993)
RAM&Storage: 16G+512G
Model: Qwen3-0.6B.mediatek.mt6993.litertlm
APP: Google AI Edge Gallery 1.0.9
Problem:
After importing the "Qwen3-0.6B.mediatek.mt6993.litertlm", I can't load it in the chat. "Qwen3-0.6B.litertlm" works fine.
My phone's SOC matches the model name. What could be causing this issue?

a3f639bf421009b03602e06f1ecfaf17

try selecting "cpu" in the model config (first icon in the top right of your screenshot)

LiteRT Community (FKA TFLite) org

The AI Edge Gallery app currently doesn't support NPUs. It is possible to run the NPU models through the LiteRT-LM Android API. The AI Edge Gallery app team is currently considering adding NPU support. I've passed your request along to them.

Sign up or log in to comment