Qwen3 4B in the plan?
#3
by
evankuo
- opened
Will you add Qwen3 4B, or models like LLaMA 3 8B / 3B?
Thank you.
We have plans to support several of the Qwen 3 models soon but the exact sizes are TBD.
Unfortunately, we will not be able to post the LLaMA 3 8B / 3B models here for licensing reasons. Advanced users could export those models themselves via the Generative API (https://github.com/google-ai-edge/ai-edge-torch).
but not with GPU support 😥
It looks like the documentation is out-of-date. The AI Edge Torch Generative API can support GPU. In fact, most non-Gemma models in the litert-community were exported with GPU support via this API.
I have informed the documentation owners that their page needs to be updated to reflect the latest behavior of the code.