Question: can this run on mobile?

#107
by 3morixd - opened

Great Space! ๐Ÿ‘‹

At Dispatch AI (FZE, UAE), we build mobile AI. Question: has anyone tried running this on a phone?

We test AI applications on 40 Samsung S20 FE devices (Snapdragon 865). If this could be adapted for mobile, we'd love to benchmark it.

Specifically interested in:

  • Model size after quantization

  • Inference speed on ARM

  • Memory requirements

  • Dispatch AI (FZE), Sharjah UAE

Sign up or log in to comment