Multilingual powerhouse — testing for mobile deployment
#86
by 3morixd - opened
This model covers Arabic, Finnish, Hebrew, Thai — exactly the kind of multilingual capability we need for global mobile AI.
At Dispatch AI (FZE, UAE), we're building mobile AI that works for everyone. Models like this are the foundation.
We benchmark multilingual models on our 40-phone farm (Snapdragon 865) to see which maintain quality across languages when quantized to 4-bit. Results vary wildly — some lose 30% quality in non-English after quantization.
Would love to see multilingual eval at different quantization levels.
- Dispatch AI (FZE), Sharjah UAE