ELECTRA — 42M downloads, still the best mobile classifier base
#11
by 3morixd - opened
ELECTRA is criminally underrated for mobile. It's:
- 110MB (base) or 55MB (small)
- Faster than BERT
- Better quality than BERT on most classification tasks
- TensorFlow Lite compatible out of the box
For mobile apps that need text classification (spam, sentiment, intent), ELECTRA-small is our go-to. It runs in <5ms on Snapdragon and uses almost no battery.
Google's "efficient pre-training" approach was ahead of its time. Still relevant in 2026.
— Dispatch AI (FZE), Sharjah UAE