On-device generative AI runs machine learning models directly on local hardware like smartphones or laptops rather than cloud servers.