Exploring low-resource inference, localized data modeling, and optimization for constrained environments