Optimize model loading with dynamic quantization and device handling 6b48ab4 MilicMilos commited on Feb 15
Improve model inference performance and reliability on hardware 46c5d16 MilicMilos commited on Feb 14