Major performance and stability improvements: disable torch.compile by default, GPU preprocessing, ROI auto-adjustment, timeout mechanism, validation, cuDNN benchmarking, version logging, concurrency limits
700e0b1
Harshith Reddycommited on
Optimize for L40S GPU (48GB VRAM): increase window sizes and batch sizes for better performance
197d4e2
Harshith Reddycommited on
Fix checkpoint loading order: load before torch.compile to avoid _orig_mod prefix mismatch
ef22c5d
Harshith Reddycommited on
Add torch.compile optimization for better memory efficiency
f6ab828
Harshith Reddycommited on
Fix GPU OOM: Add post-load memory check, use ultra-minimal settings for low memory, and improve OOM recovery
11a9b37
Harshith Reddycommited on
Optimize for dedicated GPU: Add L4 GPU support with higher memory thresholds and better batch sizes
e1b9ddc
Harshith Reddycommited on
Fix naming conflict: rename model.py to model_loader.py and initialize DEVICE to prevent NoneType errors