Fix OOM: reduce ROI depth to 64, sw_batch_size=1, CPU aggregation, fix env var timing, update TF32 API
8aecceb
Harshith Reddycommited on
Major performance and stability improvements: disable torch.compile by default, GPU preprocessing, ROI auto-adjustment, timeout mechanism, validation, cuDNN benchmarking, version logging, concurrency limits
700e0b1
Harshith Reddycommited on
Optimize for dedicated GPU: Add L4 GPU support with higher memory thresholds and better batch sizes
e1b9ddc
Harshith Reddycommited on
Fix naming conflict: rename model.py to model_loader.py and initialize DEVICE to prevent NoneType errors
493e2f1
Harshith Reddycommited on
Refactor app.py into modular structure: config, model, processing, inference, and app modules
931ed7c
Harshith Reddycommited on
Add aggressive memory management: unload unused models and check memory before inference
ea6df03
Harshith Reddycommited on
Remove CPU fallback - model requires CUDA and cannot run on CPU
5250013
Harshith Reddycommited on
Add PyTorch memory allocator config and enhanced OOM recovery with CPU fallback
6fd75e4
Harshith Reddycommited on
Remove all code comments and add adaptive memory management for OOM prevention
0c3c358
Harshith Reddycommited on
Add comprehensive diagnostic logging and performance optimizations
85fc999
Harshith Reddycommited on
Revert: Restore overlap to 0.15 for better accuracy (matches original deployment)
a10d31f
Harshith Reddycommited on
Optimize: Reduce sliding window overlap and add inference progress tracking
209c3d5
Harshith Reddycommited on
Fix: Handle image_tensor cleanup in finally block safely