Spaces:
Sleeping
Sleeping
Commit History
-
perf: Tune batch sizes and queues for A10 GPUs
Zhen Ye- Increased YOLO (HF/Drone) batch size to 32 - Increased Depth Anything batch size to 16 - Increased SAM3 batch size to 8 - Increased DETR batch size to 8 - Expanded inference.py queue_out to handle 32-frame batch burstsa5f8d15
-
Fix SAM3 batch prediction shape mismatch and add InternVL2 to frontend
Zhen Ye3de3df3 -
feat: Integrate InternVL2 and fix SAM3 segmentation batch size issue
Zhen Ye3d32b4a
-
Implement Batch Inference & Queue Backpressure Fixes
Zhen Ye5c36daa
-
feat(inference): enable full multi-GPU support for all models
Zhen Ye- Update inference.py to parallelize detection, segmentation, and depth estimation across all available GPUs - Update detectors (YOLOv8, DETR, GroundingDINO, DroneYolo) to accept device argument - Update SAM3 and DepthAnythingV2 to accept device argument - Add device-specific model loading to all model loaders - Remove OwlV2 support45eb65b
-
inital commit
Zhen Yeb30e7a3