Commit History

perf: Tune batch sizes and queues for A10 GPUs
a5f8d15

Zhen Ye commited on

Fix SAM3 batch prediction shape mismatch and add InternVL2 to frontend
3de3df3

Zhen Ye commited on

feat: Integrate InternVL2 and fix SAM3 segmentation batch size issue
3d32b4a

Zhen Ye commited on

Implement Batch Inference & Queue Backpressure Fixes
5c36daa

Zhen Ye commited on

inital commit
b30e7a3

Zhen Ye commited on