BatchLLM: Optimizing Large Batched LLM Inference with Global Prefix Sharing and Throughput-oriented Token Batching Paper • 2412.03594 • Published Nov 29, 2024