Exploiting Inter-Layer Expert Affinity for Accelerating Mixture-of-Experts Model Inference Paper • 2401.08383 • Published Jan 16, 2024 • 1
The Case for Co-Designing Model Architectures with Hardware Paper • 2401.14489 • Published Jan 25, 2024 • 4
Continual Pre-Training of Large Language Models: How to (re)warm your model? Paper • 2308.04014 • Published Aug 8, 2023 • 2