Medusa: Simple LLM Inference Acceleration Framework with Multiple Decoding Heads
Paper • 2401.10774 • Published • 60
Hongwu Peng
harveyp123
AI & ML interests
Large Language model
Organizations
None yet
upvoted a paper over 2 years ago