Online Speculative Decoding
Paper
• 2310.07177 • Published
• 3
Li shuhuai
lsh-algorithm
AI & ML interests
None yet
Recent Activity
authored
a paper
about 15 hours ago
MoE-SpAc: Efficient MoE Inference Based on Speculative Activation Utility in Heterogeneous Edge Scenarios upvoted a paper 9 months ago
Online Speculative Decoding Organizations
None yet
upvoted a paper 9 months ago