FASER: Fine-Grained Phase Management for Speculative Decoding in Dynamic LLM Serving
Paper • 2604.20503 • Published • 1
Yanying Lin
yanyinglin
·
AI & ML interests
None yet
Recent Activity
authored a paper 15 days ago
FlexPipe: Adapting Dynamic LLM Serving Through Inflight Pipeline Refactoring in Fragmented Serverless Clusters authored a paper 15 days ago
FASER: Fine-Grained Phase Management for Speculative Decoding in Dynamic LLM Serving upvoted a paper 15 days ago
FASER: Fine-Grained Phase Management for Speculative Decoding in Dynamic LLM ServingOrganizations
None yet
upvoted a paper 15 days ago