shijiecao's picture

6 3

shijiecao

shijiecao

·

AI & ML interests

None yet

Recent Activity

upvoted a paper 1 day ago

HySparse: A Hybrid Sparse Attention Architecture with Oracle Token Selection and KV Cache Sharing

upvoted a paper about 1 month ago

MiMo-V2-Flash Technical Report

upvoted a collection about 2 months ago

View all activity

Organizations

None yet

authored 2 papers 8 months ago

BitDistiller: Unleashing the Potential of Sub-4-Bit LLMs via Self-Distillation

Paper • 2402.10631 • Published Feb 16, 2024 • 2

SeerAttention: Learning Intrinsic Sparse Attention in Your LLMs

Paper • 2410.13276 • Published Oct 17, 2024 • 29