Li Shuaiyi

Syon-Li's activity

• All
• Models
• Datasets
• Spaces
• Buckets
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

authored 3 papers over 1 year ago

A Silver Bullet or a Compromise for Full Attention? A Comprehensive Study of Gist Token-based Context Compression

Paper • 2412.17483 • Published Dec 23, 2024 • 34

Attention Entropy is a Key Factor: An Analysis of Parallel Context Encoding with Full-attention-based Pre-trained Language Models

Paper • 2412.16545 • Published Dec 21, 2024

Consecutive Batch Model Editing with HooK Layers

Paper • 2403.05330 • Published Mar 8, 2024

authored a paper almost 2 years ago

On the Transformations across Reward Model, Parameter Update, and In-Context Prompt

Paper • 2406.16377 • Published Jun 24, 2024 • 13