Bohan Sun

Bohansss

3 1

·

Lazycat1119

AI & ML interests

Efficient LLM

Recent Activity

upvoted a paper 1 day ago

Massive Activations in Hybrid Linear Attention Large Language Models: Pre-Attention Spikes and Inter-Spike Plateaus

upvoted a paper 2 months ago

ICA Lens: Interpreting Language Models Without Training Another Dictionary

upvoted a collection 2 months ago

Hybrid Linear Attention Research

View all activity

Organizations

upvoted a paper 1 day ago

Massive Activations in Hybrid Linear Attention Large Language Models: Pre-Attention Spikes and Inter-Spike Plateaus

Paper • 2608.12149 • Published 3 days ago • 18

upvoted a paper 2 months ago

ICA Lens: Interpreting Language Models Without Training Another Dictionary

Paper • 2606.11722 • Published Jun 10 • 18

upvoted a collection 2 months ago

Hybrid Linear Attention Research

All 1.3B & 340M hybrid linear-attention experiments. • 62 items • Updated Sep 11, 2025 • 14