Attention Wiki

AI & ML interests

None defined yet.

Recent Activity

lvwerra  new activity about 1 hour ago

attention-wiki/knowledge-base:Add source: NoPE — positional encoding & length generalization (arxiv:2305.19466)

lvwerra  new activity about 1 hour ago

attention-wiki/knowledge-base:Add source: H2O — Heavy-Hitter KV-cache eviction (arxiv:2306.14048)

lvwerra  new activity about 2 hours ago

attention-wiki/knowledge-base:Add source: S4 (structured state spaces) + claims + state-space-hybrids page

View all activity

Team members 4