What Layers When: Learning to Skip Compute in LLMs with Residual Gates
Paper • 2510.13876 • Published • 12
🔄 In a Training Loop
Lukas Garbaciauskas
lukasgarbas
AI & ML interests
Natural Language Processing
@flair @huberlin
Recent Activity
upvoted a paper about 14 hours ago
What Layers When: Learning to Skip Compute in LLMs with Residual Gates upvoted a paper 13 days ago
PACE: Periodic and Channel-Aligned Encoding of Four-Bit Recurrent States liked a model 6 months ago
Boldt/Boldt-1BOrganizations
None yet
upvoted a paper about 14 hours ago
upvoted a paper 13 days ago
liked a
model 6 months ago
upvoted a paper 6 months ago
upvoted a paper 11 months ago
updated a
Space about 1 year ago
updated a
collection about 1 year ago
updated a
dataset about 1 year ago
published a
dataset about 1 year ago
updated a
dataset about 1 year ago
published a
dataset about 1 year ago
authored a
paper about 1 year ago
upvoted an article over 1 year ago
Article
Finally, a Replacement for BERT: Introducing ModernBERT
- +13
bwarner, NohTow, bclavie, orionweller, ohallstrom, staghado, alexisgallagher, rbiswasfc, fladhak, tomaarsen, ncoop57, griffin, jph00, johnowhitaker, iacolippo
• • 756 upvoted a paper over 1 year ago
liked a
Space almost 2 years ago
updated a
Space almost 2 years ago