A Refined Analysis of Massive Activations in LLMs
Paper
•
2503.22329
•
Published
•
14
Kalle Hilsenbek
Bachstelze
AI & ML interests
Translation, syntax assessment, efficient modeling, synthetic data generation, and ethical reasoning
Recent Activity
published
a Space
13 minutes ago
lnuDataProject/A1
updated
a Space
18 minutes ago
Bachstelze/hello-world-demo
published
a Space
about 2 hours ago
lnuDataProject/DemoPage
Organizations
upvoted
2
papers
10 months ago
upvoted
a
paper
11 months ago
upvoted
an
article
12 months ago
Article
Is Attention Interpretable in Transformer-Based Large Language Models? Let’s Unpack the Hype
•
4
upvoted
9
papers
over 1 year ago
Large Language Model Evaluation via Matrix Nuclear-Norm
Paper
•
2410.10672
•
Published
•
19
One Initialization to Rule them All: Fine-tuning via Explained Variance Adaptation
Paper
•
2410.07170
•
Published
•
16
Only-IF:Revealing the Decisive Effect of Instruction Diversity on Generalization
Paper
•
2410.04717
•
Published
•
18
Cottention: Linear Transformers With Cosine Attention
Paper
•
2409.18747
•
Published
•
16
EuroLLM: Multilingual Language Models for Europe
Paper
•
2409.16235
•
Published
•
29
Better Alignment with Instruction Back-and-Forth Translation
Paper
•
2408.04614
•
Published
•
15
Breaking the Attention Bottleneck
Paper
•
2406.10906
•
Published
•
4
GEB-1.3B: Open Lightweight Large Language Model
Paper
•
2406.09900
•
Published
•
21
Self-Play Preference Optimization for Language Model Alignment
Paper
•
2405.00675
•
Published
•
28
upvoted
a
paper
almost 2 years ago