When Attention Goes Blind: Numerical Failure in ALiBi Positional Encodings Paper • 2608.03994 • Published 9 days ago • 8
Obfuscated ModernBERT Collection Models pretrained on various obfuscated versions of the same dataset to analyse how the obfuscation affects downstream performance. • 13 items • Updated 16 days ago
DanielGallagherIRE/fineweb-edu-20B-E1-Scramble-Hier-flattened Viewer • Updated 20 days ago • 9.71M • 1.16k