Felipe Parodi commited on
Commit
2234e86
·
1 Parent(s): d4013d7

fix: correct Jiang et al. 2025 arxiv link (2501.11457 -> 2506.08010)

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -133,7 +133,7 @@ The shuffle condition is the strongest test. By layer 11, registers have been sh
133
 
134
  **CLS, by contrast, is not fungible.** Mean-substituting CLS yields 0.1% classification – the same as zeroing. CLS content is genuinely image-specific and functionally necessary. The fungibility is specific to registers.
135
 
136
- [Jiang et al. (2025)](https://arxiv.org/abs/2501.11457) showed that even *untrained* register tokens suffice for artifact removal. We extend this finding: even in models *trained with* registers, the per-image content they develop through 12 layers of attention is unnecessary for all standard downstream tasks.
137
 
138
  ---
139
 
 
133
 
134
  **CLS, by contrast, is not fungible.** Mean-substituting CLS yields 0.1% classification – the same as zeroing. CLS content is genuinely image-specific and functionally necessary. The fungibility is specific to registers.
135
 
136
+ [Jiang et al. (2025)](https://arxiv.org/abs/2506.08010) showed that even *untrained* register tokens suffice for artifact removal. We extend this finding: even in models *trained with* registers, the per-image content they develop through 12 layers of attention is unnecessary for all standard downstream tasks.
137
 
138
  ---
139