Collections
Discover the best community collections!
Collections trending this week
-
Replacing softmax with ReLU in Vision Transformers
Paper • 2309.08586 • Published • 19 -
Softmax Bias Correction for Quantized Generative Models
Paper • 2309.01729 • Published • 2 -
The Closeness of In-Context Learning and Weight Shifting for Softmax Regression
Paper • 2304.13276 • Published • 1 -
Quantizable Transformers: Removing Outliers by Helping Attention Heads Do Nothing
Paper • 2306.12929 • Published • 13
-
Replacing softmax with ReLU in Vision Transformers
Paper • 2309.08586 • Published • 19 -
Softmax Bias Correction for Quantized Generative Models
Paper • 2309.01729 • Published • 2 -
The Closeness of In-Context Learning and Weight Shifting for Softmax Regression
Paper • 2304.13276 • Published • 1 -
Quantizable Transformers: Removing Outliers by Helping Attention Heads Do Nothing
Paper • 2306.12929 • Published • 13