GAU-alpha_CosScale / README.md
HT-NEKO's picture
Update README.md
64cfa8c verified
---
language:
- zh
---
Public model checkpoints for our paper **Information Entropy Invariance: Enhancing Length Extrapolation in Attention Mechanisms**.
Code is accessible at [GitHub](https://github.com/HT-NEKO/Information-Entropy-Invariance).