README.md

metadata

language:
  - zh

Public model checkpoints for our paper Information Entropy Invariance: Enhancing Length Extrapolation in Attention Mechanisms.

Code is accessible at GitHub.