File size: 772 Bytes
f7a8e5f
 
 
c108649
 
f7a8e5f
c108649
2ba3ede
34b259e
fcf801c
c108649
315815d
1
2
3
4
5
6
7
8
9
10
11
12
---
language:
- en
pipeline_tag: feature-extraction
license: mit
---

This repo contains code and links for the [Flash normalization paper](https://arxiv.org/abs/2407.09577):
* <a href="https://colab.research.google.com/github/OpenMachine-ai/transformer-tricks/blob/main/flash_normalization.ipynb"><img src="https://colab.research.google.com/assets/colab-badge.svg" alt="Colab" height="20"></a>
* Paper: [arXiv](https://arxiv.org/abs/2407.09577), [HuggingFace paper page](https://huggingface.co/papers/2407.09577), and [latex](https://github.com/OpenMachine-ai/transformer-tricks/blob/main/latex/flash.tex)
* Code: https://github.com/OpenMachine-ai/transformer-tricks
* See [here](https://github.com/OpenMachine-ai/transformer-tricks/tree/main) for more transformer tricks