---
license: bsd-3-clause
---
# SmallFormer

A Reduced Transformer Architecture with Parameter Free Multi-Head Attention

Paper Coming Soon