5M transformer parameters, partially looped model.

40M in n-gram embeddings.