Under 3M parameters, partially looped model. 1M in n-gram embeddings.