Gemma 4 E2B Monarch model This model is derived from google/gemma-4-E2B-it. Modifications: - Replaced language-model MLP layers 34, 33, 32, 31, 30, 29, 28, 27, 26, 25, 24, 23, 22, 21, 20, 19, 18, 17, 16, 15, 14, 13, 12, 11, 10, 9, 8, 7, 6, 5, 4, 3, 2, 1, 0 with two-factor rectangular Monarch linear maps. - Initialized factors by rank-one SVD projection of each dense Monarch slice. - Distilled the modified layers against the original model. The original and modified files are distributed under the Apache License 2.0.