Update README.md

This is a fast 15B parameter 2x Self Merge MoE

MoE 2 Experts 15B total parameters

Replaced Junk Layer with a more useful Layer, retraining still needed.

ModularMoe Secret Sauce? IDK, Lets Find Out.

Mixtral-2x12b ~ Very Experimental Architecture Choice By Self Evaluated Pruning Technique

Upload 13 files

initial commit