TroyDoesAI
/

MermaidMoE-15B

Text Generation

text-generation-inference

Model card Files Files and versions

MermaidMoE-15B / config.json

Commit History

Replaced Junk Layer with a more useful Layer, retraining still needed.

6486155
verified

TroyDoesAI commited on Apr 8, 2024

ModularMoe Secret Sauce? IDK, Lets Find Out.

0ae5252
verified

TroyDoesAI commited on Apr 8, 2024

Mixtral-2x12b ~ Very Experimental Architecture Choice By Self Evaluated Pruning Technique

aa2fc12
verified

TroyDoesAI commited on Apr 8, 2024

Upload 13 files

575a523
verified

TroyDoesAI commited on Apr 7, 2024