MoE or E3B | E4B
#4
by
E7Reine - opened
Are you planning to make MoE or E3B | E4B models, for example: 24 or "27B E3B" ?
they would be faster than dense models
Hi @E7Reine ,
Thank you for reaching out to us.
We appreciate your interest in MoE and E3B/E4B architectures. Your request for variants like E3B and MoE has been shared with the development team. Thank you for the feedback.