Duplicated from  mistralai/Mistral-Small-4-119B-2603

Simsema

/

Simsema_Small-4-119B-32226

like 1

This is in its own space for MoE size vs Active size.

Thank you for presenting your work. I cannot eval any time soon though.

Please anyone who tries it share your experience.