---
license: mit
base_model:
- microsoft/Phi-4-mini-instruct
tags:
- moe
---
This is a converted version of phi-4-mini into an moe with 8 experts. It hasnt been fine tuned yet nor tested.