---
language:
- en
base_model:
- meta-llama/Llama-3.1-8B-Instruct
tags:
- peft
- lora
- moe
- moa
---

arxiv: https://arxiv.org/abs/2506.05928