Experto-4X8B-untrained

Experto-4X8B-untrained is a merge of the following models using mergoo:

• meta-llama/Meta-Llama-3-8B
• cognitivecomputations/dolphin-2.9-llama3-8b
• abacusai/Llama-3-Smaug-8B
• Weyaxi/Einstein-v6.1-Llama3-8B
• dreamgen-preview/opus-v1.2-llama-3-8b-base-run3.4-epoch2

🧩 Configuration

json

WARNING: This model needs further training to train the router layers