Model Card for Model ID

This is a mixture of experts created with mergekit and based on mistralai/Mistral-7B-v0.1.

Model Details

Model Description

The method and code used to quantize the model is explained here: Maixtchup: Make Your Own Mixture of Experts with Mergekit

Uses

This model is pre-trained and not fine-tuned. You may fine-tune it with PEFT using adapters.

Model Card Contact

The Kaitchup

Downloads last month
75
Safetensors
Model size
24B params
Tensor type
F16
ยท
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support