This collections contains all 8 experts of Mixtral 8x22B converted to single dense 22B models. The models are intended as basis for merges or finetune
-
thomasgauthier/Unmixtraled-22B-v0.1-expert-0
Text Generation • 22B • Updated • 2 -
thomasgauthier/Unmixtraled-22B-v0.1-expert-1
Text Generation • 22B • Updated • 2 -
thomasgauthier/Unmixtraled-22B-v0.1-expert-2
Text Generation • 22B • Updated • 8 • 2 -
thomasgauthier/Unmixtraled-22B-v0.1-expert-3
Text Generation • 22B • Updated • 4