Model Stock: All we need is just a few fine-tuned models
Paper • 2403.19522 • Published • 14
This is a merge of pre-trained language models created using mergekit.
This model was merged using the Model Stock merge method using lemon07r/Gemma-2-Ataraxy-v4d-9B as a base.
The following models were included in the merge:
The following YAML configuration was used to produce this model:
base_model: lemon07r/Gemma-2-Ataraxy-v4d-9B
models:
- model: allura-org/G2-9B-Aletheia-v1
- model: AXCXEPT/EZO-Common-9B-gemma-2-it
- model: AXCXEPT/EZO-Humanities-9B-gemma-2-it
- model: ehristoforu/Gemma2-9B-it-psy10k-mental_health
- model: ifable/gemma-2-Ifable-9B
- model: crestf411/gemma2-9B-sunfall-v0.5.2
- model: gmonsoon/SahabatAI-Lion-9B-TIES-v1
merge_method: model_stock
dtype: bfloat16
parameters:
normalize: true