Language Models are Super Mario: Absorbing Abilities from Homologous Models as a Free Lunch
Paper
• 2311.03099 • Published
• 30
This is a merge of pre-trained language models created using mergekit.
This model was merged using the DARE TIES merge method using kainatq/Kainoverse-7b-v0.1 as a base.
The following models were included in the merge:
The following YAML configuration was used to produce this model:
merge_method: dare_ties
base_model: kainatq/Kainoverse-7b-v0.1
parameters:
normalize: true
models:
- model: ResplendentAI/DaturaCookie_7B
parameters:
weight: 1
- model: icefog72/IceDrunkenCherryRP-7b
parameters:
weight: 1
- model: ChaoticNeutrals/RP_Vision_7B
parameters:
weight: 0.75
dtype: float16