po-WW-7B-linear / README.md

guyue123

Upload folder using huggingface_hub

e7e8928 verified about 2 years ago

preview code

raw

history blame contribute delete

647 Bytes

metadata

license: apache-2.0
tags:
  - merge
  - mergekit
  - lazymergekit
  - pankajmathur/orca_mini_v2_7b
  - WizardLM/WizardLM-7B-V1.0

Marcoro14-7B-slerp

Marcoro14-7B-slerp is a merge of the following models using mergekit:

pankajmathur/orca_mini_v2_7b
WizardLM/WizardLM-7B-V1.0

🧩 Configuration

models:
  - model: pankajmathur/orca_mini_v2_7b
    parameters:
      weight: 1.0
  - model: WizardLM/WizardLM-7B-V1.0
    parameters:
      weight: 0.3
merge_method: linear
dtype: float16