This is a merge of pre-trained language models created using mergekit.
Merge Details
Merge Method
This model was merged using the Karcher Mean merge method.
Models Merged
The following models were included in the merge:
- ../Mira-v1.25-27B-Wave
- ../Mira-v1.25-27B-Wave + ./Mira-v1.26-Adapters/sft3
- ../Mira-v1.25-27B-Wave + ./Mira-v1.26-Adapters/sft1
- ../Mira-v1.25-27B-Wave + ./Mira-v1.26-Adapters/sft2
Configuration
The following YAML configuration was used to produce this model:
models:
- model: ../Mira-v1.25-27B-Wave+./Mira-v1.26-Adapters/sft1
- model: ../Mira-v1.25-27B-Wave+./Mira-v1.26-Adapters/sft2
- model: ../Mira-v1.25-27B-Wave+./Mira-v1.26-Adapters/sft3
- model: ../Mira-v1.25-27B-Wave
merge_method: karcher
dtype: bfloat16
tokenizer_source: Lambent/Mira-v1.25-27B-Wave
pad_to_multiple_of: 16
- Downloads last month
- 3