SOGturient / README.md
tachyphylaxis's picture
Duplicate from schonsense/SOGturient
86f81fb verified
metadata
base_model:
  - Tarek07/Scripturient-V1.3-LLaMa-70B
  - schonsense/70B_SOG_MMv2_ft
library_name: transformers
tags:
  - mergekit
  - merge

SOGturient

This is a merge of pre-trained language models created using mergekit.

Merge Details

Merge Method

This model was merged using the NuSLERP merge method.

Models Merged

The following models were included in the merge:

Configuration

The following YAML configuration was used to produce this model:

models:

  - model: Tarek07/Scripturient-V1.3-LLaMa-70B
    parameters:
      weight: 1

  - model: schonsense/70B_SOG_MMv2_ft
    parameters:
      weight: 1
       

merge_method: nuslerp 
tokenizer_source: union

dtype: float32

out_dtype: bfloat16