Novaciano/Hereticsutra-2B

merge

This is a merge of pre-trained language models created using mergekit.

Merge Details

Merge Method

This model was merged using the SLERP merge method.

Models Merged

The following models were included in the merge:

• ChiKoi7/Gemma-2-Llama-Swallow-2b-it-v0.1-Heretic
• TheDrummer/Gemmasutra-Mini-2B-v1

Configuration

The following YAML configuration was used to produce this model:

base_model: TheDrummer/Gemmasutra-Mini-2B-v1

merge_method: slerp
dtype: bfloat16
# bfloat16 ensures numerical stability during spherical interpolation

parameters:
  t: 0.45
  # SLERP interpolation factor
  # 0.45 represents partial infection:
  # - Host cognition preserved
  # - Alignment degraded
  # - Behavioral instability introduced

models:
  - model: TheDrummer/Gemmasutra-Mini-2B-v1
    parameters:
      weight: 0.55
      # Primary host

  - model: ChiKoi7/Gemma-2-Llama-Swallow-2b-it-v0.1-Heretic
    parameters:
      weight: 0.45
      # not a full cognitive override