merged_ties

This is a merge of pre-trained language models created using mergekit.

Merge Details

Merge Method

This model was merged using the TIES merge method using /models/qwen3-4b-instruct-2507 as a base.

Models Merged

The following models were included in the merge:

  • /models/game-top-ana4-4
  • /models/print-top-0101928
  • /models/lgc-v2-top-train11

Configuration

The following YAML configuration was used to produce this model:


models:
  - model: /models/game-top-ana4-4
    parameters:
      density: 0.5
      weight: 1.0
  - model: /models/print-top-0101928
    parameters:
      density: 0.5
      weight: 1.0
  - model: /models/lgc-v2-top-train11
    parameters:
      density: 0.5
      weight: 1.0
merge_method: ties
base_model: /models/qwen3-4b-instruct-2507
parameters:
  normalize: true
dtype: bfloat16
Downloads last month
14
Safetensors
Model size
4B params
Tensor type
BF16
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Paper for lyraresearchlabs/affine-merged-ties