Qwen2.5-merged

This is a merge of pre-trained language models created using mergekit.

Merge Details

Merge Method

This model was merged using the linear merge method.

Models Merged

The following models were included in the merge:

  • /content/mergekit/models/Qwen2.5-Coder-0.5B-Instruct
  • /content/mergekit/models/qwen2.5-0.5B_ichikara_4802

Configuration

The following YAML configuration was used to produce this model:


models:
  - model: /content/mergekit/models/Qwen2.5-Coder-0.5B-Instruct
    parameters:
      weight: 0.8
  - model: /content/mergekit/models/qwen2.5-0.5B_ichikara_4802
    parameters:
      weight: 0.2
merge_method: linear
dtype: float16
Downloads last month
3
Safetensors
Model size
0.5B params
Tensor type
F16
·
Inference Providers NEW
Input a message to start chatting with noirchan/Qwen2.5-Coder-0.5B_mergelinear0.8.

Model tree for noirchan/Qwen2.5-Coder-0.5B_mergelinear0.8

Quantizations
1 model

Paper for noirchan/Qwen2.5-Coder-0.5B_mergelinear0.8