README.md

metadata

license: apache-2.0
tags:
  - merge
  - mergekit
  - lazymergekit
  - beyoru/Qwen3-4B-I-1509
  - TeichAI/Qwen3-4B-Instruct-2507-Claude-Opus-3-Distill
  - bunnycore/Qwen3-4B-Exp

Qwen3-4B-Exp2

Qwen3-4B-Exp2 is a merge of the following models using mergekit:

• beyoru/Qwen3-4B-I-1509
• TeichAI/Qwen3-4B-Instruct-2507-Claude-Opus-3-Distill
• bunnycore/Qwen3-4B-Exp

🧩 Configuration

models:
  - model: beyoru/Qwen3-4B-I-1509
    parameters:
      density: 0.4
      weight: 0.4
  - model: TeichAI/Qwen3-4B-Instruct-2507-Claude-Opus-3-Distill
    parameters:
      density: 0.4
      weight: 0.4
  - model: bunnycore/Qwen3-4B-Exp
    parameters:
      density: 0.5
      weight: 0.5
merge_method: ties
base_model: Roman0/Qwen3-4B-Instruct-2507-heretic
parameters:
  normalize: true
dtype: float16