Mobitron-4B / README.md

bunnycore

Upload folder using huggingface_hub

9abbd22 verified over 1 year ago

preview code

raw

history blame contribute delete

440 Bytes

metadata

license: apache-2.0
tags:
  - merge
  - mergekit
  - lazymergekit

Mobitron-4B

Mobitron-4B is a merge of the following models using mergekit:

🧩 Configuration

models:
  - model: TheDrummer/Hubble-4B-v1
  - model: Magpie-Align/Llama-3.1-Minitron-4B-Magpie-SFT-750K-MT
  - model: bunnycore/Microtron-4B
merge_method: model_stock
base_model: TheDrummer/Hubble-4B-v1
dtype: bfloat16