metadata
license: apache-2.0
tags:
- merge
- mergekit
- lazymergekit
Microtron-4B
Microtron-4B is a merge of the following models using mergekit:
🧩 Configuration
models:
- model: anthracite-org/magnum-v2-4b
- model: rasyosef/Llama-3.1-Minitron-4B-Chat
- model: nvidia/Llama-3.1-Minitron-4B-Width-Base
merge_method: model_stock
base_model: nvidia/Llama-3.1-Minitron-4B-Width-Base
dtype: bfloat16