File size: 758 Bytes
22292c2 933d5b9 22292c2 933d5b9 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 |
---
pipeline_tag: text-generation
tags:
- mistral
- merge
license: cc-by-4.0
---
# Model Card for Tippy-Toppy-7b
<!-- Provide a quick summary of what the model is/does. -->
DARE merge intended to be build on Toppy-M-7b.
.yaml file for mergekit
```.yaml:
models:
- model: mistralai/Mistral-7B-v0.1
# no parameters necessary for base model
- model: Undi95/Toppy-M-7B #175
parameters:
weight: 0.54
density: 0.81
- model: PistachioAlt/Noromaid-Bagel-7B-Slerp #75
parameters:
weight: 0.23
density: 0.61
- model: OpenPipe/mistral-ft-optimized-1227 #100
parameters:
weight: 0.31
density: 0.68
merge_method: dare_ties
base_model: mistralai/Mistral-7B-v0.1
parameters:
int8_mask: true
dtype: bfloat16
``` |