| | ---
|
| | base_model:
|
| | - Qwen/Qwen2-72B-Instruct
|
| | - alpindale/magnum-72b-v1
|
| | library_name: transformers
|
| | tags:
|
| | - mergekit
|
| | - merge
|
| | - OG_finetune_merge
|
| | license: other
|
| | language:
|
| | - en
|
| | ---
|
| | |
| | WIP of retouched [alpindale/magnum-72b-v1](https://huggingface.co/alpindale/magnum-72b-v1) but I will not use "Magnum" in the name. Call it FinalMix! |
| |
|
| | Found some issues, trying to fix them for my own usage and adding more RP data with merging. |
| |
|
| | You can do your own quantized files with the [imatrix.dat file](https://huggingface.co/Undi95/MG-FinalMix-72B/blob/main/imatrix.dat) done with "[wiki.train.raw](https://cosmo.zip/pub/datasets/wikitext-2-raw/)". |
| |
|
| | Credits to [Alpin](https://huggingface.co/alpindale) and the gang for [magnum-72b-v1](https://huggingface.co/alpindale/magnum-72b-v1), and [Ikari](https://huggingface.co/ikaridev) for his datasets. |
| |
|
| | ### Prompt template ChatML |
| |
|
| |
|
| | ``` |
| | <|im_start|>system |
| | {system_prompt}<|im_end|> |
| | <|im_start|>user |
| | {prompt}<|im_end|> |
| | <|im_start|>assistant |
| | {output}<|im_end|> |
| | ``` |
