--- base_model: - FPHam/L3-8B-Everything-COT - Azazelle/Llama-3-LongStory-LORA - FPHam/L3-8B-Everything-COT - nothingiisreal/llama3-8B-DWP-lora - FPHam/L3-8B-Everything-COT - Azazelle/Llama-3-8B-Abomination-LORA - FPHam/L3-8B-Everything-COT - ResplendentAI/NoWarning_Llama3 library_name: transformers tags: - mergekit - merge --- # merge This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit). ## Merge Details ### Merge Method This model was merged using the [Linear](https://arxiv.org/abs/2203.05482) merge method. ### Models Merged The following models were included in the merge: * [FPHam/L3-8B-Everything-COT](https://huggingface.co/FPHam/L3-8B-Everything-COT) + [Azazelle/Llama-3-LongStory-LORA](https://huggingface.co/Azazelle/Llama-3-LongStory-LORA) * [FPHam/L3-8B-Everything-COT](https://huggingface.co/FPHam/L3-8B-Everything-COT) + [nothingiisreal/llama3-8B-DWP-lora](https://huggingface.co/nothingiisreal/llama3-8B-DWP-lora) * [FPHam/L3-8B-Everything-COT](https://huggingface.co/FPHam/L3-8B-Everything-COT) + [Azazelle/Llama-3-8B-Abomination-LORA](https://huggingface.co/Azazelle/Llama-3-8B-Abomination-LORA) * [FPHam/L3-8B-Everything-COT](https://huggingface.co/FPHam/L3-8B-Everything-COT) + [ResplendentAI/NoWarning_Llama3](https://huggingface.co/ResplendentAI/NoWarning_Llama3) ### Configuration The following YAML configuration was used to produce this model: ```yaml models: - model: FPHam/L3-8B-Everything-COT+ResplendentAI/NoWarning_Llama3 - model: FPHam/L3-8B-Everything-COT+Azazelle/Llama-3-LongStory-LORA - model: FPHam/L3-8B-Everything-COT+Azazelle/Llama-3-8B-Abomination-LORA - model: FPHam/L3-8B-Everything-COT+nothingiisreal/llama3-8B-DWP-lora parameters: weight: 1.0 merge_method: linear dtype: float16 ```