|
|
--- |
|
|
license: llama2 |
|
|
base_model: |
|
|
- unsloth/llama-2-13b |
|
|
- layoric/llama-2-13b-code-alpaca |
|
|
- WizardLMTeam/WizardLM-13B-V1.2 |
|
|
tags: |
|
|
- merge |
|
|
pipeline_tag: text-generation |
|
|
--- |
|
|
|
|
|
--- |
|
|
license: llama2 |
|
|
base_model: |
|
|
- unsloth/llama-2-13b |
|
|
- layoric/llama-2-13b-code-alpaca |
|
|
- WizardLMTeam/WizardLM-13B-V1.2 |
|
|
tags: |
|
|
- merge |
|
|
pipeline_tag: text-generation |
|
|
--- |
|
|
# AIM Paper Checkpoints Uploaded For Replication |
|
|
This repository includes one of the checkpoints used in the paper "Activation-Informed Merging of Large Language Models". Specifics of this model are as follows: |
|
|
|
|
|
- **Merging Method:** task_arithmetic |
|
|
- **Models Used In Merging** |
|
|
- ***Base Model:*** unsloth/llama-2-13b |
|
|
- ***Code:*** layoric/llama-2-13b-code-alpaca |
|
|
- ***Instruction Tuned:*** WizardLMTeam/WizardLM-13B-V1.2 |
|
|
- **AIM:** True |
|
|
|
|
|
Benchmark results and paper details can be found at the official [GitHub](https://github.com/ahnobari/ActivationInformedMerging.git). |
