| license: llama2 | |
| library_name: transformers | |
| pipeline_tag: text-generation | |
| base_model: | |
| - unsloth/llama-2-13b | |
| - layoric/llama-2-13b-code-alpaca | |
| - vanillaOVO/WizardMath-13B-V1.0 | |
| tags: | |
| - merge | |
| --- | |
| --- | |
| license: llama2 | |
| base_model: | |
| - unsloth/llama-2-13b | |
| - layoric/llama-2-13b-code-alpaca | |
| - vanillaOVO/WizardMath-13B-V1.0 | |
| tags: | |
| - merge | |
| --- | |
| # AIM Paper Checkpoints Uploaded For Replication | |
| This repository includes one of the checkpoints used in the paper "[Activation-Informed Merging of Large Language Models](https://huggingface.co/papers/2502.02421)". Specifics of this model are as follows: | |
| - **Merging Method:** ties | |
| - **Models Used In Merging** | |
| - ***Base Model:*** unsloth/llama-2-13b | |
| - ***Code:*** layoric/llama-2-13b-code-alpaca | |
| - ***Math:*** vanillaOVO/WizardMath-13B-V1.0 | |
| - **AIM:** True | |
| Benchmark results and paper details can be found at the official [GitHub](https://github.com/ahnobari/ActivationInformedMerging.git). |