| --- |
| license: other |
| tags: |
| - llama |
| - llama-2 |
| --- |
| [Experimental model] |
| |
| This model is an experiment using the frankenstein script from |
| https://huggingface.co/chargoddard/llama2-22b |
| BLOCK_DIAGONAL = False |
| |
| Using: |
| https://huggingface.co/The-Face-Of-Goonery/Huginn-13b-FP16 |
| + |
| Then used https://huggingface.co/upstage/llama-30b-instruct-2048 |
| as donor model. |
| |
| It used 160GB of system ram to merge these models, they merge fast without swap. |
| |
| For prompt template and model information see [huginnV1](https://huggingface.co/The-Face-Of-Goonery/Huginn-13b-FP16). |
