File size: 593 Bytes
5600920 6dce8c1 5600920 6dce8c1 7be292e | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 | ---
license: other
tags:
- llama
- llama-2
---
[Experimental model]
This model is an experiment using the frankenstein script from
https://huggingface.co/chargoddard/llama2-22b
BLOCK_DIAGONAL = False
Using:
https://huggingface.co/The-Face-Of-Goonery/Huginn-13b-FP16
+
Then used https://huggingface.co/upstage/llama-30b-instruct-2048
as donor model.
It used 160GB of system ram to merge these models, they merge fast without swap.
For prompt template and model information see [huginnV1](https://huggingface.co/The-Face-Of-Goonery/Huginn-13b-FP16). |