grimpep commited on
Commit
6dce8c1
·
1 Parent(s): 6eec095

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +20 -0
README.md CHANGED
@@ -1,3 +1,23 @@
1
  ---
2
  license: other
 
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: other
3
+ tags:
4
+ - llama
5
+ - llama-2
6
  ---
7
+ [Experimental model]
8
+
9
+ This model is an experiment using the frankenstein script from
10
+ https://huggingface.co/chargoddard/llama2-22b
11
+ BLOCK_DIAGONAL = False
12
+
13
+ Using:
14
+ https://huggingface.co/The-Face-Of-Goonery/Huginn-13b-FP16
15
+ +
16
+ Then used https://huggingface.co/upstage/llama-30b-instruct-2048
17
+ as donor model.
18
+
19
+ It used 160GB of system ram to merge these models, they merge fast without swap.
20
+
21
+ For prompt template and model information see [huginnV1](https://huggingface.co/The-Face-Of-Goonery/Huginn-13b-FP16).
22
+
23
+ This is probably my most coherent 22b model, this 22B model can still output spelling errors though.