Create README.md

README.md

@@ -0,0 +1,20 @@
+---
+license: llama2
+
+tags:
+- merge
+- mergekit
+---
+Another trial of merging models with different sizes, still under testing, should be more stable, but I have no ideia if it's improving or degrading the base model.
+
+
+Recipe:
+```
+merge_method: task_anysize
+base_model: princeton-nlp/Sheared-LLaMA-2.7B-ShareGPT
+models:
+  - model: KoboldAI/Mistral-7B-Erebus-v3
+    parameters:
+      weight: 0.5
+dtype: bfloat16 
+```