abideen commited on
Commit
abd2cfb
·
verified ·
1 Parent(s): 9449c02

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +23 -0
README.md ADDED
@@ -0,0 +1,23 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ language:
4
+ - en
5
+ library_name: transformers
6
+ pipeline_tag: text-generation
7
+ ---
8
+
9
+ # MulitLoRA-Mistral-Merging
10
+ ![image/jpeg](https://cdn-uploads.huggingface.co/production/uploads/64e380b2e12618b261fa6ba0/A7u3zJDO6kUAdbS9pSIEt.jpeg)
11
+
12
+ MultiLoRA-Mistral-Merge is a MultiLoRA Ties Merge made with the following adapters using [🧜 AutoLoRAMerging](https://colab.research.google.com/drive/1cEj5p42NZ6Vg2HVYEGL2IM6n0G0gwvQU?usp=sharing):
13
+ * [Yhyu13/dolphin-2.6-mistral-7b-dpo-laser-function-calling-lora](https://huggingface.co/Yhyu13/dolphin-2.6-mistral-7b-dpo-laser-function-calling-lora)
14
+ * [predibase/legal](https://huggingface.co/predibase/legal)
15
+ * [predibase/wikisql](https://huggingface.co/predibase/wikisql)
16
+
17
+ ## 🧩 Configuration
18
+
19
+ ```yaml
20
+ density: 0.2
21
+ merging_type: "ties"
22
+ weights: [2.0, 0.3, 0.7]
23
+ ```