Mr-FineTuner commited on
Commit
6311f40
·
verified ·
1 Parent(s): d6b0111

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +18 -1
README.md CHANGED
@@ -8,7 +8,24 @@ tags:
8
 
9
  <!-- Provide a quick summary of what the model is/does. -->
10
 
11
-
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
12
 
13
  ## Model Details
14
 
 
8
 
9
  <!-- Provide a quick summary of what the model is/does. -->
10
 
11
+ model = FastLanguageModel.get_peft_model(
12
+ model,
13
+ r = 128, # Choose any number > 0 ! Suggested 8, 16, 32, 64, 128
14
+
15
+ target_modules = ["q_proj", "k_proj", "v_proj", "o_proj",
16
+ "gate_proj", "up_proj", "down_proj",],
17
+
18
+ lora_alpha = 8,
19
+
20
+ lora_dropout = 0.2, # Supports any, but = 0 is optimized
21
+
22
+ bias = "none", # Supports any, but = "none" is optimized
23
+
24
+ use_gradient_checkpointing = "unsloth",
25
+ random_state = 3407,
26
+ use_rslora = False, #
27
+ loftq_config = None, # And LoftQ
28
+ )
29
 
30
  ## Model Details
31