Mr-FineTuner commited on
Commit
2d5d875
·
verified ·
1 Parent(s): 7cb0eb5

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +14 -1
README.md CHANGED
@@ -7,7 +7,20 @@ tags:
7
  # Model Card for Model ID
8
 
9
  <!-- Provide a quick summary of what the model is/does. -->
10
-
 
 
 
 
 
 
 
 
 
 
 
 
 
11
 
12
 
13
  ## Model Details
 
7
  # Model Card for Model ID
8
 
9
  <!-- Provide a quick summary of what the model is/does. -->
10
+ model = FastLanguageModel.get_peft_model(
11
+ model,
12
+ r = 32
13
+ ,
14
+ target_modules = ["q_proj", "k_proj", "v_proj", "o_proj",
15
+ "gate_proj", "up_proj", "down_proj",],
16
+ lora_alpha = 16,
17
+ lora_dropout = 0.2,
18
+ bias = "none",
19
+ use_gradient_checkpointing = "unsloth",
20
+ random_state = 3407,
21
+ use_rslora = False, #
22
+ loftq_config = None, # And LoftQ
23
+ )
24
 
25
 
26
  ## Model Details