Mr-FineTuner commited on
Commit
98811c7
·
verified ·
1 Parent(s): ffe2ca8

Update readme

Browse files
Files changed (1) hide show
  1. README.md +13 -1
README.md CHANGED
@@ -14,7 +14,19 @@ tags:
14
 
15
  ### Model Description
16
 
17
- <!-- Provide a longer summary of what this model is. -->
 
 
 
 
 
 
 
 
 
 
 
 
18
 
19
  This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated.
20
 
 
14
 
15
  ### Model Description
16
 
17
+ model = FastLanguageModel.get_peft_model(
18
+ model,
19
+ r = 64, # Choose any number > 0 ! Suggested 8, 16, 32, 64, 128
20
+ target_modules = ["q_proj", "k_proj", "v_proj", "o_proj",
21
+ "gate_proj", "up_proj", "down_proj",],
22
+ lora_alpha = 8,
23
+ lora_dropout = 0.2, # Supports any, but = 0 is optimized
24
+ bias = "none", # Supports any, but = "none" is optimized
25
+ use_gradient_checkpointing = "unsloth",
26
+ random_state = 3407,
27
+ use_rslora = False, #
28
+ loftq_config = None, # And LoftQ
29
+ )
30
 
31
  This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated.
32