YosepMulia commited on
Commit
d49653d
·
verified ·
1 Parent(s): 7c0f472

Add LoRA adapter configuration

Browse files

Provide LoRA adapter configuration required for correct loading and reuse.

Files changed (1) hide show
  1. adapter_config.json +9 -0
adapter_config.json ADDED
@@ -0,0 +1,9 @@
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "peft_type": "LORA",
3
+ "task_type": "CAUSAL_LM",
4
+ "r": 16,
5
+ "lora_alpha": 32,
6
+ "lora_dropout": 0.05,
7
+ "bias": "none",
8
+ "target_modules": ["q_proj", "v_proj"]
9
+ }