humanoid-instruction-validator / adapter_config.json
YosepMulia's picture
Add LoRA adapter configuration
d49653d verified
{
"peft_type": "LORA",
"task_type": "CAUSAL_LM",
"r": 16,
"lora_alpha": 32,
"lora_dropout": 0.05,
"bias": "none",
"target_modules": ["q_proj", "v_proj"]
}