LoRA_1484_image / Hyper_params.md
ayushadarsh7's picture
Create Hyper_params.md
0f41e5d verified
|
Raw
History Blame Contribute Delete
186 Bytes
num_epochs = 10
-batch_size", type=int, default=1
--gradient_accumulation_steps = 4
--learning_rate = 2e-4
--lora_alpha", type=int, default=16
--merge_and_save", action="store_true