Share your training script?
#2
by JuLuComputing - opened
Thanks again for all your hard work on this! Would you please share your training script?
hi i used this repo and the example train.sh in it. everything was the same except i used bf16, xformers, batch size of 1, and 64 gradient accumulation steps
https://github.com/PygmalionAI/training-code