Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Log In
Sign Up
rayraycano
/
finetune-demo-lora
like
0
Transformers
Safetensors
Generated from Trainer
trl
sft
Model card
Files
Files and versions
xet
Community
Deploy
Use this model
main
finetune-demo-lora
/
TODO.md
rayraycano
Training in progress, step 20
fcca8c8
verified
4 months ago
preview
code
|
raw
Copy download link
history
blame
contribute
delete
262 Bytes
todo list
[] Validation of parameters for combinations that won't work
things that are known not to work
FSDP offload and gradient_checkpointing -
https://github.com/pytorch/pytorch/issues/82203
adamw_bnb_8bit doesn't play well with FSDP offload