SFT CUDA OOM
#2
by
Owos
- opened
I'm trying to finetune the model on an H100 but I keep getting CUDA OOM error, please how are you able to fit the model on a single gpu?
finetuning requires a cluster of A100 or H100. Atleast requires half. like 4.