SFT CUDA OOM

#2
by Owos - opened

I'm trying to finetune the model on an H100 but I keep getting CUDA OOM error, please how are you able to fit the model on a single gpu?

finetuning requires a cluster of A100 or H100. Atleast requires half. like 4.

Sign up or log in to comment