try to import from pretrained failed
#4
by PotatoesJay - opened
Hi internLM team,
I try to import internLM-20b from local downloaded weight with the following sentence, but find it not working
model_dir='/home/nio/Downloads/internLM-20b'
model = AutoModelForCausalLM.from_pretrained(model_dir, trust_remote_code=True).cuda()
the AutoModelForCausalLM importing takes a long time and failed with only a 'Killed' message returned. What could be the probable reason for this?
just found it use out the memory. How much memory does it take?
same question.