How do you download the whole pack of files?
Srry I'm very new to the site and I can't do shit, I don't know how to install files!!
You can git clone the repo to get all the files:
git lfs install
git clone https://huggingface.co/EleutherAI/gpt-j-6B
Also you just download the model weights and then use them at inference when loading it from the transformers library:
from transformers import AutoTokenizer, AutoModelForCausalLM
tokenizer = AutoTokenizer.from_pretrained("EleutherAI/gpt-j-6B")
model = AutoModelForCausalLM.from_pretrained("EleutherAI/gpt-j-6B")
i tried the above command. after downloading the model to 100%, it gets killed. A quick fix/response would be highly appriciated.
@majidbhatti I think the issue is with memory. It loads 42GB of the model weights. So I think using a large RAM instance will help.