Model keeps downloading
#158
by 1geek0 - opened
The model keeps downloading over and over again
These are the only lines of code I've run:
from transformers import AutoTokenizer,AutoModelForCausalLM
tokenizer = AutoTokenizer.from_pretrained("bigscience/bloom")
model = AutoModelForCausalLM.from_pretrained("bigscience/bloom", device_map="auto",
torch_dtype="auto")```
This is expected. The model is 350gb so we actually save it in shards, seperate smaller files. So you have to download all the shards to get it working.
Ah, didn't read the model size. Thanks
1geek0 changed discussion status to closed