RuntimeError: The model is currently loading, please re-run the query.
#2
by Manel-Hik - opened
Hi everyone
I'm trying to work with bloom for some NLP tasks in arabic
but I cannot import it
RuntimeError: The model is currently loading, please re-run the query.
model_id = "izhx/udever-bloom-1b1"
hf_token = "my_hf_token"
api_url = f"https://api-inference.huggingface.co/pipeline/feature-extraction/{model_id}"
headers = {"Authorization": f"Bearer {hf_token}"}
I'm working with GPU using 23028MiB
What should be the cause please
This seems to be a error of huggingface api.
You can try this model on you local device, by the following code:
# Load model directly
from transformers import AutoTokenizer, AutoModel
tokenizer = AutoTokenizer.from_pretrained("izhx/udever-bloom-1b1")
model = AutoModel.from_pretrained("izhx/udever-bloom-1b1")