Failed to import - PackageNotFoundError: No package metadata was found for bitsandbytes
#1
by FelipeCasali-USP - opened
Could you please help to address this issue when running this model locally?
Jypter Notebook in Visual Studio
Python 10 and 11
you need to install bitsandbytes:
pip install bitsandbytes
Ashishkr changed discussion status to closed
I imported the bitsandbytes, but it seems I don't have permission to load this project.
I'm logged in HF with my token.
OSError: You are trying to access a gated repo.
Make sure to request access at https://huggingface.co/meta-llama/Llama-2-7b-hf and pass a token having permission to this repo either by logging in with huggingface-cli login or by passing token=<your_token>.
hf_auth = "hf_your-huggingface-access-token"
you need to provide your hf access token here.