Is this model still in development?
I have tried using the code snippet for testing purpose of this LLM. but it is not working. Demo version is also not available for checking out. Can you please, assist if anything I am missing?
can you pleae specify the problem you are facing.
Please share screen shorts and error.
Demo Service is unavailable:
Local System Compile issue with the code snippet provided on the model card:
Model is running on local, try using streaming, as it is preffered.
You should install the requirements
pip install -q transformers torch accelerate
Actually the requirements are already installed. As shared the screenshots
Still, I was facing that issue. pls assist if anything else I am missing?
uninstall transformers torch accelerate and install again without mentioning version
pip install -q transformers torch accelerate
and the huggingface space is running now
Ok. I will check. Thank you!