Failing to load the model

#2
by itsanurag - opened

Unable to load the model via llama-cpp-python, always throws out the error: Failed to load model from file
Any solutions anyone has find? Because downloads are pretty large in number by people

It is pretty new so may need to wait for a llama-cpp-python update with latest changes from llama.cpp

It is pretty new so may need to wait for a llama-cpp-python update with latest changes from llama.cpp

Yeah thats indeed the case i think, will be looking to get this fixed by them
Thank you for follow up @bartowski

Using llama-cpp-python 0.3.16:

jinja2.exceptions.TemplateSyntaxError: Encountered unknown tag 'generation'. Jinja was looking for the following tags: 'elif' or 'else' or 'endif'. The innermost block that needs to be closed is 'if'.

Anyone else have this issue?

Sign up or log in to comment