I used the official convert-hf-to-gguf.py script in the llama.cpp repo to generate these GGUF files. Let me know if there's anything else I can add here!
convert-hf-to-gguf.py
llama.cpp
Closed in favor of #3, I forgot to rename the model files and couldn't figure out how to do it inside huggingface
· Sign up or log in to comment
