What is the template used in bonito-v1?
#4
by pacozaa - opened
Hi! Awesome work on Bonito!
I converted bonito-v1 into GGUF(https://huggingface.co/pacozaa/bonito-gguf) and quantize it using llama.cpp, I would like to run the model using Ollama. Is there any template I should use?
Cheers!
nihalnayak changed discussion status to closed
I know this discussion has been closed already, but can we add this snippet from the GitHub discussion / paper in the model description card? Thanks!
<|tasktype|>
Yes-no question answering
<|context|>
Zinedine Zidane -- After retiring as a player, Zidane
transitioned into coaching, becoming assistant coach at
Real Madrid… after the victory, he resigned as Real
Madrid coach.
<|task|>
I shared the my discovery and ollama template here https://medium.com/@sarinsuriyakoon/convert-pytorch-model-to-quantize-gguf-to-run-on-ollama-5c5dbc458208
Thank you for the request. I will add the template to the model card description.