quant of Poro-34b oasst2 instruct version https://huggingface.co/LumiOpen/Poro-34B-chat-OpenAssistant
I couldn't find quants for this anywhere. I understand it is quite niche model since it is finnish language mainly.
https://huggingface.co/LumiOpen/Poro-34B-chat-OpenAssistant
It's queued! :D
Never hesitate to request a great model we missed.
You can check for progress at http://hf.tst.eu/status.html or regularly check the model
summary page at https://hf.tst.eu/model#Poro-34B-chat-OpenAssistant-GGUF for quants to appear.
BloomForCausalLM from 2022 is quite a niche architecture nowadays but luckily it is still supported by llama.cpp.
The OpenAssistant dataset is old as well but still one of the best datasets to this day due to the massive amount of manual work that went into creating it.
Amazing, thank you! 🙏🏻
Yes, I figured since you have already made quants from earlier release of it. Options with finnish are not too many, so I would like to see if oasst instruct would provide improvement to this model. While most small models understand finnish perfectly fine, but don't produce correct grammar.