Please provide gguf

#4
by hgeist - opened

These numbers look incredible and I was very surprised by the preview already.

Could you provide a Q8 and Q4 gguf please?

SenseNova org

Thanks for the kind words! We expect to release both Q8 and Q4 GGUF versions tomorrow, along with llama.cpp support. Stay tuned!

Would you mind if I made a post about your model in r/LLocallaMa or would you rather wanna post about it yourself?

SenseNova org

We’d love for the community to help spread the word, so please feel free to post! We’ll likely make a post ourselves as well.

Thanks for the kind words and your interest! We've already released GGUF quantized versions of the model. You can find them here: https://huggingface.co/sensenova/SenseNova-Loop-9B-GGUF/

Sign up or log in to comment