GGUF version?

by limcheekin - opened Apr 1, 2025

Thanks for sharing the model.

It seems like no one created a GGUF version of the model, I tried to create one but no luck.

It will be great if you guys publish the GGUF version of the model.

Thanks in advance.

I'm working on a GGUF version of the model, but it does require changes to llama.cpp to run as well. Working on it.

manyoso changed discussion status to closed Apr 1, 2025

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment