inclusionAI

/

Ling-2.6-flash

like 464

Follow

inclusionAI 2.01k

Yes GGUF support please

I have this working locally with some K-quants and some initial llama.cpp for now, or at least it seems to so far. Hot off the agent presses, so holler if you run into issues:
https://huggingface.co/ssweens/inclusionAI__Ling-2.6-flash-GGUF-YMMV
https://github.com/ssweens/llama.cpp-ling-2.6