https://huggingface.co/zai-org/GLM-4.6V
#1586
by
SabinStargem
- opened
This one is about 106b, and going by the name, I am guessing it is a vision model?
We need to wait for https://github.com/ggml-org/llama.cpp/pull/16600 to be merged first. That PR unfortunately seems somewhat stale as the last commit was 1 month ago.
It's queued!
You can check for progress at http://hf.tst.eu/status.html or regularly check the model
summary page at https://hf.tst.eu/model#GLM-4.6V-GGUF for quants to appear.