Kimi-K2.5-PRISM-REAP-530B-A32B-i1-GGUF ?
#1882
by
Rebis - opened
Hi,
Could you make a version i1-GGUF of Kimi-K2.5-PRISM-REAP-530B-A32B (https://huggingface.co/Ex0bit/Kimi-K2.5-PRISM-REAP-530B-A32B) ?
This is the first Kimi-K2.5 REAP at 50% with SOTA PRISM on Hugging Face.
Thank you in advance.
Well, it's gated so I have to wait to get the access. Im not sure if it will quant because expert pruners usually modify model architecture and llama cpp doesnt like it
Hi,
You should normally have access now.
It seems access was blocked because they hadn't finished working on it.
Thank you in advance.
It's queued!
You can check for progress at http://hf.tst.eu/status.html or regularly check the model
summary page at https://hf.tst.eu/model#Kimi-K2.5-PRISM-REAP-530B-A32B-GGUF for quants to appear.