CohereLabs/tiny-aya-water

#2465
by erenyeager-1 - opened

https://huggingface.co/CohereLabs/tiny-aya-water

can you make this IQ4_XS? It would be a great help if you could!
I got an error like this:
"
(...)
File "/home/user/app/llama.cpp/conversion/base.py", line 1592, in get_vocab_base_pre
raise NotImplementedError("BPE pre-tokenizer was not recognized - update get_vocab_base_pre()")
NotImplementedError: BPE pre-tokenizer was not recognized - update get_vocab_base_pre()
"

the problem is that we might get this error as well because we are using the main llamacpp only, but let's see
It's queued!

You can check for progress at http://hf.tst.eu/status.html or regularly check the model
summary page at https://hf.tst.eu/model#tiny-aya-water-GGUF for quants to appear.

Sign up or log in to comment