Please add GGUF support for Hebrew Leaderboard
#1
by SicariusSicariiStuff - opened
Hi, I didn't know how else to contact you,
Kindly please add GGUF support for the leaderboard. GPTQ is a depreciate format, EXL2 or GGUF would provide better compatibility with quantized models.
Thank you.
Hi,
Feel free to also open a discussion on the leaderboard page.
Regarding support for GGUF - the leaderboard uses the lighteval library with the HF endpoints deployed with a TGI container. In order to support GGUF we would have to create a container which serves a GGUF model on a TGI-compatible server.
We'll add it to the list, but it can take some time until we add support for it.