Quantization request for Indian language based models BharatGenAI/Param2

#21
by praveenmaniyan - opened

Very much appreciate your work and dedication in releasing the quantized/gguf version of the various models.

Recently, India has also started releasing their own models and which support Indian languages, which is very diverse as you might be already aware. This give a good opportunity to validate if these are better from other models from a language diversity perspective.

Hence, would kindly request to support the quantization/gguf'ing of these models, and can be found at https://huggingface.co/bharatgenai/Param2-17B-A2.4B-Thinking

Thanks in advance.

Sign up or log in to comment