Quantisation support for this model
#14
by
dineshananthi
- opened
Quantisation support for this model - Do we have the plan for it
Pleas , Quantisation support for this model
RUN with Ollama
Working on this, stay tuned ♥️
I am going to serve this model using vLLM
Эта модель Quantisation =)))