any chance of an int8/int4 versions for turing gpus?

#23
by rvelloso - opened

any chance of an int8 and/or int4 versions for vllm+turing gpus?

Sign up or log in to comment