FP8 & Quantized version request.
#1
by
RedwanRafi
- opened
Please Upload the fp8 and quantized model! As most of the user own less then 16gb GPU.
Please Upload the fp8 and quantized model! As most of the user own less then 16gb GPU.