How did you do it?May I ask what quantization method is being used?

by DarrenChen - opened Jun 4

Jun 4

AWQ? I saw in your project that it supports models in AWQ quantization format.

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment