Spaces:

Alovestocode
/

ZeroGPU-LLM-Inference

Sleeping

App Files Files Community

ZeroGPU-LLM-Inference / quantize_to_awq_colab.ipynb

Alikestocode's picture

Fix AWQModifier: use quantization_config with num_bits

022b2da 6 months ago

27.9 kB

Rendering notebook...