how tu quant to fp8?

by yebo8964 - opened 14 days ago

hello~ May I ask how you quantized GLM-5 from FP16 to FP8?

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment