What are the differences between MFxP4, Q4, and UD-Q4 quantization? Which one is better to use on an AMD 395?

by wszgrcy - opened Feb 4

Feb 4

Although the AMD 395 can run Q8 models, I'm still curious about what advantages MXFP4 quantization might offer.

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment