PPL and KLD graphs for each quant
#7
by laaaaaaaaaaaaaaaaaaaa - opened
It would be great if the Unsloth team could create a graph with model size (gb) and KLD/PPL to show the loss in quality between each quant because I have heard many mixed messages on what to use. If this could be done, thank you!