Any KDL and PPL benchmarks? Would be useful.
#2
by EclipseMist - opened
Considering a bunch of unsloth Minimax m2.7 quants were showing NaN I think a KLD and PPL benchmark on these quants would be worthwhile or else downloading them is really a roll of the dice. Ive already noticed UD IQ4_NL performs pretty poorly, worse than UD Q3_K_XL minimax m2.5 which is concerning.
This would be great as I hear good things about APEX quants.