Pruned version?
#3
by stfred - opened
From the size I am guesing this is based on the unpruned version, any plans to also quantize the pruned one for even smaller GPUs / longer contexts?
I don’t think they've released any pruned or turbo version; this is currently the only version for both FL2VA and REF2VA.