REAP-ing/REAM-ing LongCat-Flash-Lite
#5
by
TomLucidor - opened
Since the rumors of the embedding tables going to disk is not true, it would be fun if the model can be pruned to a form factor closer to 32GB/48GB range of machines. Even at Q4 this model is already taking up 40GB of space!