Will there be a dynamic bnb quantized version?
#1
by bertbobson - opened
I see you guys have only focused on GGUF recently for dynamic quants. The BNB quants were extremely useful for training. Any chance they could make a comeback?
Yes, recently we haven't done them as every model is MoE so we forgot, we're going to do them hopefully soon
Thanks, I hope to see it when there is time!
bertbobson changed discussion status to closed