Convrot versions of the Newer Models
#75
by anum07 - opened
Do u release convrot versions for the newer models? Beta 6 or Beta 7..
Those int8 are convrot, yes (actually, any integer quantization at this point should be convrot really)
You can take those, or if you need one slightly smaller the one in my repo (it's linked in TenStrip card, just one level above the sample workflows for Beta 7). Its a w6a8/int8 hybrid with learned weights (convrot ofc).