Portuguese GGUFs?
#1
by
xande-p
- opened
Given your previous work on pt models, any chance these GGUFs are imatrix-portuguese?
They are just the original FP16 ggufs quantized to 4bit, to be used in this library I am building (just for fun)
https://github.com/cnmoro/tiny-lfm-builtin
https://pypi.org/project/tiny-lfm-builtin
I will look into the imatrix quantization with ptbr data for these models