10/10 Best EXL3 model card
#3
by
gghfez
- opened
Thank you for the detailed exllamav3 and (and general MoE quantization documentation), citations and explanations.
This was a great read!
Glad you liked it!
I agree, very informative, also I'm enjoying using the 3.84bpw tuned :-)
Happy to praise your work here too... 2.57bpw-tuned and wow... what a blessing this is for the knowledgeable community!