turboderp
/

granite-3.1-8b-instruct-exl2

Model card Files Files and versions

granite-3.1-8b-instruct-exl2 / README.md

turboderp's picture

Update README.md

8a783a5 verified over 1 year ago

|

History Blame Contribute Delete

648 Bytes

license: apache-2.0

EXL2 quants of granite-3.1-8b-instruct

4.00 bits per weight
5.00 bits per weight
6.00 bits per weight
8.00 bits per weight

measurement.json