EXL2 quants of Nanbeige4.1-3B-heretic

All quantizations have 8-bit heads.

  • 6.0 bpw (3.6 GB)
  • More soon; 8.0bpw next!
Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for megabytes/Nanbeige4.1-3B-heretic-exl2

Quantized
(1)
this model