DeusImperator/Lyra4-Gutenberg-12B_exl2_8bpw_max
Text Generation • Updated • 2 • 1
Exl2 8bpw MAX quants
8 BPW exl2 quants using modified quantization script to force using best quantization method for each layer for max quality
-
-
DeusImperator/Lyra4-Gutenberg-12B_exl2_8bpw_max_rpcal_mk2
Text Generation • Updated • 5 -
DeusImperator/Nemomix-v4.0-12B_exl2_8bpw_max
Text Generation • Updated • 1 -
DeusImperator/MN-12B-Lyra-v1_exl2_8bpw_max
Updated • 4 -
DeusImperator/MN-12B-Lyra-v4_exl2_8bpw_max_rpcal_mk2
Updated • 2 -
DeusImperator/Lumimaid-v0.2-12B_exl2_8bpw_max
Text Generation • Updated • 1 -
DeusImperator/Celeste-12B-V1.6_exl2_8bpw_max
Text Generation • Updated • 2 • 1 -
DeusImperator/mini-magnum-12b-v1.1_exl2_8bpw_max
Text Generation • Updated • 1 -
DeusImperator/MN-12B-Lyra-v4_exl2_8bpw_max
Updated • 2 -
DeusImperator/mistral-doryV2-12b_exl2_8bpw_max
Text Generation • Updated • 1