ISTA-DASLab
/

Mixtral-8x7B-Instruct-v0_1-AQLM-2Bit-1x16-hf

Text Generation

text-generation-inference

Model card Files Files and versions

Resources

View closed (2)

Clinical Quant

#5 opened over 1 year ago by

One needs a Qwen 72B AQLM

#4 opened almost 2 years ago by

ZN2at4_ops15sum_IntList_out4callERKNS_6TensorEN3c1016OptionalArrayRefIlEEbSt8optionalINS5_10ScalarTypeEERS2

#3 opened almost 2 years ago by