QuantTrio
/

KAT-V1-40B-GPTQ-Int4-Int8Mix

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions

KAT-V1-40B-GPTQ-Int4-Int8Mix / vocab.json

JunHowie's picture

Upload folder using huggingface_hub

12b36ba verified 9 months ago

history contribute delete

2.78 MB

File too large to display, you can check the raw version instead.