WizardLM 13B v1.1 GPTQ
From: https://huggingface.co/WizardLM/WizardLM-13B-V1.1
| Model | Bits | Group Size | Act Order (desc_act) | File Size | ExLlama Compatible? | Made With | Description |
|---|---|---|---|---|---|---|---|
| wizardlm-13b-v1.1-GPTQ-4bit-128g.no-act.order | 4 | 128 | False | 7.45 GB | True | GPTQ-for-LLaMa | Most compatible. Good inference speed in AutoGPTQ and GPTQ-for-LLaMa. |
- Downloads last month
- -