ChenMnZ
/

Mixtral-8x7B-Instruct-v0.1-OmniQuantv1-w4a16g128

Text Generation

text-generation-inference

Model card Files Files and versions

Mixtral-8x7B-Instruct-v0.1-OmniQuantv1-w4a16g128 / README.md

ChenMnZ's picture

Create README.md

d04fa4e almost 2 years ago

|

history blame contribute delete

380 Bytes

Paper: https://arxiv.org/abs/2308.13137

Code: https://github.com/OpenGVLab/OmniQuant

To run this model, refer https://github.com/OpenGVLab/OmniQuant/blob/main/runing_quantized_mixtral_7bx8.ipynb for more details.