numen-tech
/

Mistral-7B-Instruct-v0.2-w3a16g40sym

Model card Files Files and versions

Mistral-7B-Instruct-v0.2-w3a16g40sym / README.md

numen-tech's picture

Add weights

9620ac6 almost 2 years ago

|

history blame contribute delete

189 Bytes

	---
	license: apache-2.0
	---

	3-bit [OmniQuant](https://arxiv.org/abs/2308.13137) quantized version of [Mistral-7B-Instruct-v0.2](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.2).