styal
/

Mistral-7b-4bit

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions

Model Card

This model is a 4bits quantized version of Mistral 7b. -> https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.3

Downloads last month: 3

Safetensors

Model size

7B params

Tensor type

F32

·

F16

·

U8

·