gghfez
/

Mistral-Large-Instruct-2411-bnb-4bit

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions

bitsandbytes quant of mistralai/Mistral-Large-Instruct-2411

Fits in 80gb vram with unsloth at 8192 context.

Downloads last month: -

Safetensors

Model size

126B params

Tensor type

F32

·

BF16

·

U8

·