drexample
/

Monstral-123B_5.5bpw_EXL2

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions

5bpw EXL2 quant of https://huggingface.co/MarsupialAI/Monstral-123B

Default settings and dataset utilized for measurements.

Downloads last month: 2