4-bit quantization for RedHatAI/Devstral-Small-2-24B-Instruct-2512

by jcordes - opened 21 days ago

Red Hat AI org 21 days ago

Will there be a 4-bit quantized model for RedHatAI/Devstral-Small-2-24B-Instruct-2512?

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment