metadata
base_model:
- Vikhrmodels/Vistral-24B-Instruct
Straightforward dynamic FP8 quant using llmcompressor. Nice for performance on Hopper and Blackwell GPUs.
Tested with nightly vllm on November 25-26, 2025.