RedHatAI

/

Qwen3-8B-NVFP4

like 2

Follow

Red Hat AI 2.96k

Hi! I'm Niels from the Hugging Face community team.

This PR improves the model card for Qwen3-8B-NVFP4 by:

1. Adding a link to the original research paper: Mix-Quant: Quantized Prefilling, Precise Decoding for Agentic LLMs.
2. Linking the official GitHub repository and project page.
3. Adding library_name: vllm to the metadata to enable specialized UI features and reflect its primary deployment target.
4. Adding a BibTeX citation section.

These changes help users understand the context of the NVFP4 quantization applied here and find the relevant serving scripts for the Mix-Quant framework.