bnjmnmarie's picture
Upload folder using huggingface_hub
90f0503 verified
metadata
license: apache-2.0
base_model:
  - Qwen/Qwen3-VL-2B-Instruct
tags:
  - nvfp4

This is Qwen/Qwen3-VL-2B-Instruct quantized with LLM Compressor in NVFP4 (llm-compressor format). The model has been created, tested, and evaluated by The Kaitchup. The model is compatible with vLLM (as of v0.12).

How to Support My Work

Subscribe to The Kaitchup. This helps me a lot to continue quantizing and evaluating models for free. Or you prefer to give some GPU hours, "buy me a coffee"