Hugging Face's logo

vllm-sr
/
d3-NVFP4

Zero-Shot Classification
Transformers
Safetensors
qwen3_5
feature-extraction
decision-model
classification
system-one
multimodal
vision
video
quantized
compressed-tensors
nvfp4
custom_code
8-bit precision
Model card Files
xet
 Community
d3-NVFP4

Commit History

3 days ago

  1. Prepare for publishing: current d3_runtime.py, no local paths, drop dev eval files⁠

    TheoHsiung
    Verified signature
    95a92cc

  2. Card: serve with vllm-sr Engine mode (#5225, #5233 merged); merged projections

    TheoHsiung
    Verified signature
    49dc8b0

4 days ago

  1. Add MODEL_MANIFEST.json for the vLLM Semantic Router model runtime

    TheoHsiung
    Verified signature
    446ce02

5 days ago

  1. Card: latency served at --dtype auto (23.2 ms), exact-kernel columns kept

    TheoHsiung
    Verified signature
    0a86c1c

6 days ago

  1. Card: tasksource test split through the model runtime (82.71%, 96.64% agreement)

    TheoHsiung
    Verified signature
    07fa5a0

7 days ago

  1. Card: Decision Index, public vision suite and Perception Test through the model runtime with NVFP4 support (64.83, 73.60, 76.57%)

    TheoHsiung
    Verified signature
    90dfece

  2. Card: why NVFP4 needs graphs (kernel launches), shorter serving notes

    TheoHsiung
    Verified signature
    880ec9a

  3. Card: optimized NVFP4 layers next to the first ones (28.5 ms with graphs, 48.0 ms without), and what changed

    TheoHsiung
    Verified signature
    5cc266a

  4. Model card in the d3-FP8 card's layout: Decision Index per area with agreement, serving performance on RTX PRO 6000 with the NVFP4 runtime of #5145

    TheoHsiung
    Verified signature
    c998473

9 days ago

  1. Model card: drop tasksource eval600 (superseded by the full test split, which the runtime cannot run on NVFP4)

    TheoHsiung
    Verified signature
    05e5771

  2. Model card: the vLLM Semantic Router runtime (#5066) loads FP8 and int4, not NVFP4; link d3-FP8 and d3-W4A16-G128-AWQ

    TheoHsiung
    Verified signature
    de3214b

  3. Decision Index public suite: d3-NVFP4 complete (64.72, 96.96% agreement with BF16); text table with BF16 deltas

    TheoHsiung
    Verified signature
    cce3779

10 days ago

  1. Model card in the d3 card's layout; full-suite evaluation (in progress); add d3q_engine.py

    TheoHsiung
    Verified signature
    23d7073

  2. NVFP4 (W4A4) quantization of vllm-sr/d3 with FP4 runtime kernels and eval results

    Hsiung Li Syun
    Verified signature
    61b3f92

  3. initial commit

    Hsiung Li Syun
    Verified signature
    cf91b69