Loren

lsmc's activity

• All
• Models
• Datasets
• Spaces
• Buckets
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-NVFP4 2 months ago

vLLM MTP unusable on RTX 6000 Pro, as spec decoding consumes 20GB+ VRAM at start-up, causing OOM

5

#9 opened 2 months ago by

lsmc

vLLM MTP unusable on RTX 6000 Pro, as spec decoding consumes 20GB+ VRAM at start-up, causing OOM

5

#9 opened 2 months ago by

lsmc

vLLM MTP unusable on RTX 6000 Pro, as spec decoding consumes 20GB+ VRAM at start-up, causing OOM

5

#9 opened 2 months ago by

lsmc