Loren's picture

1

Loren

lsmc

AI & ML interests

None yet

Recent Activity

new activity 17 days ago

nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-NVFP4:vLLM MTP unusable on RTX 6000 Pro, as spec decoding consumes 20GB+ VRAM at start-up, causing OOM

new activity 17 days ago

nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-NVFP4:vLLM MTP unusable on RTX 6000 Pro, as spec decoding consumes 20GB+ VRAM at start-up, causing OOM

new activity 19 days ago

nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-NVFP4:vLLM MTP unusable on RTX 6000 Pro, as spec decoding consumes 20GB+ VRAM at start-up, causing OOM

View all activity

Organizations

None yet

New activity in nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-NVFP4 17 days ago

vLLM MTP unusable on RTX 6000 Pro, as spec decoding consumes 20GB+ VRAM at start-up, causing OOM

#9 opened 19 days ago by

vLLM MTP unusable on RTX 6000 Pro, as spec decoding consumes 20GB+ VRAM at start-up, causing OOM

#9 opened 19 days ago by

New activity in nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-NVFP4 19 days ago

vLLM MTP unusable on RTX 6000 Pro, as spec decoding consumes 20GB+ VRAM at start-up, causing OOM

#9 opened 19 days ago by