tacos4me
/

Step-3.5-Flash-NVFP4

Generates incoherent outputs for me with VLLM 0.18

by catplusplus - opened 13 days ago

Like Chinese characters and not answering my actual question. Any KIs/workarounds?

This is on NVIDIA Thor dev kit

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment