Add config_format and load_format to vLLM args

by mgoin - opened Nov 19, 2024

←

•

This specification is needed now that there is a HF config present

patrickvonplaten changed pull request status to merged Nov 19, 2024

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment