Removes `quantization_config` from config.json

by sonnymodular - opened Jan 29

←

Modular, Inc. org Jan 29

Testing to see if this solves the issue with vLLM running this model

Modular, Inc. org Jan 29

I created a PR, and now I'll merge my PR.

sonnymodular changed pull request status to merged Jan 29

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment