mlx-community
/

LongCat-Flash-Lite-4bit

Text Generation

longcat_flash_ngram

4-bit precision

Model card Files Files and versions

How can this be used with vLLM?

#1

by TomLucidor - opened 1 day ago

1 day ago

There seems to be an issue with ValueError: Model type longcat_flash_ngram not supported. here

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment