Alpha-VLLM
/

Lumina-Next-T2I

Model card Files Files and versions

Can you add an fp8 or int4 quantization loader?

#3

by win10 - opened May 25, 2024

Can you add an fp8 or int4 quantization loader?
Please, please let 3050 generate a picture in at least 30 seconds.

We will released int8 or int4 model in the future. please stay tunned.

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment