lmz
/

candle-quantized-t5

text2text-generation

text-generation-inference

Model card Files Files and versions

Flan-t5-xl.gguf missing

#2

by bayang - opened Dec 8, 2023

•

edited Dec 8, 2023

Can I do a PR to your repo? just to contribute.
xl GGUF on your github

Owner Dec 8, 2023

Sure thing!

What x-bit integer quantization support did you use to generate the flan-t5-large.gguf ?
(q6k)?

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment