Please add GGUF options
#3
by YuLexuan30 - opened
The 35GB models are too large for most local setups. Please provide smaller GGUF files for lower-end GPUs.
The 35GB models are too large for most local setups. Please provide smaller GGUF files for lower-end GPUs.