Vram requirement

#10
by Wu234 - opened

Can I run it with RTX 1060 6gb VRAM?

If with fp8 quant you can,but still slow

Fish Audio org

Using tensor parallelism.

Sign up or log in to comment