Any gradio solution for this?
#5
by
aamindart
- opened
I wonder if i can use this gguf model with gradio, if yes which code(repo) I will need to use? please sombody help me. I am using colab, comfy ui becomes very difficult to use in colab. as you know colab has l4 and a100, will it be enough for this?
im not sure how to run this there, you might check out calcuis, he has a gradio app if im not mistaken and his own quants
ok thanks