Local LLM option?

#1
by Kjay - opened

Hi, many thanks for this app. It looks very nice and the layout is great, very polished .
Any chance of incorporating local LLMs as well as the APIs?
Muchas gracias.

I keep getting connection refused errors when trying to connect to my local Ollama for windows. Ollama does properly connect to other software without issue so I know it is serving.
I tried http://localhost:11434 and http://127.0.0.1:11434 The first gives an unknown url error. The second a connection refused.

Any assistance would be greatly appreciated.

Sign up or log in to comment