Recommended hardware
#1
by Test107 - opened
What would be the recommended hardware to run this model? does a Coral TPU help?
The easiest way to set up glimpse is by using Ollama. Unfortunately, since Ollama is based on llama.cpp, it does not support TPUs. Glimpse was tested on a mac mini, but I think other mini PCs will work as well. I'd be interested to hear what hardware you end up using, so I can collect some recommended hardware options.