Apple M1/M2/M3 - Metal
#1
by christianweyer - opened
Do you have an example to run this on Metal / MPS?
Thanks!
christianweyer changed discussion title from Apple M1/M2/M3 - Meta to Apple M1/M2/M3 - Metal
Hi Chris, I will work on it! I will let you know once we did it.
Do you have an example to run this on Metal / MPS?
Thanks!
alexchen4ai changed discussion status to closed
alexchen4ai changed discussion status to open
https://huggingface.co/NexaAIDev/octopus-v4-gguf
Hi Chris, please check out this link. Consider to use GGUF and ollama to run it on your computer. To utilize the M chip better, we still need more time to optimize it.
BTW: Would be nice to have an official model in the Ollama registry from you guys.
https://ollama.com/search?q=octo&p=1