When automatically modifying the source in Cursor AI IDE

#6
by jungheekim - opened

Hi all I'm currently using 2 dgx spark. I successfully llama.cpp rpc glm4.7 with gguf, but it was slower than tps(6.2), so I moved it to vllm. But it's fast, but the source doesn't automatically change when calling from cursor ai. llama cpp rpc went well. Is there anyone who can change the cursor ai source from vllm?Please help me

Sign up or log in to comment