Building vllm eats my 64GB of RAM and a good chunk of swap
#2
by mirix - opened
Building vllm eats my 64GB of RAM and a good chunk of swap.
pip install "vllm @ git+https://github.com/Zyphra/vllm.git@zaya1"
My Linux workstation is frozen at the moment.
This does not happen if I build vllm from the official repo.
mirix changed discussion status to closed