notebook script fails on LambdaLabs cloud
#1
by bdambrosio - opened
running python 3.8.x
Complains about versionitis deep down in tensorboard.protobuf.
Do I just need a later python, then reinstall everything?
bdambrosio changed discussion title from notebook script fails on LambdaLabs cloud running python 3.8.x Complains about versionitis deep down in tensorboard.protobuf. to notebook script fails on LambdaLabs cloud
Well, try a newer version please. The more recent it is, the better it will be.
Ok, but turns out lambdacloud is a pain to use unless you want to keep the instance running 24/7
Do you think I can run 13B on a pair of K80s? each one has 24GB and 2 gpus. They are pretty cheap (~$100 on ebay), appreciate your thoughts.
bdambrosio changed discussion status to closed
bdambrosio changed discussion status to open
Yes, you can. Additionally, ensure that there is at least 24G of free memory. To lower the memory cost, use the following command:
python3 -m fastchat.serve.cli --model-name /content/drive/MyDrive/AI/fastchat/vicuna-13b --load-8bit