Spaces:

GakkiLi
/

simcourt

Build error

simcourt / api_pool /run_local_model_base.sh

Upload folder using huggingface_hub

94bdfd0 verified 9 months ago

114 Bytes

CUDA_VISIBLE_DEVICES=0,1,2,3,4,5,6,7 uvicorn local_model_api_vllm_base:app --reload --host='127.0.0.1' --port=8005