BechusRantus's picture
Upload folder using huggingface_hub
7134ce7 verified
ASCEND_RT_VISIBLE_DEVICES=0 swift deploy \
--model Qwen/Qwen2.5-7B-Instruct \
--infer_backend vllm \
--served_model_name Qwen2.5-7B-Instruct