yuccaaa commited on
Commit
3ec987b
·
verified ·
1 Parent(s): 57d2ab6

Upload ms-swift/examples/deploy/lora/server.sh with huggingface_hub

Browse files
ms-swift/examples/deploy/lora/server.sh ADDED
@@ -0,0 +1,7 @@
 
 
 
 
 
 
 
 
1
+ # Since `swift/test_lora` is trained by swift and contains an `args.json` file,
2
+ # there is no need to explicitly set `--model`, `--system`, etc., as they will be automatically read.
3
+ CUDA_VISIBLE_DEVICES=0 swift deploy \
4
+ --host 0.0.0.0 \
5
+ --port 8000 \
6
+ --adapters lora1=swift/test_lora lora2=swift/test_lora2 \
7
+ --infer_backend vllm