yuccaaa commited on
Commit
a1896ac
·
verified ·
1 Parent(s): ca6e780

Upload ms-swift/examples/deploy/bert/server.sh with huggingface_hub

Browse files
ms-swift/examples/deploy/bert/server.sh ADDED
@@ -0,0 +1,10 @@
 
 
 
 
 
 
 
 
 
 
 
1
+ # Since `swift/test_lora` is trained by swift and contains an `args.json` file,
2
+ # there is no need to explicitly set `--model`, `--system`, etc., as they will be automatically read.
3
+ CUDA_VISIBLE_DEVICES=0 swift deploy \
4
+ --host 0.0.0.0 \
5
+ --port 8000 \
6
+ --adapters swift/test_bert \
7
+ --served_model_name bert-base-chinese \
8
+ --infer_backend pt \
9
+ --truncation_strategy right \
10
+ --max_length 512