yuccaaa commited on
Commit
6268cef
·
verified ·
1 Parent(s): fd9e05e

Upload ms-swift/examples/app/base_url/demo.sh with huggingface_hub

Browse files
ms-swift/examples/app/base_url/demo.sh ADDED
@@ -0,0 +1,7 @@
 
 
 
 
 
 
 
 
1
+ # You need to have a deployed model or api service first
2
+ CUDA_VISIBLE_DEVICES=0 swift app \
3
+ --model '<model_name>' \
4
+ --base_url http://127.0.0.1:8000/v1 \
5
+ --stream true \
6
+ --max_new_tokens 2048 \
7
+ --lang zh