eliuakk
/

mirau-agent-14b-base

Text Generation

Model card Files Files and versions

eliuakk commited on Jun 20, 2025

Commit

bfaae7e

·

verified ·

1 Parent(s): 93e7be0

fix deploy bug

Files changed (1) hide show

README.md +2 -1

README.md CHANGED Viewed

@@ -33,7 +33,8 @@ CUDA_VISIBLE_DEVICES=0 swift deploy\
     --tensor_parallel_size 1\
     --gpu_memory_utilization 0.9 \
     --max_model_len 16312 \
-    --vllm_max_lora_rank 64
 ```
 ### Tool Definition

     --tensor_parallel_size 1\
     --gpu_memory_utilization 0.9 \
     --max_model_len 16312 \
+    --vllm_max_lora_rank 64 \
+    --use_hf true
 ```
 ### Tool Definition