Update README.md

README.md

@@ -18,6 +18,15 @@ LRC-1.7B-Base is a base pre-trained model. While it has not undergone specific S
 
 ## How to Get Started with the Model
 
+**❗ Critical:** For vLLM serving, please specify `model-impl==transformers` when using qwen series model. This is because, in the current implementation of vLLM, the qwen model does not support setting a custom `head_dim` through the config. Fortunately, vLLM allows using transformers as the backend.
+
+Tested versions that can serve properly: `vllm==0.8.5.post1` and `transformers==4.51.3`.
+
+Serve command:
+```commandline
+vllm serve JitaiHao/LRC-1.7B-Base --model-impl transformers
+```
+
 ```python
 from transformers import AutoTokenizer, AutoModelForCausalLM