Update README.md

README.md

@@ -40,6 +40,36 @@ These metrics demonstrate robust acceleration performance across diverse and com
 ![2](https://hackmd.io/_uploads/S1Da5BLmbl.png)
 ![3](https://hackmd.io/_uploads/S1v65HIm-e.png)
 
+## Quick Start
+
+### Requirements
+
+- NVIDIA GPU 
+- CUDA 12.0+
+- PyTorch 2.0+
+
+### Installation
+
+```bash
+pip install sglang==0.5.6
+```
+
+### Inference with SGLang
+
+```python
+python3 -m sglang.launch_server  \
+    --model-path /models/Kimi-K2-Instruct \
+    --host 0.0.0.0 --port 30012  \
+    --trust-remote-code  \
+    --attention-backend fa3  \
+    --mem-fraction-static 0.9 \
+    --tp-size 1  \
+    --speculative-algorithm EAGLE3  \
+    --speculative-draft-model-path AQ-MedAI/Kimi-K2-Instruct-eagle3 \
+    --speculative-num-steps 3  \
+    --speculative-eagle-topk 1   \
+    --speculative-num-draft-tokens 4
+```
 
 ## Training Data