update README.md
Browse files
README.md
CHANGED
|
@@ -99,6 +99,16 @@ After modification, you can run the following command to reproduce the long-cont
|
|
| 99 |
python3 tests/test_generate.py
|
| 100 |
```
|
| 101 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 102 |
For more details about CPM.cu, please refer to [the repo CPM.cu](https://github.com/OpenBMB/cpm.cu).
|
| 103 |
|
| 104 |
### Hybird Reasoning Mode
|
|
|
|
| 99 |
python3 tests/test_generate.py
|
| 100 |
```
|
| 101 |
|
| 102 |
+
You can run the following command to infer with EAGLE3 speculative decoding algorithm.
|
| 103 |
+
|
| 104 |
+
```bash
|
| 105 |
+
python3 -m cpmcu.cli \
|
| 106 |
+
--model-path $BASE_MODEL_PATH \
|
| 107 |
+
--draft-model-path $EAGLE3_DRAFT_MODEL_PATH \
|
| 108 |
+
--prompt-text "Write an article about Artificial Intelligence." \
|
| 109 |
+
--use-eagle3 true
|
| 110 |
+
```
|
| 111 |
+
|
| 112 |
For more details about CPM.cu, please refer to [the repo CPM.cu](https://github.com/OpenBMB/cpm.cu).
|
| 113 |
|
| 114 |
### Hybird Reasoning Mode
|