Update README.md
Browse files
README.md
CHANGED
|
@@ -1,6 +1,7 @@
|
|
| 1 |
# SEAGLE: Safe-Aware EAGLE
|
| 2 |
|
| 3 |
**SEAGLE** is a safety-aware speculative decoding policy based on [SGLang](https://github.com/sgl-project/sglang). It embeds a lightweight probe model into the draft loop of [EAGLE-3](https://github.com/SafeAILab/EAGLE) speculative decoding, performs real-time safety monitoring on each decoding step, dynamically adjusts draft tokens, and triggers a fallback mechanism when unsafe content is continuously detected.
|
|
|
|
| 4 |
[HERE](https://www.modelscope.cn/models/Alibaba-AAIG/SEAGLE) is the link to the source code and model weights.
|
| 5 |
|
| 6 |
## 1. Overview of SEAGLE
|
|
|
|
| 1 |
# SEAGLE: Safe-Aware EAGLE
|
| 2 |
|
| 3 |
**SEAGLE** is a safety-aware speculative decoding policy based on [SGLang](https://github.com/sgl-project/sglang). It embeds a lightweight probe model into the draft loop of [EAGLE-3](https://github.com/SafeAILab/EAGLE) speculative decoding, performs real-time safety monitoring on each decoding step, dynamically adjusts draft tokens, and triggers a fallback mechanism when unsafe content is continuously detected.
|
| 4 |
+
|
| 5 |
[HERE](https://www.modelscope.cn/models/Alibaba-AAIG/SEAGLE) is the link to the source code and model weights.
|
| 6 |
|
| 7 |
## 1. Overview of SEAGLE
|