Update README.md
Browse files
README.md
CHANGED
|
@@ -7,7 +7,7 @@ Eagle model for [CohereLabs/North-mini-code-1.0](https://huggingface.co/CohereLa
|
|
| 7 |
Key highlights include:
|
| 8 |
- three layers with dense transformer blocks
|
| 9 |
- all draft layers use sliding window attention
|
| 10 |
-
- compatible with fp8/
|
| 11 |
|
| 12 |
## vllm
|
| 13 |
To start vllm server with this draft model, run the following
|
|
|
|
| 7 |
Key highlights include:
|
| 8 |
- three layers with dense transformer blocks
|
| 9 |
- all draft layers use sliding window attention
|
| 10 |
+
- compatible with fp8/w4a16 target model checkpoints
|
| 11 |
|
| 12 |
## vllm
|
| 13 |
To start vllm server with this draft model, run the following
|