Update README.md
Browse files
README.md
CHANGED
|
@@ -79,6 +79,9 @@ Answer：
|
|
| 79 |
Question：Explain QKV
|
| 80 |
Answer：
|
| 81 |
```
|
|
|
|
|
|
|
|
|
|
| 82 |
|
| 83 |
|
| 84 |
### Framework versions
|
|
|
|
| 79 |
Question：Explain QKV
|
| 80 |
Answer：
|
| 81 |
```
|
| 82 |
+
Using Exllamav2_HF set alpha=2.5 for 16K Context
|
| 83 |
+
|
| 84 |
+
**Users also report that exllamav2_HF loader, 8bpw-h8 exl2 quant, simple-1 preset provides good results**
|
| 85 |
|
| 86 |
|
| 87 |
### Framework versions
|