Update README.md
Browse files
README.md
CHANGED
|
@@ -28,6 +28,12 @@ Run them in your choice of tools:
|
|
| 28 |
|
| 29 |
Note: if it's a newly supported model, you may need to wait for an update from the developers.
|
| 30 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 31 |
## Prompt format
|
| 32 |
|
| 33 |
```
|
|
|
|
| 28 |
|
| 29 |
Note: if it's a newly supported model, you may need to wait for an update from the developers.
|
| 30 |
|
| 31 |
+
### It's suggested you disable flash attention (`--flash-attn off`) for improved performance
|
| 32 |
+
|
| 33 |
+
### Re-uploaded with fixed imatrix from the fixed gating function: https://github.com/ggml-org/llama.cpp/pull/18980
|
| 34 |
+
|
| 35 |
+
You'll need the updated llama.cpp to get proper output
|
| 36 |
+
|
| 37 |
## Prompt format
|
| 38 |
|
| 39 |
```
|