bartowski commited on
Commit
464d075
·
verified ·
1 Parent(s): 733099a

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +6 -0
README.md CHANGED
@@ -28,6 +28,12 @@ Run them in your choice of tools:
28
 
29
  Note: if it's a newly supported model, you may need to wait for an update from the developers.
30
 
 
 
 
 
 
 
31
  ## Prompt format
32
 
33
  ```
 
28
 
29
  Note: if it's a newly supported model, you may need to wait for an update from the developers.
30
 
31
+ ### It's suggested you disable flash attention (`--flash-attn off`) for improved performance
32
+
33
+ ### Re-uploaded with fixed imatrix from the fixed gating function: https://github.com/ggml-org/llama.cpp/pull/18980
34
+
35
+ You'll need the updated llama.cpp to get proper output
36
+
37
  ## Prompt format
38
 
39
  ```