Update README.md
Browse files
README.md
CHANGED
|
@@ -54,8 +54,8 @@ SillyTavern Master File → <a rel="nofollow" href="https://huggingface.co/Nitra
|
|
| 54 |
<b><h2>Gemma 3 Presets</b></h2>
|
| 55 |
|
| 56 |
Note: Use a System Prompt as you best see fit. Note updated on 7:06 PM Friday, April 4, 2025. [EDT]<br>
|
| 57 |
-
Update: Flash Attention with KV Cache < FP16 causes a big slow down for Gemma 3 Models, so disable it! <a rel="nofollow" href="https://github.com/LostRuins/koboldcpp/issues/1423">(Source)
|
| 58 |
-
Read more here: <a rel="nofollow" href="https://ai.google.dev/gemma/docs/core/prompt-structure">Gemma formatting and system instructions
|
| 59 |
|
| 60 |
1. Sindre's Gemma 3 Presets <a rel="nofollow" href="https://www.reddit.com/r/SillyTavernAI/comments/1jae28l/comment/mhl3ljy/">(Source)</a><br>
|
| 61 |
SillyTavern Master File → <a rel="nofollow" href="https://huggingface.co/Frowningface/Silly_Tavern_Presets_Database/blob/main/Gemma%203/%5BMASTER%5DSindre-Gemma-3-ST-Presets.json">Download</a><br>
|
|
|
|
| 54 |
<b><h2>Gemma 3 Presets</b></h2>
|
| 55 |
|
| 56 |
Note: Use a System Prompt as you best see fit. Note updated on 7:06 PM Friday, April 4, 2025. [EDT]<br>
|
| 57 |
+
Update: Flash Attention with KV Cache < FP16 causes a big slow down for Gemma 3 Models, so disable it! <a rel="nofollow" href="https://github.com/LostRuins/koboldcpp/issues/1423">(Source)</a><br>
|
| 58 |
+
Read more here: <a rel="nofollow" href="https://ai.google.dev/gemma/docs/core/prompt-structure">Gemma formatting and system instructions</a><br>
|
| 59 |
|
| 60 |
1. Sindre's Gemma 3 Presets <a rel="nofollow" href="https://www.reddit.com/r/SillyTavernAI/comments/1jae28l/comment/mhl3ljy/">(Source)</a><br>
|
| 61 |
SillyTavern Master File → <a rel="nofollow" href="https://huggingface.co/Frowningface/Silly_Tavern_Presets_Database/blob/main/Gemma%203/%5BMASTER%5DSindre-Gemma-3-ST-Presets.json">Download</a><br>
|