parameters guide
samplers guide
model generation
role play settings
quant selection
arm quants
iq quants vs q quants
optimal model setting
gibberish fixes
coherence
instructing following
quality generation
chat settings
quality settings
llamacpp server
llamacpp
lmstudio
sillytavern
koboldcpp
backyard
ollama
model generation steering
steering
model generation fixes
text generation webui
ggufs
exl2
full precision
quants
imatrix
neo imatrix
llama
llama-3
gemma
gemma2
gemma3
llama-2
llama-3.1
llama-3.2
mistral
Mixture of Experts
mixture of experts
mixtral
Update README.md
Browse files
README.md
CHANGED
|
@@ -24,18 +24,19 @@ These settings / suggestions can be applied to all models including GGUF, EXL2,
|
|
| 24 |
It also includes critical settings for Class 3 and Class 4 models at this repo - DavidAU - to enhance and control generation
|
| 25 |
for specific as a well as outside use case(s) including role play, chat and other use case(s).
|
| 26 |
|
| 27 |
-
|
| 28 |
|
| 29 |
- "Gibberish"
|
| 30 |
- Generation length (including out of control generation)
|
| 31 |
- Chat quality.
|
|
|
|
| 32 |
- Letter, word, phrase, paragraph repeats
|
| 33 |
- Coherence
|
| 34 |
-
-
|
| 35 |
-
-
|
| 36 |
-
-
|
| 37 |
-
-
|
| 38 |
-
-
|
| 39 |
|
| 40 |
Likewise ALL the setting below can also improve model generation and/or general overall "smoothness" / "quality" of model operation.
|
| 41 |
|
|
|
|
| 24 |
It also includes critical settings for Class 3 and Class 4 models at this repo - DavidAU - to enhance and control generation
|
| 25 |
for specific as a well as outside use case(s) including role play, chat and other use case(s).
|
| 26 |
|
| 27 |
+
The settings discussed in this document can also fix a number of model issues (<B>any model, any repo</B>) such as:
|
| 28 |
|
| 29 |
- "Gibberish"
|
| 30 |
- Generation length (including out of control generation)
|
| 31 |
- Chat quality.
|
| 32 |
+
- Multi-turn / COT / and other multi prompt/answer generation
|
| 33 |
- Letter, word, phrase, paragraph repeats
|
| 34 |
- Coherence
|
| 35 |
+
- Instruction following
|
| 36 |
+
- Creativeness or lack there of or .. too much - purple prose.
|
| 37 |
+
- Low quant (ie q2k, iq1s, iq2s) issues.
|
| 38 |
+
- General output quality.
|
| 39 |
+
- Role play related issues.
|
| 40 |
|
| 41 |
Likewise ALL the setting below can also improve model generation and/or general overall "smoothness" / "quality" of model operation.
|
| 42 |
|