parameters guide
samplers guide
model generation
role play settings
quant selection
arm quants
iq quants vs q quants
optimal model setting
gibberish fixes
coherence
instructing following
quality generation
chat settings
quality settings
llamacpp server
llamacpp
lmstudio
sillytavern
koboldcpp
backyard
ollama
model generation steering
steering
model generation fixes
text generation webui
ggufs
exl2
full precision
quants
imatrix
neo imatrix
llama
llama-3
gemma
gemma2
gemma3
llama-2
llama-3.1
llama-3.2
mistral
Mixture of Experts
mixture of experts
mixtral
Update README.md
Browse files
README.md
CHANGED
|
@@ -84,11 +84,15 @@ You will get higher quality operation overall - stronger prose, better answers,
|
|
| 84 |
|
| 85 |
<B>How to Use this document:</B>
|
| 86 |
|
| 87 |
-
Review quant(s) information to select quant(s) to download, then review "Class 1,2,3..." for specific information on models followed by "Source Files...APPS to run LLMs/AIs".
|
|
|
|
|
|
|
|
|
|
|
|
|
| 88 |
|
| 89 |
The "DETAILED NOTES ON PARAMETERS, SAMPLERS and ADVANCED SAMPLERS" section after this covers and links to more information about "tuning" your model(s). These cover theory, hints, tips and tricks, and observations.
|
| 90 |
|
| 91 |
-
All information about parameters, samplers and advanced samplers applies to ALL models
|
| 92 |
|
| 93 |
<small>
|
| 94 |
<PRE>
|
|
|
|
| 84 |
|
| 85 |
<B>How to Use this document:</B>
|
| 86 |
|
| 87 |
+
Review quant(s) information to select quant(s) to download, then review "Class 1,2,3..." for specific information on models followed by "Source Files...APPS to run LLMs/AIs".
|
| 88 |
+
|
| 89 |
+
"Quick reference" will state the best parameter settings for each "Class" of model(s) to get the best operation and/or good defaults to use to get started. If you came to this page from a repo card on my repo -DavidAU- the "class" of the model would have been stated just before you came to this page.
|
| 90 |
+
|
| 91 |
+
The detailed sections about parameters - Section 1 a,b,c and section 2 will help tune the model(s) operation.
|
| 92 |
|
| 93 |
The "DETAILED NOTES ON PARAMETERS, SAMPLERS and ADVANCED SAMPLERS" section after this covers and links to more information about "tuning" your model(s). These cover theory, hints, tips and tricks, and observations.
|
| 94 |
|
| 95 |
+
All information about parameters, samplers and advanced samplers applies to ALL models, regardless of repo(s) you download them from.
|
| 96 |
|
| 97 |
<small>
|
| 98 |
<PRE>
|