parameters guide
samplers guide
model generation
role play settings
quant selection
arm quants
iq quants vs q quants
optimal model setting
gibberish fixes
coherence
instructing following
quality generation
chat settings
quality settings
llamacpp server
llamacpp
lmstudio
sillytavern
koboldcpp
backyard
ollama
model generation steering
steering
model generation fixes
text generation webui
ggufs
exl2
full precision
quants
imatrix
neo imatrix
llama
llama-3
gemma
gemma2
gemma3
llama-2
llama-3.1
llama-3.2
mistral
Mixture of Experts
mixture of experts
mixtral
Update README.md
Browse files
README.md
CHANGED
|
@@ -125,9 +125,10 @@ Generational Control And Steering of a Model / Fixing Model Issues on the Fly
|
|
| 125 |
- Multiple Methods to Steer Generation on the fly
|
| 126 |
- On the fly Class 3/4 Steering / Generational Issues and Fixes (also for any model/type)
|
| 127 |
- Advanced Steering / Fixing Issues (any model, any type) and "sequenced" parameter/sampler change(s)
|
|
|
|
| 128 |
|
| 129 |
Quick Reference Table - Parameters, Samplers, Advanced Samplers
|
| 130 |
-
-
|
| 131 |
|
| 132 |
Section 1a : PRIMARY PARAMETERS - ALL APPS
|
| 133 |
Section 1b : PENALITY SAMPLERS - ALL APPS
|
|
@@ -507,9 +508,13 @@ I do not set any other settings, parameters or have samplers activated when gene
|
|
| 507 |
|
| 508 |
Everything else is "zeroed" / "disabled".
|
| 509 |
|
|
|
|
|
|
|
| 510 |
These parameters/settings are considered both safe and default and in most cases available to all users in all AI/LLM apps.
|
| 511 |
|
| 512 |
-
|
|
|
|
|
|
|
| 513 |
|
| 514 |
|
| 515 |
---
|
|
@@ -522,7 +527,12 @@ Note for Class 3/Class 4 models (discussed below) "repeat-last-n" is a CRITICAL
|
|
| 522 |
|
| 523 |
Now that you have the basic parameters and samplers from the previous section, I will cover Generational Control and Steering.
|
| 524 |
|
| 525 |
-
This section
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 526 |
|
| 527 |
There is a very important concept that must be covered first:
|
| 528 |
|
|
@@ -536,12 +546,14 @@ When you hit "REGEN" this nullifies only the last "generation" - not the prompt
|
|
| 536 |
|
| 537 |
The part I will cover here is once a generation has started, from a single prompt (no other prompts/generations in the chat).
|
| 538 |
|
| 539 |
-
So
|
| 540 |
|
| 541 |
Start a 1000 word scene (vivid horror, 1st person, include thoughts) with: The sky scraper swayed, as she watched the window in front of her on the 21 floor explode...
|
| 542 |
|
| 543 |
Generation starts ... and then ends.
|
| 544 |
|
|
|
|
|
|
|
| 545 |
Then you hit regen however many times to get a "good" generation.
|
| 546 |
|
| 547 |
There is a better way.
|
|
@@ -598,6 +610,8 @@ If you have single or multiple paragraph repeat(s):
|
|
| 598 |
- Hit continue.
|
| 599 |
- Better: Do these steps, and add "steering" (last line -> word, phrase, sentence or paragraph)
|
| 600 |
|
|
|
|
|
|
|
| 601 |
<B>Advanced Steering / Fixing Issues (any model, any type) and "sequenced" parameter/sampler change(s)</B>
|
| 602 |
|
| 603 |
This will drastically (depending on changes you make) change up "Continue(d)" generation(s):
|
|
|
|
| 125 |
- Multiple Methods to Steer Generation on the fly
|
| 126 |
- On the fly Class 3/4 Steering / Generational Issues and Fixes (also for any model/type)
|
| 127 |
- Advanced Steering / Fixing Issues (any model, any type) and "sequenced" parameter/sampler change(s)
|
| 128 |
+
- "Cold" Editing/Generation
|
| 129 |
|
| 130 |
Quick Reference Table - Parameters, Samplers, Advanced Samplers
|
| 131 |
+
- Quick setup for all model classes for automated control / smooth operation.
|
| 132 |
|
| 133 |
Section 1a : PRIMARY PARAMETERS - ALL APPS
|
| 134 |
Section 1b : PENALITY SAMPLERS - ALL APPS
|
|
|
|
| 508 |
|
| 509 |
Everything else is "zeroed" / "disabled".
|
| 510 |
|
| 511 |
+
IMPORTANT:
|
| 512 |
+
|
| 513 |
These parameters/settings are considered both safe and default and in most cases available to all users in all AI/LLM apps.
|
| 514 |
|
| 515 |
+
You should set these as noted first. I would say these are the minimum settings to use to get good model operation.
|
| 516 |
+
|
| 517 |
+
Note for Class 3/Class 4 models settings/samplers (discussed below) "repeat-last-n" is a CRITICAL setting.
|
| 518 |
|
| 519 |
|
| 520 |
---
|
|
|
|
| 527 |
|
| 528 |
Now that you have the basic parameters and samplers from the previous section, I will cover Generational Control and Steering.
|
| 529 |
|
| 530 |
+
This section is optional.
|
| 531 |
+
|
| 532 |
+
This section (in part) will cover how to deal with Class 3/4 issues directly, as well as general issues than can happen with any "class" of model during generation IF you want to control them manually as
|
| 533 |
+
the "Quick Reference" and/or "Detailed Parameters, Samplers, and Advanced Samplers" will cover how to deal with any generation issue(s) automatically.
|
| 534 |
+
|
| 535 |
+
This section will also cover how to manually STEER generation(s) - ANY MODEL, ANY TYPE.
|
| 536 |
|
| 537 |
There is a very important concept that must be covered first:
|
| 538 |
|
|
|
|
| 546 |
|
| 547 |
The part I will cover here is once a generation has started, from a single prompt (no other prompts/generations in the chat).
|
| 548 |
|
| 549 |
+
So lets start with a prompt (NOTE: this one has no steering in the instructions):
|
| 550 |
|
| 551 |
Start a 1000 word scene (vivid horror, 1st person, include thoughts) with: The sky scraper swayed, as she watched the window in front of her on the 21 floor explode...
|
| 552 |
|
| 553 |
Generation starts ... and then ends.
|
| 554 |
|
| 555 |
+
It could be 500 words, to 4000+...
|
| 556 |
+
|
| 557 |
Then you hit regen however many times to get a "good" generation.
|
| 558 |
|
| 559 |
There is a better way.
|
|
|
|
| 610 |
- Hit continue.
|
| 611 |
- Better: Do these steps, and add "steering" (last line -> word, phrase, sentence or paragraph)
|
| 612 |
|
| 613 |
+
In each case we are BREAKING the "condition" that lead (or lead into) to the repeat(s).
|
| 614 |
+
|
| 615 |
<B>Advanced Steering / Fixing Issues (any model, any type) and "sequenced" parameter/sampler change(s)</B>
|
| 616 |
|
| 617 |
This will drastically (depending on changes you make) change up "Continue(d)" generation(s):
|