More important changes to README.md

Added more info to V1, V2, Temperature+Top-K, Repetition Penalty, Top-A, Repetition Slope, TFS and Additional recommendations.

README.md

@@ -54,6 +54,93 @@ ContextShift should be disabled.
 
 Flash Attention should be disalbed.
 
+><summary>Smoothing Factor:</summary>
+Avoid in any case.
+
+Increases stability of outputs with very randomized settings, but will cause incorrect choices later, and will cause issues with strict settings, like nonsensical choices, actions, events and etc (even with low values like 0.002).
+</details>
+<details><summary>Mirostat:</summary>
+Helps to steady the temperature (might replace) and dynamically adjusts the effective temperature based on more "surprising" tokens.
+
+Tau helps to adjust the diversity; higher - more diverse and creative; lower - more deterministic.
+
+Eta helps to increase the frequency of temperature updates; smaller - stable and slow; higher - faster but less coherent.
+
+Never managed to get stable enough results for very long period of progression, so I personally avoid it and use strict settings instead.
+</details>
+<details><summary>Smoothing Curve (new):</summary>
+Dynamically adjusts the Penalty, temperature, probability to avoid sudden changes; 1 and lower.
+
+Has stronger effect with higher Repetition Penalty.
+
+Avoid with strict settings.
+
+Values below 0.96 are not recommended.
+</details>
+<details><summary>Adaptive-P (new):</summary>
+Does not work with high Temperature; Avoid at any case.
+</details>
+<details><summary>DRY:</summary>
+Avoid in any case.
+
+Helps to steady any repetitions, but never managed to get stable enough outputs.
+</details>
+<details><summary>XTC:</summary>
+Threshold - helps to cutoff the high-probability tokens (most likely), which mostly helps with lower Temperature.
+
+Probability - the chance for Threshold to cutoff the desired most likely tokens.
+</details>
+</details>
+
+# Ready-to-use AIO general settings:
+<details><summary></summary>
+<details><summary>V1 **-CREATIVE-BALANCED-**</summary>
+<img src="https://gitlab.com/Azuro721/trueperfect-ai/-/raw/main/PERF1.png" style="float:right; width:200px; height:300px; padding:10px;">
+
+Very fine with very good creativity, level of details, emotional connections.
+
+Might confuse things like character names, species and etc (due to high Temperature and not low enough Top-A). **In such cases lower Repetition Penalty to 1.02612**
+
+Top-A 0.043725 might work well only with Repetition Penalty 1.02612, but better with **V2**
+</details>
+<details><summary>V2 **-INSANE-DETAIL/ATTENTION-**</summary>
+<img src="https://gitlab.com/Azuro721/trueperfect-ai/-/raw/main/PERF2.png" style="float:right; width:200px; height:300px; padding:10px;">
+
+OVERKILL.
+
+Maintains insane amount of details, attention, accuracy, and length.
+
+Top-K 206 might improve attention to details, but not generally recommended for Temperature 4.8, mostly due to more focused output on certain things, followed by transitions, which lowers the cases with better creativity and some supposed variations in one output.
+
+Lower Repetition Penalty to get even more insane attention and accuracy, but sacrifice a bit of creativity.
+</details>
+<details><summary>V2-Alt **-INSANE-DETAIL/ATTENTION-ASSISTANT-**</summary>
+<img src="https://gitlab.com/Azuro721/trueperfect-ai/-/raw/main/PERF3.png" style="float:right; width:200px; height:300px; padding:10px;">
+
+Insane for maximum accuracy for ASSISTANT tasks; can be used with overly complexive RP scenarios (with favor of attention). Will be less creative in favor of attention.
+</details>
+
+To preserve the versatility, I would like to describe complete and specific sampler values below **Additional fine-tuning:**, to aim perfection for any case.
+
+Here I will describe additional values for special cases, as well as dependencies across different sampler parameters (Like Temperature+Top-K)
+<details><summary>Additional fine-tuning:</summary>
+<details><summary>Temperature+Top-K (only higher values):</summary>
+Temperature is related to Top-K, and in order to achieve perfect part for this specific parameters, both of these needs to be adjusted.
+
+For example Temperature 2.4 **needs** to have at least Top-K 134, increased by 72.
+
+**Acceptable values of Top-K for Temperature 2.4/4.8**: 134, 206.
+
+Different values will cause inconsistency, instability and other issues.
+
+**Acceptable values of Temperature for Top-K**: 2.4, 4.8.
+
+(1.2) is not prioritized mostly because in most cases it will output unsatisfactory results (e.g. bland and boring).
+
+Lower temperature will be output less "exciting" and creative results (like less emotions, variety and predictability by one output), and might trigger repetitions, which can be mostly fixed by raising Top-K.
+
+Higher Top-K will expand the attention to smaller details, and preserve attention to multiple simultaneous events, and also can fix smaller text-related issues (like with quotation marks, asterisks, hyphens and etc.)
+
 # General and simplified info about specific sampler parameters:
 <details><summary></summary>
 <details><summary>Temperature:</summary>
@@ -157,27 +244,41 @@ Probability - the chance for Threshold to cutoff the desired most likely tokens.
 <details><summary>V1 **-CREATIVE-BALANCED-**</summary>
 <img src="https://gitlab.com/Azuro721/trueperfect-ai/-/raw/main/PERF1.png" style="float:right; width:200px; height:300px; padding:10px;">
 
-Very fine with very good creativity, level of details, emotional connections.
+Very fine with very good creativity, level of detail, emotional connections, "surprising" outcomes and descriptions.
 
-Might confuse things like character names, species and etc (due to high Temperature and not low enough Top-A). **In such cases lower Repetition Penalty to 1.02612**
+In some cases where Repetition Penalty 1.12082 outputs overly descriptive results, try out 1.121, it might provide better results and fix such issues; but in most cases adjusting the typos and logical inconsistency from instructions or character cards will fix such issues, so 1.121 is generally not recommended.
 
-Top-A 0.043725 might work well only with Repetition Penalty 1.02612, but better with **V2**
+Might confuse things like character names, species, User actions and etc (due to high Temperature alongside with not low enough Top-A). **In such cases lower Repetition Penalty to 1.02612; this will fix most issues and alter the outputs in a more focused and less creative way, with attention to finer details**.
+
+In this case, Top-K 206 with Repetition Penalty 1.02612 will improve attention to finer details with less attention to creative things and slower progression. **Top-K 134 (with Repetition Penalty 1.02612) is generally more preferred due to being more subtle, with faster progression (good in most cases) and better creative outcomes**.
+
+In some specific models (most likely), TFS 0.9551 might improve things even further, with more attention, creativity, and performance overall; do not use if you notice overly long descriptions (extremely long after each section).
 </details>
 <details><summary>V2 **-INSANE-DETAIL/ATTENTION-**</summary>
 <img src="https://gitlab.com/Azuro721/trueperfect-ai/-/raw/main/PERF2.png" style="float:right; width:200px; height:300px; padding:10px;">
 
 OVERKILL.
 
-Maintains insane amount of details, attention, accuracy, and length.
+**RECOMENDATIONS:** use only if you want insane level of detail and attention; V1 is more preferred for general role play and good reactions, emotional connections, creativity and shorter outputs with well-preserved details. Use V2 only with very complex cases, or if you want extreme level of detail with very high attention and slow transisitons during certain events, as well as attention to very fine descriptions.
 
-Top-K 206 might improve attention to details, but not generally recommended for Temperature 4.8, mostly due to more focused output on certain things, followed by transitions, which lowers the cases with better creativity and some supposed variations in one output.
+Maintains insane amount of details, attention, accuracy, and length: focused outputs, "surprising" outcomes and descriptions (noticeably (in some models) less compared to Top-A 0.07 but still generally good).
 
-Lower Repetition Penalty to get even more insane attention and accuracy, but sacrifice a bit of creativity.
+Lower Repetition Penalty to get even more insane attention and level of detail, but sacrifice a bit of creativity, "surprising" outcomes and descriptions (especially with 1.02612).
+
+Repetition Penalty 1.02612 is preferred as the lowest point; will output very attentive and detailed descriptions, with other things described earlier.
+
+In this case, Top-K 206 will increase attention even further.
+
+Use Top-K 134 for faster transitions and attention to more "surprising" moments.
 </details>
 <details><summary>V2-Alt **-INSANE-DETAIL/ATTENTION-ASSISTANT-**</summary>
 <img src="https://gitlab.com/Azuro721/trueperfect-ai/-/raw/main/PERF3.png" style="float:right; width:200px; height:300px; padding:10px;">
 
 Insane for maximum accuracy for ASSISTANT tasks; can be used with overly complexive RP scenarios (with favor of attention). Will be less creative in favor of attention.
+
+Generally, Top-K 278 might improve attention to details, but not recommended for Temperature 2.4 and other cases, mostly due to increased chance of becoming overly descriptive, which will confuse model and force hallucinations.
+
+In rare cases (specific models) with overly descriptive results, decrease TFS to 0.8413 or/and Top-K to 134.
 </details>
 
 To preserve the versatility, I would like to describe complete and specific sampler values below **Additional fine-tuning:**, to aim perfection for any case.
@@ -201,6 +302,8 @@ Lower temperature will be output less "exciting" and creative results (like less
 
 Higher Top-K will expand the attention to smaller details, and preserve attention to multiple simultaneous events, and also can fix smaller text-related issues (like with quotation marks, asterisks, hyphens and etc.)
 
+Top-K 278, as described earlier, might cause overly descriptive results, which will most likely cause hallucinations.
+
 Top-K 206 is the more attentive one, which fits more with assistant tasks, as it will take away some of creativity, so might not be suitable for Temperature 4.8.
 
 Top-K 134 is the middle-balanced one, with better creativity, good level of detail and fine transitions. Recommeded one for in-character actions and strong roleplay scenarios.
@@ -212,21 +315,21 @@ Temperature 4.8 with Top-K 206 and TFS 0.8413 will output more creative, emotion
 Temperature 2.4 with Top-K 206 and TFS 0.8413 will output more attentive results, with less variety, emotions and "surprising" moments.
 
 Temperature 1.2 with Top-K 206 and TFS 0.8413 will output slightly more attentive results, with even less variety, emotions and "surprising" moments.
+
+Further experimentation with Top-K might not be possible, mostly due to logical limit for all settings combined.
 </details>
 <details><summary>Repetition Penalty:</summary>
-Base value: 1.12082, which will output more creative, emotional, varied, smart and "exciting" results. But tends to have issues with asterisks and quotation marks. Good as an **assistant**. Similar to 1.02612, but with more creativity, less descriptions, faster pace, more interesting responses across multiple characters simultaneously.
-
-1.121: an alternative variant of 1.12082, which might fix issues with overly descriptive outputs, but 1.12082 is preferred and context and/or initial input (first) should be adjusted instead.
+Base value: 1.12082, which will output more creative, emotional, varied, smart and "exciting" results. But tends to have issues with asterisks and quotation marks; similar to 1.02612, but with more creativity, less descriptions, faster pace, but prone to issues if input has logical inconsistencies or lots of typos.
 
 1.105 (untuned): specific value I found out during experimentation. Will output less "exciting" results, but fairly better compared to 1.05.
 
-1.05 (untuned, not recommended): base value, which is widely used in various LLMs. Will output more casual values, but also omit issues with asterisks and quotation marks.
+1.05 (untuned, not recommended): base value, which is widely used in various LLMs. Might output focused results with average creativity (better than 1.02612), but prone to be less stable compared to 1.105.
 
 1.02612: very specific one; will output very descriptive, attentive and expanded results. Will try to pay attention to noticeably more things compared to other variants. Will preserve character details and much more things as events go by. Great as an **assistant.**. Great for very complex instructions, very complex character cards and complex scenes. Great attention to multiple characters.
 
-**Other values (might output unstable results):**
+<details><summary>Other values (might output unstable results):</summary>
 
-Feel free to experiment with and output any results.
+Feel free to experiment with these variants, and show any good results (if stable enough to be used for at least ~6K tokens).
 
 1.02665: similar to 1.02695, but slightly more altered creativity, with interesting developement of events, more realistic responses from other characters; no issues so far; closest to the 1.02612 one; haven't been tested thoroughly.
 
@@ -238,6 +341,9 @@ Feel free to experiment with and output any results.
 
 1.0285/1.0286: will provide very interesting and creative responses, but will mess up some character details (mostly the ones that already in LLM's database)
 Some of them will output inconsistency with specific character parts, like body type, skin type and etc; also missing out certain details and skipping some important parts, be sure to include that and select the best one.
+
+Might output quite stable results if used with Top-A 0.0001.
+</details>
 </details>
 <details><summary>Top-P:</summary>
 Base value: 0.915, which will output very attentive, consistent and stable results. Recommeded for all cases.
@@ -248,16 +354,16 @@ Base value: 0.915, which will output very attentive, consistent and stable resul
 </details>
 <details><summary>Top-A:</summary>
 Base value: 0.07, which will output extremely consistent, stable results, with smooth transitions and very good attention to most things. Recommeded for all cases.
-</details>
 <details><summary>Other values (experimental):</summary>
-0.043725: more attention to anatomy, but unstable and tends to be unpredictable. Works well with Repetition Penalty 1.02612
+0.043725: more attention to anatomy, but unstable and tends to be unpredictable. Works better with Repetition Penalty 1.02612 or **V2** but goes bad soon, after several thousand tokens.
 
-0.2025: more creative, descriptive, "exciting" and emotional, but tends to skip some details and be slightly more stable compared to 0.045. Less accurate and prone to have more issues with such high Temperature.
+0.2025: more creative, descriptive, "exciting" and emotional, but tends to skip some details. Less accurate and have lots of issues with high Temperature; not suitable to be used generally, only to get initial creative inputs.
+</details>
 </details>
 <details><summary>Repetition Range:</summary>
 Base value: 64, which is the least one that will output overall better, consistant and descriptive results. Recommeded for all cases.
 
-128: will output more descriptive results, but tends to be repetitive. Not recommended.
+128: will output more descriptive results, but tends to be repetitive. Not recommended, but cab be used to adjust initial responses.
 </details>
 <details><summary>Seed:</summary>
 Use fixed seed to improve consistency alot.
@@ -277,19 +383,19 @@ Feel free to use these fixed values:
 132458
 </details>
 <details><summary>Repetition Slope:</summary>
-Base value: 1.12, which will help to max out most things like consistency, level of detail and etc. Recommeded for all cases. Higher values won't output any gain.
+Base value: 1.12, which will help to max out most things like consistency, level of detail and etc. Recommeded for all cases. Higher values won't affect outputs at all, only might cause issues with slowdowns.
 
-All values below 1 are unstable and will cause issues.
+All values below 1 are unstable and will cause very random issues.
 </details>
 <details><summary>TFS:</summary>
 Base value: 0.8413, which will output very smart, attentive and smooth outputs. Recommeded for all cases.
 
-0.9551: will output extremely descriptive and attentive results; the best one as an **assistant**; might cause issues in some LLMs, specifically overly descriptive and attentive results.
+0.9551: will output extremely descriptive and attentive results; the best one as an **assistant**; might cause issues in some LLMs as described earlier.
 </details>
 <details><summary>(Additional) recommendations for assistant mode+other tips:</summary>
-Disable "Inject Chatnames" to get best results for a personal assistant.
+Disable "Inject ChatNames" to get the best results for assistant-related tasks.
 
-Usage of "Separate End Tags" might improve the cases with repetitions and make responses smarter and overall better for some models.
+Usage of "Separate End Tags" might improve the cases with repetitions, make responses smarter and overall better for some models.
 </details>
 </details>
 </details>