Not-For-All-Audiences
nsfw
Update Summary for ST Beginners.md
Browse files- Summary for ST Beginners.md +21 -15
Summary for ST Beginners.md
CHANGED
|
@@ -1,28 +1,34 @@
|
|
| 1 |
-
# Summary for ST Beginners
|
| 2 |
|
| 3 |
-
Hello everyone. This is a brief summary of the most frequently asked questions I receive. I will try to provide concise answers and summaries for all topics. I'm not an expert, LLM is just a hobby in my free time. It's only my way to set up things, feel free to skip chapters. I will not turn myself
|
| 4 |
|
| 5 |
-
# I'm a
|
| 6 |
|
| 7 |
-
|
| 8 |
|
| 9 |
-
|
| 10 |
-
* python
|
| 11 |
-
* miniconda
|
| 12 |
-
You are not a kid to explain basics, if you don't know wtf is this 2 google it.
|
| 13 |
-
### From Where We Can Start?
|
| 14 |
|
| 15 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 16 |
|
| 17 |
### What Can I Run on My Machine?
|
| 18 |
|
| 19 |
If you have:
|
| 20 |
|
| 21 |
-
* NVIDIA newer
|
| 22 |
-
From the get
|
| 23 |
|
| 24 |
-
1. [oobabooga/text-generation-webui](https://
|
| 25 |
-
2. [TabbyAPI](https://github.com/theroyallab/tabbyAPI)
|
| 26 |
* Other GPU/APU gguf
|
| 27 |
|
| 28 |
1. [Koboldcpp](https://github.com/LostRuins/koboldcpp)
|
|
@@ -95,4 +101,4 @@ If you have:
|
|
| 95 |
|
| 96 |
* STscript
|
| 97 |
* mergekit
|
| 98 |
-
* exllamav2
|
|
|
|
| 1 |
+
# Summary for ST Beginners (Work in Progress)
|
| 2 |
|
| 3 |
+
Hello everyone. This is a brief summary of the most frequently asked questions I receive. I will try to provide concise answers and summaries for all topics. I'm not an expert, LLM is just a hobby in my free time. It's only my way to set up things, feel free to skip chapters. I will not turn myself into support on call, if something isn't working - try to Google it yourself or go to ST-discord support channels to ask about it (without mentioning me or this summary). Feel free to correct me if I'm wrong somewhere with proper arguments.
|
| 4 |
|
| 5 |
+
# I'm a Beginner, How Do I Run ST and What Is It?
|
| 6 |
|
| 7 |
+
SillyTavern is a frontend for LLM models. To use it you need to run LLM locally or have access to Web solutions.
|
| 8 |
|
| 9 |
+
## What Can I Run, and How Do I Properly Install and Set Up Any of This?
|
|
|
|
|
|
|
|
|
|
|
|
|
| 10 |
|
| 11 |
+
### What Is All This Running On?
|
| 12 |
+
|
| 13 |
+
* Python
|
| 14 |
+
* Miniconda
|
| 15 |
+
* Hopes and dreams
|
| 16 |
+
|
| 17 |
+
You are not a kid, if you don't know what these are, Google it.
|
| 18 |
+
|
| 19 |
+
### Where Do We Start?
|
| 20 |
+
|
| 21 |
+
* We go here [SillyTavern-Launcher](https://github.com/SillyTavern/SillyTavern-Launcher) and follow all the installation steps.
|
| 22 |
|
| 23 |
### What Can I Run on My Machine?
|
| 24 |
|
| 25 |
If you have:
|
| 26 |
|
| 27 |
+
* NVIDIA newer than 20xx RTX card then it's a no-brainer - use exl2 models.
|
| 28 |
+
From the get-go do this- open NVIDIA Control Panel -> Manage 3D Settings -> CUDA - Sysmem Fallback Policy : Prefer No Sysmem Fallback
|
| 29 |
|
| 30 |
+
1. [oobabooga/text-generation-webui](https://github.com/oobabooga/text-generation-webui) oobabooga is the name of the creator of text-generation-webui but everyone calls text-generation-webui as oobabooga
|
| 31 |
+
2. [TabbyAPI](https://github.com/theroyallab/tabbyAPI) How to setup [Getting-Started](https://github.com/theroyallab/tabbyAPI/wiki/1.-Getting-Started)
|
| 32 |
* Other GPU/APU gguf
|
| 33 |
|
| 34 |
1. [Koboldcpp](https://github.com/LostRuins/koboldcpp)
|
|
|
|
| 101 |
|
| 102 |
* STscript
|
| 103 |
* mergekit
|
| 104 |
+
* exllamav2
|