Update README.md
Browse files
README.md
CHANGED
|
@@ -33,9 +33,9 @@ set your (Max Tokens)context-lenght 16000t main-model, set your embedder-model (
|
|
| 33 |
|
| 34 |
-> ok what that mean!
|
| 35 |
|
| 36 |
-
you can receive
|
| 37 |
|
| 38 |
-
you can play and set for your needs, eg
|
| 39 |
|
| 40 |
16000t ~1GB VRAM usage
|
| 41 |
|
|
|
|
| 33 |
|
| 34 |
-> ok what that mean!
|
| 35 |
|
| 36 |
+
you can receive 14-snippets a 1024t (14336t) from your document ~10000words and 1600t left for the answer ~1000words
|
| 37 |
|
| 38 |
+
you can play and set for your needs, eg 8-snippets a 2048t, or 28-snippets a 512t ...
|
| 39 |
|
| 40 |
16000t ~1GB VRAM usage
|
| 41 |
|