Update README.md
Browse files
README.md
CHANGED
|
@@ -73,8 +73,8 @@ You can receive 14-snippets a 1024t (~14000t) from your document ~10000words(10p
|
|
| 73 |
You can play and set for your needs, eg 8-snippets a 2048t, or 28-snippets a 512t ... (every time you change the chunk-length the document must be embedd again). With these settings everything fits best for ONE answer, if you need more for a conversation, you should set lower and/or disable the document.
|
| 74 |
<ul style="line-height: 1.05;">
|
| 75 |
english vs german differ 50%<br>
|
| 76 |
-
~5000 characters is one page of a book (no matter ger/en). But if you calculate with words ... words in german are longer, that means per word more token<br>
|
| 77 |
-
|
| 78 |
<li>1200t (~1000 words ~5000 chracter) ~0.1GB, this is aprox one page with small font</li>
|
| 79 |
<li>8000t (~6000 words) ~0.8GB VRAM usage</li>
|
| 80 |
<li>16000t (~12000 words) ~1.5GB VRAM usage</li>
|
|
|
|
| 73 |
You can play and set for your needs, eg 8-snippets a 2048t, or 28-snippets a 512t ... (every time you change the chunk-length the document must be embedd again). With these settings everything fits best for ONE answer, if you need more for a conversation, you should set lower and/or disable the document.
|
| 74 |
<ul style="line-height: 1.05;">
|
| 75 |
english vs german differ 50%<br>
|
| 76 |
+
~5000 characters is one page of a book (no matter ger/en). But if you calculate with words ... words in german are longer, that means per word more token.<br>
|
| 77 |
+
The example is english, for german you can add apox 50% more token/word (1000 words ~1800t)<br>
|
| 78 |
<li>1200t (~1000 words ~5000 chracter) ~0.1GB, this is aprox one page with small font</li>
|
| 79 |
<li>8000t (~6000 words) ~0.8GB VRAM usage</li>
|
| 80 |
<li>16000t (~12000 words) ~1.5GB VRAM usage</li>
|