kalle07 commited on
Commit
ac01051
·
verified ·
1 Parent(s): 5931f16

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -73,8 +73,8 @@ You can receive 14-snippets a 1024t (~14000t) from your document ~10000words(10p
73
  You can play and set for your needs, eg 8-snippets a 2048t, or 28-snippets a 512t ... (every time you change the chunk-length the document must be embedd again). With these settings everything fits best for ONE answer, if you need more for a conversation, you should set lower and/or disable the document.
74
  <ul style="line-height: 1.05;">
75
  english vs german differ 50%<br>
76
- ~5000 characters is one page of a book (no matter ger/en). But if you calculate with words ... words in german are longer, that means per word more token<br>
77
- the example is english, for german you can add apox 50% more token/word (1000 words ~1800t)<br>
78
  <li>1200t (~1000 words ~5000 chracter) ~0.1GB, this is aprox one page with small font</li>
79
  <li>8000t (~6000 words) ~0.8GB VRAM usage</li>
80
  <li>16000t (~12000 words) ~1.5GB VRAM usage</li>
 
73
  You can play and set for your needs, eg 8-snippets a 2048t, or 28-snippets a 512t ... (every time you change the chunk-length the document must be embedd again). With these settings everything fits best for ONE answer, if you need more for a conversation, you should set lower and/or disable the document.
74
  <ul style="line-height: 1.05;">
75
  english vs german differ 50%<br>
76
+ ~5000 characters is one page of a book (no matter ger/en). But if you calculate with words ... words in german are longer, that means per word more token.<br>
77
+ The example is english, for german you can add apox 50% more token/word (1000 words ~1800t)<br>
78
  <li>1200t (~1000 words ~5000 chracter) ~0.1GB, this is aprox one page with small font</li>
79
  <li>8000t (~6000 words) ~0.8GB VRAM usage</li>
80
  <li>16000t (~12000 words) ~1.5GB VRAM usage</li>