Update README.md
Browse filesUpdated after additional testing.
README.md
CHANGED
|
@@ -13,7 +13,7 @@ pipeline_tag: text-generation
|
|
| 13 |
|
| 14 |
This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
|
| 15 |
|
| 16 |
-
In theory, context length has been extended to 32K tokens.
|
| 17 |
|
| 18 |
Tested with ChatML instruct prompts, temperature 1.0, and minP 0.01, but feel free to experiment.
|
| 19 |
|
|
|
|
| 13 |
|
| 14 |
This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
|
| 15 |
|
| 16 |
+
In theory, context length has been extended to 32K tokens. In practice? Degradation above 8K context length.
|
| 17 |
|
| 18 |
Tested with ChatML instruct prompts, temperature 1.0, and minP 0.01, but feel free to experiment.
|
| 19 |
|