Update README.md
Browse filesClarification and sysprompt update
README.md
CHANGED
|
@@ -12,13 +12,15 @@ license: apache-2.0
|
|
| 12 |
# Magnolia-v1-12B
|
| 13 |
|
| 14 |
This repo contains a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
|
|
|
|
| 15 |
Instruct was added in at low weight in order to increase the steerability of the model;
|
| 16 |
safety has consequently been reinforced.
|
| 17 |
|
| 18 |
Tested at temperature 0.7 and minP 0.01, with ChatML prompting.
|
| 19 |
|
| 20 |
-
Mistral Nemo models tend to have repetition issues in general. For this model at least,
|
| 21 |
```
|
|
|
|
| 22 |
Ensure that all punctuation rules are adhered to without the introduction of spurious intervening spaces.
|
| 23 |
Avoid redundant phrasing and maintain forward narrative progression by utilizing varied sentence structure, alternative word choices, and active voice.
|
| 24 |
Employ descriptive details judiciously, ensuring they serve a purpose in advancing the story or revealing character or touching upon setting.
|
|
|
|
| 12 |
# Magnolia-v1-12B
|
| 13 |
|
| 14 |
This repo contains a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
|
| 15 |
+
The base is a merge of two models trained for variety in text generation.
|
| 16 |
Instruct was added in at low weight in order to increase the steerability of the model;
|
| 17 |
safety has consequently been reinforced.
|
| 18 |
|
| 19 |
Tested at temperature 0.7 and minP 0.01, with ChatML prompting.
|
| 20 |
|
| 21 |
+
Mistral Nemo models tend to have repetition issues in general. For this model at least, various issues can be mitigated somewhat with additional sysprompting, e.g.:
|
| 22 |
```
|
| 23 |
+
No passage shall exceed 10 lines of text, with turns limited to a maximum of 5 lines per speaker to ensure snappy and engaging dialog and action.
|
| 24 |
Ensure that all punctuation rules are adhered to without the introduction of spurious intervening spaces.
|
| 25 |
Avoid redundant phrasing and maintain forward narrative progression by utilizing varied sentence structure, alternative word choices, and active voice.
|
| 26 |
Employ descriptive details judiciously, ensuring they serve a purpose in advancing the story or revealing character or touching upon setting.
|