Update README.md
Browse files
README.md
CHANGED
|
@@ -9,6 +9,10 @@ tags:
|
|
| 9 |
# MN-12b-RP-Ink
|
| 10 |
|
| 11 |
This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
|
|
|
|
|
|
|
|
|
|
|
|
|
| 12 |
|
| 13 |
## Merge Details
|
| 14 |
### Merge Method
|
|
|
|
| 9 |
# MN-12b-RP-Ink
|
| 10 |
|
| 11 |
This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
|
| 12 |
+
I have removed several of the unsused layers as a test. The model still works but it can catch itself into a loop. I am attempting to finetune the model on a longer conversational dataset to see if that issue can be resolved.
|
| 13 |
+
|
| 14 |
+
I would NOT use this model... It is for testing purposes only.
|
| 15 |
+
|
| 16 |
|
| 17 |
## Merge Details
|
| 18 |
### Merge Method
|