Update README.md
Browse files
README.md
CHANGED
|
@@ -7,7 +7,9 @@ An experiment with gradient merges using [the following script](https://github.c
|
|
| 7 |
|
| 8 |
Chronos is a wonderfully verbose model, though it definitely seems to lack in the logic department. Hermes and WizardLM have been merged gradually, primarily in the higher layers (10+) in an attempt to rectify some of this behaviour.
|
| 9 |
|
| 10 |
-
|
|
|
|
|
|
|
| 11 |
|
| 12 |
This model primarily uses Alpaca formatting, so for optimal model performance, use:
|
| 13 |
```
|
|
|
|
| 7 |
|
| 8 |
Chronos is a wonderfully verbose model, though it definitely seems to lack in the logic department. Hermes and WizardLM have been merged gradually, primarily in the higher layers (10+) in an attempt to rectify some of this behaviour.
|
| 9 |
|
| 10 |
+
Below is an illustration attempting to showcase the gradients I used for this specific merge.
|
| 11 |
+
|
| 12 |
+

|
| 13 |
|
| 14 |
This model primarily uses Alpaca formatting, so for optimal model performance, use:
|
| 15 |
```
|