Gryphe commited on
Commit
d0a6a8c
·
1 Parent(s): c2c2d49

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -1
README.md CHANGED
@@ -7,7 +7,9 @@ An experiment with gradient merges using [the following script](https://github.c
7
 
8
  Chronos is a wonderfully verbose model, though it definitely seems to lack in the logic department. Hermes and WizardLM have been merged gradually, primarily in the higher layers (10+) in an attempt to rectify some of this behaviour.
9
 
10
- I'd say the end product is about 65% Chronos, with 15% Hermes and 20% Wizard added in gradually increasing amounts. The result feels surprisingly robust, though I'll let you be the final judge of that!
 
 
11
 
12
  This model primarily uses Alpaca formatting, so for optimal model performance, use:
13
  ```
 
7
 
8
  Chronos is a wonderfully verbose model, though it definitely seems to lack in the logic department. Hermes and WizardLM have been merged gradually, primarily in the higher layers (10+) in an attempt to rectify some of this behaviour.
9
 
10
+ Below is an illustration attempting to showcase the gradients I used for this specific merge.
11
+
12
+ ![](approximation.png)
13
 
14
  This model primarily uses Alpaca formatting, so for optimal model performance, use:
15
  ```