Sweaterdog commited on
Commit
998ef58
·
verified ·
1 Parent(s): 9e25300

Update failed-tunes/Why this failed.txt

Browse files
Files changed (1) hide show
  1. failed-tunes/Why this failed.txt +3 -1
failed-tunes/Why this failed.txt CHANGED
@@ -2,4 +2,6 @@ You may wonder why there is this folder
2
 
3
  This folder is for fine-tunes of Andy-3.5-beta which resulted in less than desireable results.
4
  For the first model here, I tuned it only on the newer prompts instead of it all, meaning the model didn't have the full understanding of the game.
5
- The second model, which is NOT in here, I tuned that model on all 601 examples I have hand-crafted, it can build, code, and summarize memory, it can do everything the models need to do.
 
 
 
2
 
3
  This folder is for fine-tunes of Andy-3.5-beta which resulted in less than desireable results.
4
  For the first model here, I tuned it only on the newer prompts instead of it all, meaning the model didn't have the full understanding of the game.
5
+ The second model was trained on horrible settings, there were not enough steps and I had enabled something that randomly combined parts of the tuning, which made it so the model would have no clue what to do.
6
+ The third,which is NOT in here, I tuned that model on all 620 examples I have hand-crafted, it can build, code, and summarize memory, it can do everything the models need to do.
7
+ The third model had 80,000,000 parameters tuned, compared to the others which had ~40,000,000 parameters tuned, hopefully this makes the model better