Update failed-tunes/Why this failed.txt
Browse files
failed-tunes/Why this failed.txt
CHANGED
|
@@ -2,4 +2,6 @@ You may wonder why there is this folder
|
|
| 2 |
|
| 3 |
This folder is for fine-tunes of Andy-3.5-beta which resulted in less than desireable results.
|
| 4 |
For the first model here, I tuned it only on the newer prompts instead of it all, meaning the model didn't have the full understanding of the game.
|
| 5 |
-
The second model
|
|
|
|
|
|
|
|
|
| 2 |
|
| 3 |
This folder is for fine-tunes of Andy-3.5-beta which resulted in less than desireable results.
|
| 4 |
For the first model here, I tuned it only on the newer prompts instead of it all, meaning the model didn't have the full understanding of the game.
|
| 5 |
+
The second model was trained on horrible settings, there were not enough steps and I had enabled something that randomly combined parts of the tuning, which made it so the model would have no clue what to do.
|
| 6 |
+
The third,which is NOT in here, I tuned that model on all 620 examples I have hand-crafted, it can build, code, and summarize memory, it can do everything the models need to do.
|
| 7 |
+
The third model had 80,000,000 parameters tuned, compared to the others which had ~40,000,000 parameters tuned, hopefully this makes the model better
|