Update README.md
Browse files
README.md
CHANGED
|
@@ -32,7 +32,7 @@ This marks the first use of a new prototype object dubbed AnchorBank, which is d
|
|
| 32 |
while specifically aligning the expectation of those distillation valuations into the bank itself.
|
| 33 |
|
| 34 |
This allows the model to POTENTIALLY solve nth token lookup without a head, so a head will allow finetuning. If successful, the anchor bank will contain
|
| 35 |
-
all the knowledge the model requires to
|
| 36 |
|
| 37 |
**HOPEFULLY** after this refit, the structure will be capable of predicting NIL head token prediction, if not I'll work with a different small LLM project and then
|
| 38 |
determine the potential utility of direct integration of the two on a MOE pipeline instead of a full collective behavioral implication.
|
|
|
|
| 32 |
while specifically aligning the expectation of those distillation valuations into the bank itself.
|
| 33 |
|
| 34 |
This allows the model to POTENTIALLY solve nth token lookup without a head, so a head will allow finetuning. If successful, the anchor bank will contain
|
| 35 |
+
all the knowledge the model requires to geometrically represent it's data into expanded structures - if the losses and training process is correctly aligned to the task.
|
| 36 |
|
| 37 |
**HOPEFULLY** after this refit, the structure will be capable of predicting NIL head token prediction, if not I'll work with a different small LLM project and then
|
| 38 |
determine the potential utility of direct integration of the two on a MOE pipeline instead of a full collective behavioral implication.
|