AbstractPhil commited on
Commit
88ab7af
·
verified ·
1 Parent(s): ca8058d

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -32,7 +32,7 @@ This marks the first use of a new prototype object dubbed AnchorBank, which is d
32
  while specifically aligning the expectation of those distillation valuations into the bank itself.
33
 
34
  This allows the model to POTENTIALLY solve nth token lookup without a head, so a head will allow finetuning. If successful, the anchor bank will contain
35
- all the knowledge the model requires to geomewtrically represent it's data into expanded structures - if the losses and training process is correctly aligned to the task.
36
 
37
  **HOPEFULLY** after this refit, the structure will be capable of predicting NIL head token prediction, if not I'll work with a different small LLM project and then
38
  determine the potential utility of direct integration of the two on a MOE pipeline instead of a full collective behavioral implication.
 
32
  while specifically aligning the expectation of those distillation valuations into the bank itself.
33
 
34
  This allows the model to POTENTIALLY solve nth token lookup without a head, so a head will allow finetuning. If successful, the anchor bank will contain
35
+ all the knowledge the model requires to geometrically represent it's data into expanded structures - if the losses and training process is correctly aligned to the task.
36
 
37
  **HOPEFULLY** after this refit, the structure will be capable of predicting NIL head token prediction, if not I'll work with a different small LLM project and then
38
  determine the potential utility of direct integration of the two on a MOE pipeline instead of a full collective behavioral implication.