prism-lab
/

official-implementation

Model card Files Files and versions

prism-lab commited on Apr 1

Commit

c3d749a

·

verified ·

1 Parent(s): c103487

Update README.md

Files changed (1) hide show

README.md +2 -1

README.md CHANGED Viewed

@@ -40,5 +40,6 @@ All notebooks pull pre-tokenized data from prism-lab/wikitext-103-prism-32k-seq4
 All models use tied embeddings (input embeddings = output projection weights). Checkpoint files contain duplicated weights for compatibility. Evaluation scripts redefine model classes with proper weight tying before loading.
 ## Additional Notes
-Phase exploration on embeddings will be replaced soon with stronger version which includes statistical test
 Causal ablation codes and models will be added soon.

 All models use tied embeddings (input embeddings = output projection weights). Checkpoint files contain duplicated weights for compatibility. Evaluation scripts redefine model classes with proper weight tying before loading.
 ## Additional Notes
+Phase exploration on embeddings will be replaced soon with stronger version which includes statistical analysis.
 Causal ablation codes and models will be added soon.