Update README.md

README.md

@@ -12,6 +12,9 @@ license: mit
 
 Multi-modal Variational Autoencoder for text embedding transformation using geometric fusion.
 
+The current implementation is trained with only a handful of token sequences, so it's essentially front-loaded. Expect short sequences to work.
+Full-sequence pretraining will begin soon with a uniform vocabulary that takes both tokens in for a representative uniform token based on the position.
+
 ## Model Details
 
 - **Fusion Strategy**: cantor