Fix text splitting

#2
by Ethylene - opened

previous splitting code created tokens which were unable to be processed

Cannot merge
This branch has merge conflicts in the following files:
  • RunMiniLM.cs

Sign up or log in to comment