train and save model, and roughly genrate words
2f610df
Rafael Camargo
commited on
Commit History
replace simple tokenizer with tiktoken package
74f384d
Rafael Camargo
commited on