makemore-mlp / tokenization_makemore.py

Commit History

fix AutoTokenizer auto_map to string not array
9fc7c74

George Treacy commited on

automodel and autotok
be8f2be

George Treacy commited on

add MakemoreTokenizer, wire AutoTokenizer, drop tokenizer.json
9e25bfd

George Treacy commited on