fix tokenizer resolution: use auto_map only, remove tokenizer_class 66ab6c3 George Treacy commited on May 27
add MakemoreTokenizer, wire AutoTokenizer, drop tokenizer.json 9e25bfd George Treacy commited on May 27