Commit History

Add special_tokens_map.json for transformers 4.x compatibility
c1685dd
verified

Kyle1668 commited on

Add detailed README documenting changes vs upstream Nemotron tokenizer
20224f1
verified

Kyle1668 commited on

Initial upload: instruct-only Nemotron tokenizer (no think-tag injection)
0739f2f
verified

Kyle1668 commited on

initial commit
baf3c80
verified

Kyle1668 commited on