scaled-base / tokenizer_config.json

Commit History

Patch tokenizer_config.json: add auto_map for trust_remote_code
118a754
verified

ml-ryanlee commited on

Add gpt2 tokenizer: tokenizer_config.json
b3bed42
verified

ml-ryanlee commited on

Patch tokenizer_config.json: add auto_map for trust_remote_code
218be48
verified

ml-ryanlee commited on

Add gpt2 tokenizer: tokenizer_config.json
baab812
verified

ml-ryanlee commited on

Patch tokenizer_config.json: add auto_map for trust_remote_code
091bc71
verified

ml-ryanlee commited on

Add gpt2 tokenizer: tokenizer_config.json
1193677
verified

ml-ryanlee commited on