chess_swdo_subTok / tokenizer_config.json
swdo's picture
Chess Challenge submission by swdo
86d1117 verified
{
"tokenizer_class": "ChessTokenizer",
"auto_map": {
"AutoTokenizer": [
"tokenizer.ChessTokenizer",
null
]
},
"add_move_separator": false,
"vocab_size": 88
}