RA-ALTA
/

tokenizer-fineweb_pl

Model card Files Files and versions

tokenizer-fineweb_pl / tokenizer_config.json

Commit History

Register tokenizer as HF SentencePiece tokenizer

5e7a8b5
verified

suchirsalhan commited on Feb 23