Rogarcia18
/

wikitext2-bpe-tokenizer

Model card Files Files and versions

wikitext2-bpe-tokenizer

Commit History

Upload BPE tokenizer trained on WikiText-2

7cd0c06
verified

Rogarcia18 commited on Sep 19, 2025

Upload BPE tokenizer trained on WikiText-2

c9e63eb
verified

Rogarcia18 commited on Sep 19, 2025

initial commit

b0e9212
verified

Rogarcia18 commited on Sep 19, 2025