Models
Datasets
Spaces
Buckets new
Docs
Enterprise
Pricing
Log In
Sign Up

ace-1
/

mgpt2-tokenizer

Model card Files Files and versions

mgpt2-tokenizer

1 contributor

History: 7 commits

ace-1's picture

Fix transformers v5 auto_map + HF init

16fed5d verified 7 days ago

tokenizer
Fix transformers v5 auto_map + HF init 7 days ago
.gitattributes

1.52 kB

initial commit 20 days ago
README.md

1.8 kB

Publish mgpt2 tokenizer (GPT-2 exact merges) + eval metrics 7 days ago
added_tokens.json

29 Bytes

Upload mgpt2 tokenizer 18 days ago
evaluation.json

7.59 kB

Upload mgpt2 tokenizer 12 days ago
special_tokens_map.json

35 Bytes

Upload mgpt2 tokenizer 20 days ago
tokenization_mgpt2.py

80 Bytes

Publish mgpt2 tokenizer (GPT-2 exact merges) + eval metrics 7 days ago
tokenizer.model

465 kB
xet

Upload mgpt2 tokenizer 12 days ago
tokenizer.vocab

1.82 MB

Upload mgpt2 tokenizer 12 days ago
tokenizer_config.json

530 Bytes

Fix transformers v5 auto_map + HF init 7 days ago