omarmomen
/

babylm_tokenizer_32k

Model card Files Files and versions

omarmomen commited on Mar 26, 2024

Commit

75fcf77

·

verified ·

1 Parent(s): 2e80b2d

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -13,4 +13,4 @@ library_name: transformers
 This tokenizer is part of the experiments in the published paper at the BabyLM workshop in CoNLL 2023.
 The paper titled "Increasing The Performance of Cognitively Inspired Data-Efficient Language Models via Implicit Structure Building" (https://aclanthology.org/2023.conll-babylm.29/)
-<strong>omarmomen/babylm_tokenizer_32k</strong> is a RobertTokenizer that is pretrained on the BabyLM 10M dataset (cased) with 32K tokens.

 This tokenizer is part of the experiments in the published paper at the BabyLM workshop in CoNLL 2023.
 The paper titled "Increasing The Performance of Cognitively Inspired Data-Efficient Language Models via Implicit Structure Building" (https://aclanthology.org/2023.conll-babylm.29/)
+<strong>omarmomen/babylm_tokenizer_32k</strong> is a RobertaTokenizer that is pretrained on the BabyLM 10M dataset (cased) with 32K tokens.