Malikeh1375 commited on
Commit
88ee2bb
·
verified ·
1 Parent(s): bd851da

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -1
README.md CHANGED
@@ -17,6 +17,8 @@ tags:
17
  - research
18
  pipeline_tag: text-generation
19
  library_name: transformers
 
 
20
  ---
21
 
22
  <p align="left">
@@ -196,4 +198,4 @@ If you use this model, please cite:
196
  title={TokSuite: Measuring the Impact of Tokenizer Choice on Language Model Behavior},
197
  author={Altıntaş, Gul Sena and Ehghaghi, Malikeh and Lester, Brian and Liu, Fengyuan and Zhao, Wanru and Ciccone, Marco and Raffel, Colin},
198
  year={2025}
199
- }
 
17
  - research
18
  pipeline_tag: text-generation
19
  library_name: transformers
20
+ datasets:
21
+ - toksuite/toksuite_pretraining_data
22
  ---
23
 
24
  <p align="left">
 
198
  title={TokSuite: Measuring the Impact of Tokenizer Choice on Language Model Behavior},
199
  author={Altıntaş, Gul Sena and Ehghaghi, Malikeh and Lester, Brian and Liu, Fengyuan and Zhao, Wanru and Ciccone, Marco and Raffel, Colin},
200
  year={2025}
201
+ }