Ouzhang's picture
Add files using upload-large-folder tool
31dc8dc verified
Raw
History Blame Contribute Delete
155 Bytes
train: text8-1k
valid: text8-1k
tokenizer_name_or_path: text8
cache_dir: ./cache
wrap: True
streaming: False
insert_train_eos: True
insert_valid_eos: True