hku_diffusion_dllm / reference /code /flm /configs /data /lm1b-streaming.yaml
Ouzhang's picture
Add files using upload-large-folder tool
31dc8dc verified
Raw
History Blame Contribute Delete
158 Bytes
train: lm1b
valid: lm1b
tokenizer_name_or_path: bert-base-uncased
cache_dir: ./cache
wrap: False
streaming: True
insert_train_eos: True
insert_valid_eos: True