1.37 MB

Ctrl+K

1 contributor

History: 1 commit

KexuanShi

Upload folder using huggingface_hub

88e6849 verified about 2 months ago

__pycache__
Upload folder using huggingface_hub about 2 months ago
retro
Upload folder using huggingface_hub about 2 months ago
Makefile

313 Bytes
Upload folder using huggingface_hub about 2 months ago
__init__.py

0 Bytes
Upload folder using huggingface_hub about 2 months ago
bert_dataset.py

7.28 kB
Upload folder using huggingface_hub about 2 months ago
blended_dataset.py

9.99 kB
Upload folder using huggingface_hub about 2 months ago
blended_megatron_dataset_builder.py

25.1 kB
Upload folder using huggingface_hub about 2 months ago
blended_megatron_dataset_config.py

9.42 kB
Upload folder using huggingface_hub about 2 months ago
data_schedule.py

12.9 kB
Upload folder using huggingface_hub about 2 months ago
gpt_dataset.py

34.4 kB
Upload folder using huggingface_hub about 2 months ago
helpers.cpp

29.8 kB
Upload folder using huggingface_hub about 2 months ago
helpers.py

2.13 kB
Upload folder using huggingface_hub about 2 months ago
helpers_cpp.cpython-311-x86_64-linux-gnu.so

268 kB
xet

Upload folder using huggingface_hub about 2 months ago
helpers_cpp.cpython-312-x86_64-linux-gnu.so

261 kB
xet

Upload folder using huggingface_hub about 2 months ago
indexed_dataset.py

38.2 kB
Upload folder using huggingface_hub about 2 months ago
masked_dataset.py

17.6 kB
Upload folder using huggingface_hub about 2 months ago
megatron_dataset.py

7.21 kB
Upload folder using huggingface_hub about 2 months ago
megatron_tokenizer.py

4.67 kB
Upload folder using huggingface_hub about 2 months ago
multimodal_dataset.py

1.91 kB
Upload folder using huggingface_hub about 2 months ago
object_storage_utils.py

8.31 kB
Upload folder using huggingface_hub about 2 months ago
readme.md

8.97 kB
Upload folder using huggingface_hub about 2 months ago
t5_dataset.py

14.3 kB
Upload folder using huggingface_hub about 2 months ago
utils.py

2.79 kB
Upload folder using huggingface_hub about 2 months ago
utils_s3.py

185 Bytes
Upload folder using huggingface_hub about 2 months ago