applied-ai-018
/

peacock-data-public-evaluation

Model card Files Files and versions

peacock-data-public-evaluation / Megatron-DeepSpeed /examples_deepspeed /rebase

86.4 kB

Ctrl+K

Ctrl+K

1 contributor

History: 1 commit

applied-ai-018's picture

Add files using upload-large-folder tool

1eda32b verified over 1 year ago

README.md

5.02 kB
Add files using upload-large-folder tool over 1 year ago
ds_config_gpt_TEMPLATE.json

436 Bytes
Add files using upload-large-folder tool over 1 year ago
ds_config_gpt_slw_TEMPLATE.json

742 Bytes
Add files using upload-large-folder tool over 1 year ago
ds_pretrain_gpt_1.3B.sh

11.2 kB
Add files using upload-large-folder tool over 1 year ago
ds_pretrain_gpt_1.3B_megatron_checkpointing.sh

12.2 kB
Add files using upload-large-folder tool over 1 year ago
ds_pretrain_gpt_1.3B_rope.sh

11.3 kB
Add files using upload-large-folder tool over 1 year ago
ds_pretrain_gpt_1.3B_rope_slw.sh

12.2 kB
Add files using upload-large-folder tool over 1 year ago
ds_pretrain_gpt_125M.sh

11 kB
Add files using upload-large-folder tool over 1 year ago
ds_pretrain_gpt_125M_flashattn.sh

11 kB
Add files using upload-large-folder tool over 1 year ago
ds_pretrain_gpt_13B.sh

11.2 kB
Add files using upload-large-folder tool over 1 year ago