O2iginal
/

dsv3_0.5b

Model card Files Files and versions

1.67 GB

1 contributor

History: 20 commits

O2iginal's picture

Upload __21_0.distcp to dsv3_0.5b

9412089 verified 5 months ago

.gitattributes

2.17 kB

Upload __21_0.distcp to dsv3_0.5b 5 months ago
LOG_NODE_RANK_3.log

5.55 MB

Upload LOG_NODE_RANK_3.log to dsv3_0.5b 5 months ago
README.md

348 Bytes

Add model card with tags for dsv3_0.5b 5 months ago
__0_0.distcp

174 MB
xet

Upload __0_0.distcp to dsv3_0.5b 5 months ago
__11_0.distcp

125 MB
xet

Upload __11_0.distcp to dsv3_0.5b 5 months ago
__13_1.distcp

125 MB
xet

Upload __13_1.distcp to dsv3_0.5b 5 months ago
__14_1.distcp

124 MB
xet

Upload __14_1.distcp to dsv3_0.5b 5 months ago
__17_0.distcp

124 MB
xet

Upload __17_0.distcp to dsv3_0.5b 5 months ago
__19_1.distcp

124 MB
xet

Upload __19_1.distcp to dsv3_0.5b 5 months ago
__20_0.distcp

124 MB
xet

Upload __20_0.distcp to dsv3_0.5b 5 months ago
__21_0.distcp

124 MB
xet

Upload __21_0.distcp to dsv3_0.5b 5 months ago
__25_0.distcp

124 MB
xet

Upload __25_0.distcp to dsv3_0.5b 5 months ago
__2_0.distcp

125 MB
xet

Upload __2_0.distcp to dsv3_0.5b 5 months ago
__31_1.distcp

125 MB
xet

Upload __31_1.distcp to dsv3_0.5b 5 months ago
__6_0.distcp

125 MB
xet

Upload __6_0.distcp to dsv3_0.5b 5 months ago
__7_1.distcp

124 MB
xet

Upload __7_1.distcp to dsv3_0.5b 5 months ago
common.pt
Detected Pickle imports (6)
- "megatron.core.transformer.enums.AttnBackend",
- "megatron.core.enums.ModelType",
- "torch.bfloat16",
- "torch.float32",
- "megatron.core.rerun_state_machine.RerunMode",
- "argparse.Namespace"
How to fix it?
19 kB
xet

Upload common.pt to dsv3_0.5b 5 months ago
dsv3_0.5b_pretrain_template.sh

8.63 kB

Upload dsv3_0.5b_pretrain_template.sh to dsv3_0.5b 5 months ago
run_2node_dsv3_0.5b_pretrain.sh

2.07 kB

Upload run_2node_dsv3_0.5b_pretrain.sh to dsv3_0.5b 5 months ago
upload_status.json

781 Bytes

Upload upload_status.json to dsv3_0.5b 5 months ago