O2iginal

/

dsv3_0.5b

like 0

• "megatron.core.transformer.enums.AttnBackend",
• "megatron.core.enums.ModelType",
• "torch.bfloat16",
• "torch.float32",
• "megatron.core.rerun_state_machine.RerunMode",
• "argparse.Namespace"

How to fix it?