| --------- Environment sanity check --------- | |
| shell: ./sft-safe.sh running under bash 5.0.17(1)-release | |
| conda env: pda | |
| python: /home/panda/miniconda3/envs/pda/bin/python | |
| sys.executable : /home/panda/miniconda3/envs/pda/bin/python | |
| python version : 3.11.11 | |
| CONDA_PREFIX : /home/panda/miniconda3/envs/pda | |
| deepspeed: /home/panda/miniconda3/envs/pda/bin/deepspeed | |
| -------------------------------------------- | |
| [2025-05-01 21:22:25,246] [INFO] [real_accelerator.py:239:get_accelerator] Setting ds_accelerator to cuda (auto detect) | |
| [2025-05-01 21:22:26,990] [WARNING] [runner.py:215:fetch_hostfile] Unable to find hostfile, will proceed with training with local resources only. | |
| Detected VISIBLE_DEVICES=0,1: setting --include=localhost:0,1 | |
| [2025-05-01 21:22:26,990] [INFO] [runner.py:605:main] cmd = /home/panda/miniconda3/envs/pda/bin/python -u -m deepspeed.launcher.launch --world_info=eyJsb2NhbGhvc3QiOiBbMCwgMV19 --master_addr=127.0.0.1 --master_port=26602 --module --enable_each_rank_log=None safe_rlhf.algorithms.safe_ft --train_datasets SAFE-ALPACA/300 --model_name_or_path huggyllama/llama-7b --cache_dir /home/panda/pda-llm/cache/sft-300 --safe_sft false --max_length 1024 --trust_remote_code True --epochs 6 --per_device_train_batch_size 4 --per_device_eval_batch_size 4 --gradient_accumulation_steps 32 --gradient_checkpointing --learning_rate 1e-4 --lr_scheduler_type cosine --lr_warmup_ratio 0.03 --weight_decay 0.0 --seed 42 --output_dir /home/panda/pda-llm/output/sft-safe/300/run-false-300-1-10 --log_type wandb --log_project SAFE-SFT-v3 --zero_stage 0 --offload none --safety_ratio_tol 10 --resilient_coeff 1 --lora_r 4 --lora_alpha 16 --lora_dropout 0.05 --bf16 False --fp16 True --tf32 True | |
| [2025-05-01 21:22:28,124] [INFO] [real_accelerator.py:239:get_accelerator] Setting ds_accelerator to cuda (auto detect) | |
| [2025-05-01 21:22:29,823] [INFO] [launch.py:146:main] WORLD INFO DICT: {'localhost': [0, 1]} | |
| [2025-05-01 21:22:29,823] [INFO] [launch.py:152:main] nnodes=1, num_local_procs=2, node_rank=0 | |
| [2025-05-01 21:22:29,823] [INFO] [launch.py:163:main] global_rank_mapping=defaultdict(<class 'list'>, {'localhost': [0, 1]}) | |
| [2025-05-01 21:22:29,823] [INFO] [launch.py:164:main] dist_world_size=2 | |
| [2025-05-01 21:22:29,823] [INFO] [launch.py:168:main] Setting CUDA_VISIBLE_DEVICES=0,1 | |
| [2025-05-01 21:22:29,824] [INFO] [launch.py:256:main] process 1926216 spawned with command: ['/home/panda/miniconda3/envs/pda/bin/python', '-u', '-m', 'safe_rlhf.algorithms.safe_ft', '--local_rank=0', '--train_datasets', 'SAFE-ALPACA/300', '--model_name_or_path', 'huggyllama/llama-7b', '--cache_dir', '/home/panda/pda-llm/cache/sft-300', '--safe_sft', 'false', '--max_length', '1024', '--trust_remote_code', 'True', '--epochs', '6', '--per_device_train_batch_size', '4', '--per_device_eval_batch_size', '4', '--gradient_accumulation_steps', '32', '--gradient_checkpointing', '--learning_rate', '1e-4', '--lr_scheduler_type', 'cosine', '--lr_warmup_ratio', '0.03', '--weight_decay', '0.0', '--seed', '42', '--output_dir', '/home/panda/pda-llm/output/sft-safe/300/run-false-300-1-10', '--log_type', 'wandb', '--log_project', 'SAFE-SFT-v3', '--zero_stage', '0', '--offload', 'none', '--safety_ratio_tol', '10', '--resilient_coeff', '1', '--lora_r', '4', '--lora_alpha', '16', '--lora_dropout', '0.05', '--bf16', 'False', '--fp16', 'True', '--tf32', 'True'] | |
| [2025-05-01 21:22:29,824] [INFO] [launch.py:256:main] process 1926217 spawned with command: ['/home/panda/miniconda3/envs/pda/bin/python', '-u', '-m', 'safe_rlhf.algorithms.safe_ft', '--local_rank=1', '--train_datasets', 'SAFE-ALPACA/300', '--model_name_or_path', 'huggyllama/llama-7b', '--cache_dir', '/home/panda/pda-llm/cache/sft-300', '--safe_sft', 'false', '--max_length', '1024', '--trust_remote_code', 'True', '--epochs', '6', '--per_device_train_batch_size', '4', '--per_device_eval_batch_size', '4', '--gradient_accumulation_steps', '32', '--gradient_checkpointing', '--learning_rate', '1e-4', '--lr_scheduler_type', 'cosine', '--lr_warmup_ratio', '0.03', '--weight_decay', '0.0', '--seed', '42', '--output_dir', '/home/panda/pda-llm/output/sft-safe/300/run-false-300-1-10', '--log_type', 'wandb', '--log_project', 'SAFE-SFT-v3', '--zero_stage', '0', '--offload', 'none', '--safety_ratio_tol', '10', '--resilient_coeff', '1', '--lora_r', '4', '--lora_alpha', '16', '--lora_dropout', '0.05', '--bf16', 'False', '--fp16', 'True', '--tf32', 'True'] | |
| [2025-05-01 21:22:30,979] [INFO] [real_accelerator.py:239:get_accelerator] Setting ds_accelerator to cuda (auto detect) | |
| [2025-05-01 21:22:31,004] [INFO] [real_accelerator.py:239:get_accelerator] Setting ds_accelerator to cuda (auto detect) | |
| [2025-05-01 21:22:33,886] [INFO] [comm.py:658:init_distributed] cdb=None | |
| [2025-05-01 21:22:33,886] [INFO] [comm.py:689:init_distributed] Initializing TorchBackend in DeepSpeed with backend nccl | |
| [2025-05-01 21:22:33,888] [INFO] [comm.py:658:init_distributed] cdb=None | |
| Set logger level to WARNING. | |
| calculating baseline ... | |
| calculating baseline ... | |
| Loading cached baseline logprobs from /home/panda/pda-llm/cache/sft-300/cached_baseline_logprobs.pt | |
| Loaded cached baseline logprobs successfully | |
| ninja: no work to do. | |
| Time to load fused_adam op: 0.032178401947021484 seconds | |
| Time to load fused_adam op: 0.10086774826049805 seconds | |
| ***** Running training ***** | |
| ***** Evaluating at the beginning ***** | |
| ***** Evaluating at epoch 1/6 ***** | |
| ***** Evaluating at epoch 2/6 ***** | |
| ***** Evaluating at epoch 3/6 ***** | |
| ***** Evaluating at epoch 4/6 ***** | |
| ***** Evaluating at epoch 5/6 ***** | |
| ***** Evaluating at epoch 6/6 ***** | |
| Saving model to "/home/panda/pda-llm/output/sft-safe/300/run-false-300-1-10" ... | |
| Saving Hugging Face Checkpoints... | |
| Model saved! | |
| [2025-05-01 23:40:51,870] [INFO] [launch.py:351:main] Process 1926217 exits successfully. | |
| [2025-05-01 23:40:54,871] [INFO] [launch.py:351:main] Process 1926216 exits successfully. | |