| # python3 -m espnet2.bin.s2t_train --use_preprocessor true --bpemodel data/token_list/bpe_unigram50000/bpe.model --token_type bpe --token_list data/token_list/bpe_unigram50000/tokens.txt --non_linguistic_symbols none --cleaner none --g2p none --valid_data_path_and_name_and_type dump/raw/cgn_valid/wav.scp,speech,kaldi_ark --valid_shape_file /ocean/projects/cis210027p/pwang10/rota/espnet/egs2/owsm_v3.1/s2t1/exp/s2t_stats_raw_bpe50000_medium//valid/speech_shape --resume true --fold_length 80000 --output_dir exp/s2t_lora_2 --config conf/lora_medium_2.yaml --frontend_conf fs=16k --normalize=global_mvn --normalize_conf stats_file=/ocean/projects/cis210027p/pwang10/rota/espnet/egs2/owsm_v3.1/s2t1/exp/s2t_stats_raw_bpe50000_medium//train/feats_stats.npz --train_data_path_and_name_and_type dump/raw/cgn_train/wav.scp,speech,kaldi_ark --train_shape_file /ocean/projects/cis210027p/pwang10/rota/espnet/egs2/owsm_v3.1/s2t1/exp/s2t_stats_raw_bpe50000_medium//train/speech_shape --fold_length 150 --train_data_path_and_name_and_type dump/raw/cgn_train/text.prev,text_prev,text --train_shape_file /ocean/projects/cis210027p/pwang10/rota/espnet/egs2/owsm_v3.1/s2t1/exp/s2t_stats_raw_bpe50000_medium//train/text_prev_shape.bpe --fold_length 150 --train_data_path_and_name_and_type dump/raw/cgn_train/text.ctc,text_ctc,text --train_shape_file /ocean/projects/cis210027p/pwang10/rota/espnet/egs2/owsm_v3.1/s2t1/exp/s2t_stats_raw_bpe50000_medium//train/text_ctc_shape.bpe --fold_length 150 --train_data_path_and_name_and_type dump/raw/cgn_train/text,text,text --train_shape_file /ocean/projects/cis210027p/pwang10/rota/espnet/egs2/owsm_v3.1/s2t1/exp/s2t_stats_raw_bpe50000_medium//train/text_shape.bpe --valid_data_path_and_name_and_type dump/raw/cgn_valid/text.prev,text_prev,text --valid_shape_file /ocean/projects/cis210027p/pwang10/rota/espnet/egs2/owsm_v3.1/s2t1/exp/s2t_stats_raw_bpe50000_medium//valid/text_prev_shape.bpe --valid_data_path_and_name_and_type dump/raw/cgn_valid/text.ctc,text_ctc,text --valid_shape_file /ocean/projects/cis210027p/pwang10/rota/espnet/egs2/owsm_v3.1/s2t1/exp/s2t_stats_raw_bpe50000_medium//valid/text_ctc_shape.bpe --valid_data_path_and_name_and_type dump/raw/cgn_valid/text,text,text --valid_shape_file /ocean/projects/cis210027p/pwang10/rota/espnet/egs2/owsm_v3.1/s2t1/exp/s2t_stats_raw_bpe50000_medium//valid/text_shape.bpe --model_conf extract_feats_in_collect_stats=false --ngpu 1 --multiprocessing_distributed True |
| # Started at Thu May 22 06:02:45 EDT 2025 |
| # |
| /ocean/projects/cis210027p/pwang10/miniconda3/envs/rota/bin/python3 /ocean/projects/cis210027p/pwang10/rota/espnet/espnet2/bin/s2t_train.py --use_preprocessor true --bpemodel data/token_list/bpe_unigram50000/bpe.model --token_type bpe --token_list data/token_list/bpe_unigram50000/tokens.txt --non_linguistic_symbols none --cleaner none --g2p none --valid_data_path_and_name_and_type dump/raw/cgn_valid/wav.scp,speech,kaldi_ark --valid_shape_file /ocean/projects/cis210027p/pwang10/rota/espnet/egs2/owsm_v3.1/s2t1/exp/s2t_stats_raw_bpe50000_medium//valid/speech_shape --resume true --fold_length 80000 --output_dir exp/s2t_lora_2 --config conf/lora_medium_2.yaml --frontend_conf fs=16k --normalize=global_mvn --normalize_conf stats_file=/ocean/projects/cis210027p/pwang10/rota/espnet/egs2/owsm_v3.1/s2t1/exp/s2t_stats_raw_bpe50000_medium//train/feats_stats.npz --train_data_path_and_name_and_type dump/raw/cgn_train/wav.scp,speech,kaldi_ark --train_shape_file /ocean/projects/cis210027p/pwang10/rota/espnet/egs2/owsm_v3.1/s2t1/exp/s2t_stats_raw_bpe50000_medium//train/speech_shape --fold_length 150 --train_data_path_and_name_and_type dump/raw/cgn_train/text.prev,text_prev,text --train_shape_file /ocean/projects/cis210027p/pwang10/rota/espnet/egs2/owsm_v3.1/s2t1/exp/s2t_stats_raw_bpe50000_medium//train/text_prev_shape.bpe --fold_length 150 --train_data_path_and_name_and_type dump/raw/cgn_train/text.ctc,text_ctc,text --train_shape_file /ocean/projects/cis210027p/pwang10/rota/espnet/egs2/owsm_v3.1/s2t1/exp/s2t_stats_raw_bpe50000_medium//train/text_ctc_shape.bpe --fold_length 150 --train_data_path_and_name_and_type dump/raw/cgn_train/text,text,text --train_shape_file /ocean/projects/cis210027p/pwang10/rota/espnet/egs2/owsm_v3.1/s2t1/exp/s2t_stats_raw_bpe50000_medium//train/text_shape.bpe --valid_data_path_and_name_and_type dump/raw/cgn_valid/text.prev,text_prev,text --valid_shape_file /ocean/projects/cis210027p/pwang10/rota/espnet/egs2/owsm_v3.1/s2t1/exp/s2t_stats_raw_bpe50000_medium//valid/text_prev_shape.bpe --valid_data_path_and_name_and_type dump/raw/cgn_valid/text.ctc,text_ctc,text --valid_shape_file /ocean/projects/cis210027p/pwang10/rota/espnet/egs2/owsm_v3.1/s2t1/exp/s2t_stats_raw_bpe50000_medium//valid/text_ctc_shape.bpe --valid_data_path_and_name_and_type dump/raw/cgn_valid/text,text,text --valid_shape_file /ocean/projects/cis210027p/pwang10/rota/espnet/egs2/owsm_v3.1/s2t1/exp/s2t_stats_raw_bpe50000_medium//valid/text_shape.bpe --model_conf extract_feats_in_collect_stats=false --ngpu 1 --multiprocessing_distributed True |
| [w010] 2025-05-22 06:05:06,649 (s2t:462) INFO: Vocabulary size: 50002 |
| [w010] 2025-05-22 06:05:11,375 (e_branchformer_encoder:445) INFO: Gradient checkpoint layers: [] |
| [w010] 2025-05-22 06:05:11,863 (transformer_decoder:103) INFO: Gradient checkpoint layers: [] |
| [w010] 2025-05-22 06:05:14,458 (abs_task:1370) INFO: Setting encoder.embed.conv.0.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,458 (abs_task:1370) INFO: Setting encoder.embed.conv.0.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,458 (abs_task:1370) INFO: Setting encoder.embed.conv.2.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,458 (abs_task:1370) INFO: Setting encoder.embed.conv.2.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,458 (abs_task:1370) INFO: Setting encoder.embed.out.0.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,458 (abs_task:1370) INFO: Setting encoder.embed.out.0.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,458 (abs_task:1370) INFO: Setting encoder.encoders.0.attn.linear_q.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,458 (abs_task:1370) INFO: Setting encoder.encoders.0.attn.linear_q.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,458 (abs_task:1370) INFO: Setting encoder.encoders.0.attn.linear_k.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,458 (abs_task:1370) INFO: Setting encoder.encoders.0.attn.linear_k.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,458 (abs_task:1370) INFO: Setting encoder.encoders.0.attn.linear_v.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,458 (abs_task:1370) INFO: Setting encoder.encoders.0.attn.linear_v.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,458 (abs_task:1370) INFO: Setting encoder.encoders.0.attn.linear_out.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,458 (abs_task:1370) INFO: Setting encoder.encoders.0.attn.linear_out.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,458 (abs_task:1370) INFO: Setting encoder.encoders.0.cgmlp.channel_proj1.0.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,458 (abs_task:1370) INFO: Setting encoder.encoders.0.cgmlp.channel_proj1.0.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,458 (abs_task:1370) INFO: Setting encoder.encoders.0.cgmlp.csgu.norm.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,458 (abs_task:1370) INFO: Setting encoder.encoders.0.cgmlp.csgu.norm.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,458 (abs_task:1370) INFO: Setting encoder.encoders.0.cgmlp.csgu.conv.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,458 (abs_task:1370) INFO: Setting encoder.encoders.0.cgmlp.csgu.conv.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,458 (abs_task:1370) INFO: Setting encoder.encoders.0.cgmlp.channel_proj2.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,458 (abs_task:1370) INFO: Setting encoder.encoders.0.cgmlp.channel_proj2.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,458 (abs_task:1370) INFO: Setting encoder.encoders.0.feed_forward.w_1.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,458 (abs_task:1370) INFO: Setting encoder.encoders.0.feed_forward.w_1.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,458 (abs_task:1370) INFO: Setting encoder.encoders.0.feed_forward.w_2.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,458 (abs_task:1370) INFO: Setting encoder.encoders.0.feed_forward.w_2.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,459 (abs_task:1370) INFO: Setting encoder.encoders.0.feed_forward_macaron.w_1.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,459 (abs_task:1370) INFO: Setting encoder.encoders.0.feed_forward_macaron.w_1.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,459 (abs_task:1370) INFO: Setting encoder.encoders.0.feed_forward_macaron.w_2.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,459 (abs_task:1370) INFO: Setting encoder.encoders.0.feed_forward_macaron.w_2.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,459 (abs_task:1370) INFO: Setting encoder.encoders.0.norm_ff.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,459 (abs_task:1370) INFO: Setting encoder.encoders.0.norm_ff.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,459 (abs_task:1370) INFO: Setting encoder.encoders.0.norm_ff_macaron.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,459 (abs_task:1370) INFO: Setting encoder.encoders.0.norm_ff_macaron.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,459 (abs_task:1370) INFO: Setting encoder.encoders.0.norm_mha.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,459 (abs_task:1370) INFO: Setting encoder.encoders.0.norm_mha.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,459 (abs_task:1370) INFO: Setting encoder.encoders.0.norm_mlp.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,459 (abs_task:1370) INFO: Setting encoder.encoders.0.norm_mlp.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,459 (abs_task:1370) INFO: Setting encoder.encoders.0.norm_final.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,459 (abs_task:1370) INFO: Setting encoder.encoders.0.norm_final.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,459 (abs_task:1370) INFO: Setting encoder.encoders.0.depthwise_conv_fusion.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,459 (abs_task:1370) INFO: Setting encoder.encoders.0.depthwise_conv_fusion.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,459 (abs_task:1370) INFO: Setting encoder.encoders.0.merge_proj.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,459 (abs_task:1370) INFO: Setting encoder.encoders.0.merge_proj.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,459 (abs_task:1370) INFO: Setting encoder.encoders.1.attn.linear_q.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,459 (abs_task:1370) INFO: Setting encoder.encoders.1.attn.linear_q.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,459 (abs_task:1370) INFO: Setting encoder.encoders.1.attn.linear_k.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,459 (abs_task:1370) INFO: Setting encoder.encoders.1.attn.linear_k.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,459 (abs_task:1370) INFO: Setting encoder.encoders.1.attn.linear_v.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,459 (abs_task:1370) INFO: Setting encoder.encoders.1.attn.linear_v.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,459 (abs_task:1370) INFO: Setting encoder.encoders.1.attn.linear_out.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,459 (abs_task:1370) INFO: Setting encoder.encoders.1.attn.linear_out.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,459 (abs_task:1370) INFO: Setting encoder.encoders.1.cgmlp.channel_proj1.0.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,459 (abs_task:1370) INFO: Setting encoder.encoders.1.cgmlp.channel_proj1.0.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,459 (abs_task:1370) INFO: Setting encoder.encoders.1.cgmlp.csgu.norm.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,459 (abs_task:1370) INFO: Setting encoder.encoders.1.cgmlp.csgu.norm.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,459 (abs_task:1370) INFO: Setting encoder.encoders.1.cgmlp.csgu.conv.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,459 (abs_task:1370) INFO: Setting encoder.encoders.1.cgmlp.csgu.conv.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,459 (abs_task:1370) INFO: Setting encoder.encoders.1.cgmlp.channel_proj2.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,459 (abs_task:1370) INFO: Setting encoder.encoders.1.cgmlp.channel_proj2.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,459 (abs_task:1370) INFO: Setting encoder.encoders.1.feed_forward.w_1.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,459 (abs_task:1370) INFO: Setting encoder.encoders.1.feed_forward.w_1.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,459 (abs_task:1370) INFO: Setting encoder.encoders.1.feed_forward.w_2.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,459 (abs_task:1370) INFO: Setting encoder.encoders.1.feed_forward.w_2.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,459 (abs_task:1370) INFO: Setting encoder.encoders.1.feed_forward_macaron.w_1.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,459 (abs_task:1370) INFO: Setting encoder.encoders.1.feed_forward_macaron.w_1.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,459 (abs_task:1370) INFO: Setting encoder.encoders.1.feed_forward_macaron.w_2.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,459 (abs_task:1370) INFO: Setting encoder.encoders.1.feed_forward_macaron.w_2.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,459 (abs_task:1370) INFO: Setting encoder.encoders.1.norm_ff.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,459 (abs_task:1370) INFO: Setting encoder.encoders.1.norm_ff.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,459 (abs_task:1370) INFO: Setting encoder.encoders.1.norm_ff_macaron.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,459 (abs_task:1370) INFO: Setting encoder.encoders.1.norm_ff_macaron.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,459 (abs_task:1370) INFO: Setting encoder.encoders.1.norm_mha.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,459 (abs_task:1370) INFO: Setting encoder.encoders.1.norm_mha.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,459 (abs_task:1370) INFO: Setting encoder.encoders.1.norm_mlp.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,459 (abs_task:1370) INFO: Setting encoder.encoders.1.norm_mlp.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,459 (abs_task:1370) INFO: Setting encoder.encoders.1.norm_final.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,459 (abs_task:1370) INFO: Setting encoder.encoders.1.norm_final.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,459 (abs_task:1370) INFO: Setting encoder.encoders.1.depthwise_conv_fusion.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,459 (abs_task:1370) INFO: Setting encoder.encoders.1.depthwise_conv_fusion.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,459 (abs_task:1370) INFO: Setting encoder.encoders.1.merge_proj.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,459 (abs_task:1370) INFO: Setting encoder.encoders.1.merge_proj.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,459 (abs_task:1370) INFO: Setting encoder.encoders.2.attn.linear_q.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,460 (abs_task:1370) INFO: Setting encoder.encoders.2.attn.linear_q.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,460 (abs_task:1370) INFO: Setting encoder.encoders.2.attn.linear_k.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,460 (abs_task:1370) INFO: Setting encoder.encoders.2.attn.linear_k.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,460 (abs_task:1370) INFO: Setting encoder.encoders.2.attn.linear_v.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,460 (abs_task:1370) INFO: Setting encoder.encoders.2.attn.linear_v.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,460 (abs_task:1370) INFO: Setting encoder.encoders.2.attn.linear_out.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,460 (abs_task:1370) INFO: Setting encoder.encoders.2.attn.linear_out.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,460 (abs_task:1370) INFO: Setting encoder.encoders.2.cgmlp.channel_proj1.0.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,460 (abs_task:1370) INFO: Setting encoder.encoders.2.cgmlp.channel_proj1.0.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,460 (abs_task:1370) INFO: Setting encoder.encoders.2.cgmlp.csgu.norm.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,460 (abs_task:1370) INFO: Setting encoder.encoders.2.cgmlp.csgu.norm.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,460 (abs_task:1370) INFO: Setting encoder.encoders.2.cgmlp.csgu.conv.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,460 (abs_task:1370) INFO: Setting encoder.encoders.2.cgmlp.csgu.conv.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,460 (abs_task:1370) INFO: Setting encoder.encoders.2.cgmlp.channel_proj2.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,460 (abs_task:1370) INFO: Setting encoder.encoders.2.cgmlp.channel_proj2.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,460 (abs_task:1370) INFO: Setting encoder.encoders.2.feed_forward.w_1.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,460 (abs_task:1370) INFO: Setting encoder.encoders.2.feed_forward.w_1.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,460 (abs_task:1370) INFO: Setting encoder.encoders.2.feed_forward.w_2.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,460 (abs_task:1370) INFO: Setting encoder.encoders.2.feed_forward.w_2.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,460 (abs_task:1370) INFO: Setting encoder.encoders.2.feed_forward_macaron.w_1.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,460 (abs_task:1370) INFO: Setting encoder.encoders.2.feed_forward_macaron.w_1.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,460 (abs_task:1370) INFO: Setting encoder.encoders.2.feed_forward_macaron.w_2.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,460 (abs_task:1370) INFO: Setting encoder.encoders.2.feed_forward_macaron.w_2.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,460 (abs_task:1370) INFO: Setting encoder.encoders.2.norm_ff.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,460 (abs_task:1370) INFO: Setting encoder.encoders.2.norm_ff.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,460 (abs_task:1370) INFO: Setting encoder.encoders.2.norm_ff_macaron.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,460 (abs_task:1370) INFO: Setting encoder.encoders.2.norm_ff_macaron.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,460 (abs_task:1370) INFO: Setting encoder.encoders.2.norm_mha.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,460 (abs_task:1370) INFO: Setting encoder.encoders.2.norm_mha.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,460 (abs_task:1370) INFO: Setting encoder.encoders.2.norm_mlp.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,460 (abs_task:1370) INFO: Setting encoder.encoders.2.norm_mlp.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,460 (abs_task:1370) INFO: Setting encoder.encoders.2.norm_final.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,460 (abs_task:1370) INFO: Setting encoder.encoders.2.norm_final.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,460 (abs_task:1370) INFO: Setting encoder.encoders.2.depthwise_conv_fusion.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,460 (abs_task:1370) INFO: Setting encoder.encoders.2.depthwise_conv_fusion.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,460 (abs_task:1370) INFO: Setting encoder.encoders.2.merge_proj.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,460 (abs_task:1370) INFO: Setting encoder.encoders.2.merge_proj.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,460 (abs_task:1370) INFO: Setting encoder.encoders.3.attn.linear_q.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,460 (abs_task:1370) INFO: Setting encoder.encoders.3.attn.linear_q.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,460 (abs_task:1370) INFO: Setting encoder.encoders.3.attn.linear_k.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,460 (abs_task:1370) INFO: Setting encoder.encoders.3.attn.linear_k.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,460 (abs_task:1370) INFO: Setting encoder.encoders.3.attn.linear_v.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,460 (abs_task:1370) INFO: Setting encoder.encoders.3.attn.linear_v.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,460 (abs_task:1370) INFO: Setting encoder.encoders.3.attn.linear_out.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,460 (abs_task:1370) INFO: Setting encoder.encoders.3.attn.linear_out.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,460 (abs_task:1370) INFO: Setting encoder.encoders.3.cgmlp.channel_proj1.0.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,460 (abs_task:1370) INFO: Setting encoder.encoders.3.cgmlp.channel_proj1.0.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,460 (abs_task:1370) INFO: Setting encoder.encoders.3.cgmlp.csgu.norm.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,460 (abs_task:1370) INFO: Setting encoder.encoders.3.cgmlp.csgu.norm.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,460 (abs_task:1370) INFO: Setting encoder.encoders.3.cgmlp.csgu.conv.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,460 (abs_task:1370) INFO: Setting encoder.encoders.3.cgmlp.csgu.conv.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,460 (abs_task:1370) INFO: Setting encoder.encoders.3.cgmlp.channel_proj2.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,460 (abs_task:1370) INFO: Setting encoder.encoders.3.cgmlp.channel_proj2.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,460 (abs_task:1370) INFO: Setting encoder.encoders.3.feed_forward.w_1.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,460 (abs_task:1370) INFO: Setting encoder.encoders.3.feed_forward.w_1.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,460 (abs_task:1370) INFO: Setting encoder.encoders.3.feed_forward.w_2.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,460 (abs_task:1370) INFO: Setting encoder.encoders.3.feed_forward.w_2.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,460 (abs_task:1370) INFO: Setting encoder.encoders.3.feed_forward_macaron.w_1.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,460 (abs_task:1370) INFO: Setting encoder.encoders.3.feed_forward_macaron.w_1.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,461 (abs_task:1370) INFO: Setting encoder.encoders.3.feed_forward_macaron.w_2.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,461 (abs_task:1370) INFO: Setting encoder.encoders.3.feed_forward_macaron.w_2.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,461 (abs_task:1370) INFO: Setting encoder.encoders.3.norm_ff.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,461 (abs_task:1370) INFO: Setting encoder.encoders.3.norm_ff.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,461 (abs_task:1370) INFO: Setting encoder.encoders.3.norm_ff_macaron.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,461 (abs_task:1370) INFO: Setting encoder.encoders.3.norm_ff_macaron.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,461 (abs_task:1370) INFO: Setting encoder.encoders.3.norm_mha.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,461 (abs_task:1370) INFO: Setting encoder.encoders.3.norm_mha.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,461 (abs_task:1370) INFO: Setting encoder.encoders.3.norm_mlp.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,461 (abs_task:1370) INFO: Setting encoder.encoders.3.norm_mlp.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,461 (abs_task:1370) INFO: Setting encoder.encoders.3.norm_final.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,461 (abs_task:1370) INFO: Setting encoder.encoders.3.norm_final.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,461 (abs_task:1370) INFO: Setting encoder.encoders.3.depthwise_conv_fusion.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,461 (abs_task:1370) INFO: Setting encoder.encoders.3.depthwise_conv_fusion.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,461 (abs_task:1370) INFO: Setting encoder.encoders.3.merge_proj.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,461 (abs_task:1370) INFO: Setting encoder.encoders.3.merge_proj.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,461 (abs_task:1370) INFO: Setting encoder.encoders.4.attn.linear_q.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,461 (abs_task:1370) INFO: Setting encoder.encoders.4.attn.linear_q.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,461 (abs_task:1370) INFO: Setting encoder.encoders.4.attn.linear_k.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,461 (abs_task:1370) INFO: Setting encoder.encoders.4.attn.linear_k.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,461 (abs_task:1370) INFO: Setting encoder.encoders.4.attn.linear_v.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,461 (abs_task:1370) INFO: Setting encoder.encoders.4.attn.linear_v.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,461 (abs_task:1370) INFO: Setting encoder.encoders.4.attn.linear_out.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,461 (abs_task:1370) INFO: Setting encoder.encoders.4.attn.linear_out.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,461 (abs_task:1370) INFO: Setting encoder.encoders.4.cgmlp.channel_proj1.0.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,461 (abs_task:1370) INFO: Setting encoder.encoders.4.cgmlp.channel_proj1.0.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,461 (abs_task:1370) INFO: Setting encoder.encoders.4.cgmlp.csgu.norm.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,461 (abs_task:1370) INFO: Setting encoder.encoders.4.cgmlp.csgu.norm.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,461 (abs_task:1370) INFO: Setting encoder.encoders.4.cgmlp.csgu.conv.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,461 (abs_task:1370) INFO: Setting encoder.encoders.4.cgmlp.csgu.conv.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,461 (abs_task:1370) INFO: Setting encoder.encoders.4.cgmlp.channel_proj2.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,461 (abs_task:1370) INFO: Setting encoder.encoders.4.cgmlp.channel_proj2.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,461 (abs_task:1370) INFO: Setting encoder.encoders.4.feed_forward.w_1.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,461 (abs_task:1370) INFO: Setting encoder.encoders.4.feed_forward.w_1.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,461 (abs_task:1370) INFO: Setting encoder.encoders.4.feed_forward.w_2.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,461 (abs_task:1370) INFO: Setting encoder.encoders.4.feed_forward.w_2.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,461 (abs_task:1370) INFO: Setting encoder.encoders.4.feed_forward_macaron.w_1.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,461 (abs_task:1370) INFO: Setting encoder.encoders.4.feed_forward_macaron.w_1.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,461 (abs_task:1370) INFO: Setting encoder.encoders.4.feed_forward_macaron.w_2.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,461 (abs_task:1370) INFO: Setting encoder.encoders.4.feed_forward_macaron.w_2.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,461 (abs_task:1370) INFO: Setting encoder.encoders.4.norm_ff.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,461 (abs_task:1370) INFO: Setting encoder.encoders.4.norm_ff.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,461 (abs_task:1370) INFO: Setting encoder.encoders.4.norm_ff_macaron.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,461 (abs_task:1370) INFO: Setting encoder.encoders.4.norm_ff_macaron.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,461 (abs_task:1370) INFO: Setting encoder.encoders.4.norm_mha.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,461 (abs_task:1370) INFO: Setting encoder.encoders.4.norm_mha.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,461 (abs_task:1370) INFO: Setting encoder.encoders.4.norm_mlp.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,461 (abs_task:1370) INFO: Setting encoder.encoders.4.norm_mlp.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,461 (abs_task:1370) INFO: Setting encoder.encoders.4.norm_final.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,461 (abs_task:1370) INFO: Setting encoder.encoders.4.norm_final.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,461 (abs_task:1370) INFO: Setting encoder.encoders.4.depthwise_conv_fusion.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,461 (abs_task:1370) INFO: Setting encoder.encoders.4.depthwise_conv_fusion.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,461 (abs_task:1370) INFO: Setting encoder.encoders.4.merge_proj.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,461 (abs_task:1370) INFO: Setting encoder.encoders.4.merge_proj.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,461 (abs_task:1370) INFO: Setting encoder.encoders.5.attn.linear_q.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,461 (abs_task:1370) INFO: Setting encoder.encoders.5.attn.linear_q.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,461 (abs_task:1370) INFO: Setting encoder.encoders.5.attn.linear_k.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,461 (abs_task:1370) INFO: Setting encoder.encoders.5.attn.linear_k.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,461 (abs_task:1370) INFO: Setting encoder.encoders.5.attn.linear_v.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,461 (abs_task:1370) INFO: Setting encoder.encoders.5.attn.linear_v.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,462 (abs_task:1370) INFO: Setting encoder.encoders.5.attn.linear_out.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,462 (abs_task:1370) INFO: Setting encoder.encoders.5.attn.linear_out.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,462 (abs_task:1370) INFO: Setting encoder.encoders.5.cgmlp.channel_proj1.0.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,462 (abs_task:1370) INFO: Setting encoder.encoders.5.cgmlp.channel_proj1.0.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,462 (abs_task:1370) INFO: Setting encoder.encoders.5.cgmlp.csgu.norm.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,462 (abs_task:1370) INFO: Setting encoder.encoders.5.cgmlp.csgu.norm.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,462 (abs_task:1370) INFO: Setting encoder.encoders.5.cgmlp.csgu.conv.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,462 (abs_task:1370) INFO: Setting encoder.encoders.5.cgmlp.csgu.conv.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,462 (abs_task:1370) INFO: Setting encoder.encoders.5.cgmlp.channel_proj2.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,462 (abs_task:1370) INFO: Setting encoder.encoders.5.cgmlp.channel_proj2.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,462 (abs_task:1370) INFO: Setting encoder.encoders.5.feed_forward.w_1.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,462 (abs_task:1370) INFO: Setting encoder.encoders.5.feed_forward.w_1.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,462 (abs_task:1370) INFO: Setting encoder.encoders.5.feed_forward.w_2.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,462 (abs_task:1370) INFO: Setting encoder.encoders.5.feed_forward.w_2.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,462 (abs_task:1370) INFO: Setting encoder.encoders.5.feed_forward_macaron.w_1.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,462 (abs_task:1370) INFO: Setting encoder.encoders.5.feed_forward_macaron.w_1.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,462 (abs_task:1370) INFO: Setting encoder.encoders.5.feed_forward_macaron.w_2.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,462 (abs_task:1370) INFO: Setting encoder.encoders.5.feed_forward_macaron.w_2.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,462 (abs_task:1370) INFO: Setting encoder.encoders.5.norm_ff.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,462 (abs_task:1370) INFO: Setting encoder.encoders.5.norm_ff.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,462 (abs_task:1370) INFO: Setting encoder.encoders.5.norm_ff_macaron.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,462 (abs_task:1370) INFO: Setting encoder.encoders.5.norm_ff_macaron.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,462 (abs_task:1370) INFO: Setting encoder.encoders.5.norm_mha.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,462 (abs_task:1370) INFO: Setting encoder.encoders.5.norm_mha.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,462 (abs_task:1370) INFO: Setting encoder.encoders.5.norm_mlp.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,462 (abs_task:1370) INFO: Setting encoder.encoders.5.norm_mlp.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,462 (abs_task:1370) INFO: Setting encoder.encoders.5.norm_final.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,462 (abs_task:1370) INFO: Setting encoder.encoders.5.norm_final.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,462 (abs_task:1370) INFO: Setting encoder.encoders.5.depthwise_conv_fusion.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,462 (abs_task:1370) INFO: Setting encoder.encoders.5.depthwise_conv_fusion.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,462 (abs_task:1370) INFO: Setting encoder.encoders.5.merge_proj.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,462 (abs_task:1370) INFO: Setting encoder.encoders.5.merge_proj.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,462 (abs_task:1370) INFO: Setting encoder.encoders.6.attn.linear_q.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,462 (abs_task:1370) INFO: Setting encoder.encoders.6.attn.linear_q.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,462 (abs_task:1370) INFO: Setting encoder.encoders.6.attn.linear_k.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,462 (abs_task:1370) INFO: Setting encoder.encoders.6.attn.linear_k.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,462 (abs_task:1370) INFO: Setting encoder.encoders.6.attn.linear_v.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,462 (abs_task:1370) INFO: Setting encoder.encoders.6.attn.linear_v.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,462 (abs_task:1370) INFO: Setting encoder.encoders.6.attn.linear_out.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,462 (abs_task:1370) INFO: Setting encoder.encoders.6.attn.linear_out.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,462 (abs_task:1370) INFO: Setting encoder.encoders.6.cgmlp.channel_proj1.0.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,462 (abs_task:1370) INFO: Setting encoder.encoders.6.cgmlp.channel_proj1.0.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,462 (abs_task:1370) INFO: Setting encoder.encoders.6.cgmlp.csgu.norm.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,462 (abs_task:1370) INFO: Setting encoder.encoders.6.cgmlp.csgu.norm.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,462 (abs_task:1370) INFO: Setting encoder.encoders.6.cgmlp.csgu.conv.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,462 (abs_task:1370) INFO: Setting encoder.encoders.6.cgmlp.csgu.conv.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,462 (abs_task:1370) INFO: Setting encoder.encoders.6.cgmlp.channel_proj2.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,462 (abs_task:1370) INFO: Setting encoder.encoders.6.cgmlp.channel_proj2.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,462 (abs_task:1370) INFO: Setting encoder.encoders.6.feed_forward.w_1.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,462 (abs_task:1370) INFO: Setting encoder.encoders.6.feed_forward.w_1.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,462 (abs_task:1370) INFO: Setting encoder.encoders.6.feed_forward.w_2.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,462 (abs_task:1370) INFO: Setting encoder.encoders.6.feed_forward.w_2.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,462 (abs_task:1370) INFO: Setting encoder.encoders.6.feed_forward_macaron.w_1.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,462 (abs_task:1370) INFO: Setting encoder.encoders.6.feed_forward_macaron.w_1.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,462 (abs_task:1370) INFO: Setting encoder.encoders.6.feed_forward_macaron.w_2.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,462 (abs_task:1370) INFO: Setting encoder.encoders.6.feed_forward_macaron.w_2.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,462 (abs_task:1370) INFO: Setting encoder.encoders.6.norm_ff.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,462 (abs_task:1370) INFO: Setting encoder.encoders.6.norm_ff.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,462 (abs_task:1370) INFO: Setting encoder.encoders.6.norm_ff_macaron.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,462 (abs_task:1370) INFO: Setting encoder.encoders.6.norm_ff_macaron.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,462 (abs_task:1370) INFO: Setting encoder.encoders.6.norm_mha.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,462 (abs_task:1370) INFO: Setting encoder.encoders.6.norm_mha.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,463 (abs_task:1370) INFO: Setting encoder.encoders.6.norm_mlp.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,463 (abs_task:1370) INFO: Setting encoder.encoders.6.norm_mlp.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,463 (abs_task:1370) INFO: Setting encoder.encoders.6.norm_final.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,463 (abs_task:1370) INFO: Setting encoder.encoders.6.norm_final.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,463 (abs_task:1370) INFO: Setting encoder.encoders.6.depthwise_conv_fusion.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,463 (abs_task:1370) INFO: Setting encoder.encoders.6.depthwise_conv_fusion.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,463 (abs_task:1370) INFO: Setting encoder.encoders.6.merge_proj.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,463 (abs_task:1370) INFO: Setting encoder.encoders.6.merge_proj.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,463 (abs_task:1370) INFO: Setting encoder.encoders.7.attn.linear_q.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,463 (abs_task:1370) INFO: Setting encoder.encoders.7.attn.linear_q.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,463 (abs_task:1370) INFO: Setting encoder.encoders.7.attn.linear_k.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,463 (abs_task:1370) INFO: Setting encoder.encoders.7.attn.linear_k.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,463 (abs_task:1370) INFO: Setting encoder.encoders.7.attn.linear_v.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,463 (abs_task:1370) INFO: Setting encoder.encoders.7.attn.linear_v.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,463 (abs_task:1370) INFO: Setting encoder.encoders.7.attn.linear_out.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,463 (abs_task:1370) INFO: Setting encoder.encoders.7.attn.linear_out.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,463 (abs_task:1370) INFO: Setting encoder.encoders.7.cgmlp.channel_proj1.0.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,463 (abs_task:1370) INFO: Setting encoder.encoders.7.cgmlp.channel_proj1.0.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,463 (abs_task:1370) INFO: Setting encoder.encoders.7.cgmlp.csgu.norm.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,463 (abs_task:1370) INFO: Setting encoder.encoders.7.cgmlp.csgu.norm.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,463 (abs_task:1370) INFO: Setting encoder.encoders.7.cgmlp.csgu.conv.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,463 (abs_task:1370) INFO: Setting encoder.encoders.7.cgmlp.csgu.conv.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,463 (abs_task:1370) INFO: Setting encoder.encoders.7.cgmlp.channel_proj2.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,463 (abs_task:1370) INFO: Setting encoder.encoders.7.cgmlp.channel_proj2.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,463 (abs_task:1370) INFO: Setting encoder.encoders.7.feed_forward.w_1.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,463 (abs_task:1370) INFO: Setting encoder.encoders.7.feed_forward.w_1.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,463 (abs_task:1370) INFO: Setting encoder.encoders.7.feed_forward.w_2.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,463 (abs_task:1370) INFO: Setting encoder.encoders.7.feed_forward.w_2.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,463 (abs_task:1370) INFO: Setting encoder.encoders.7.feed_forward_macaron.w_1.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,463 (abs_task:1370) INFO: Setting encoder.encoders.7.feed_forward_macaron.w_1.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,463 (abs_task:1370) INFO: Setting encoder.encoders.7.feed_forward_macaron.w_2.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,463 (abs_task:1370) INFO: Setting encoder.encoders.7.feed_forward_macaron.w_2.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,463 (abs_task:1370) INFO: Setting encoder.encoders.7.norm_ff.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,463 (abs_task:1370) INFO: Setting encoder.encoders.7.norm_ff.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,463 (abs_task:1370) INFO: Setting encoder.encoders.7.norm_ff_macaron.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,463 (abs_task:1370) INFO: Setting encoder.encoders.7.norm_ff_macaron.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,463 (abs_task:1370) INFO: Setting encoder.encoders.7.norm_mha.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,463 (abs_task:1370) INFO: Setting encoder.encoders.7.norm_mha.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,463 (abs_task:1370) INFO: Setting encoder.encoders.7.norm_mlp.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,463 (abs_task:1370) INFO: Setting encoder.encoders.7.norm_mlp.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,463 (abs_task:1370) INFO: Setting encoder.encoders.7.norm_final.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,463 (abs_task:1370) INFO: Setting encoder.encoders.7.norm_final.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,463 (abs_task:1370) INFO: Setting encoder.encoders.7.depthwise_conv_fusion.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,463 (abs_task:1370) INFO: Setting encoder.encoders.7.depthwise_conv_fusion.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,463 (abs_task:1370) INFO: Setting encoder.encoders.7.merge_proj.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,463 (abs_task:1370) INFO: Setting encoder.encoders.7.merge_proj.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,463 (abs_task:1370) INFO: Setting encoder.encoders.8.attn.linear_q.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,463 (abs_task:1370) INFO: Setting encoder.encoders.8.attn.linear_q.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,463 (abs_task:1370) INFO: Setting encoder.encoders.8.attn.linear_k.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,463 (abs_task:1370) INFO: Setting encoder.encoders.8.attn.linear_k.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,463 (abs_task:1370) INFO: Setting encoder.encoders.8.attn.linear_v.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,463 (abs_task:1370) INFO: Setting encoder.encoders.8.attn.linear_v.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,463 (abs_task:1370) INFO: Setting encoder.encoders.8.attn.linear_out.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,463 (abs_task:1370) INFO: Setting encoder.encoders.8.attn.linear_out.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,463 (abs_task:1370) INFO: Setting encoder.encoders.8.cgmlp.channel_proj1.0.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,463 (abs_task:1370) INFO: Setting encoder.encoders.8.cgmlp.channel_proj1.0.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,463 (abs_task:1370) INFO: Setting encoder.encoders.8.cgmlp.csgu.norm.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,463 (abs_task:1370) INFO: Setting encoder.encoders.8.cgmlp.csgu.norm.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,463 (abs_task:1370) INFO: Setting encoder.encoders.8.cgmlp.csgu.conv.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,463 (abs_task:1370) INFO: Setting encoder.encoders.8.cgmlp.csgu.conv.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,463 (abs_task:1370) INFO: Setting encoder.encoders.8.cgmlp.channel_proj2.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,463 (abs_task:1370) INFO: Setting encoder.encoders.8.cgmlp.channel_proj2.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,464 (abs_task:1370) INFO: Setting encoder.encoders.8.feed_forward.w_1.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,464 (abs_task:1370) INFO: Setting encoder.encoders.8.feed_forward.w_1.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,464 (abs_task:1370) INFO: Setting encoder.encoders.8.feed_forward.w_2.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,464 (abs_task:1370) INFO: Setting encoder.encoders.8.feed_forward.w_2.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,464 (abs_task:1370) INFO: Setting encoder.encoders.8.feed_forward_macaron.w_1.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,464 (abs_task:1370) INFO: Setting encoder.encoders.8.feed_forward_macaron.w_1.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,464 (abs_task:1370) INFO: Setting encoder.encoders.8.feed_forward_macaron.w_2.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,464 (abs_task:1370) INFO: Setting encoder.encoders.8.feed_forward_macaron.w_2.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,464 (abs_task:1370) INFO: Setting encoder.encoders.8.norm_ff.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,464 (abs_task:1370) INFO: Setting encoder.encoders.8.norm_ff.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,464 (abs_task:1370) INFO: Setting encoder.encoders.8.norm_ff_macaron.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,464 (abs_task:1370) INFO: Setting encoder.encoders.8.norm_ff_macaron.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,464 (abs_task:1370) INFO: Setting encoder.encoders.8.norm_mha.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,464 (abs_task:1370) INFO: Setting encoder.encoders.8.norm_mha.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,464 (abs_task:1370) INFO: Setting encoder.encoders.8.norm_mlp.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,464 (abs_task:1370) INFO: Setting encoder.encoders.8.norm_mlp.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,464 (abs_task:1370) INFO: Setting encoder.encoders.8.norm_final.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,464 (abs_task:1370) INFO: Setting encoder.encoders.8.norm_final.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,464 (abs_task:1370) INFO: Setting encoder.encoders.8.depthwise_conv_fusion.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,464 (abs_task:1370) INFO: Setting encoder.encoders.8.depthwise_conv_fusion.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,464 (abs_task:1370) INFO: Setting encoder.encoders.8.merge_proj.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,464 (abs_task:1370) INFO: Setting encoder.encoders.8.merge_proj.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,464 (abs_task:1370) INFO: Setting encoder.encoders.9.attn.linear_q.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,464 (abs_task:1370) INFO: Setting encoder.encoders.9.attn.linear_q.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,464 (abs_task:1370) INFO: Setting encoder.encoders.9.attn.linear_k.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,464 (abs_task:1370) INFO: Setting encoder.encoders.9.attn.linear_k.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,464 (abs_task:1370) INFO: Setting encoder.encoders.9.attn.linear_v.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,464 (abs_task:1370) INFO: Setting encoder.encoders.9.attn.linear_v.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,464 (abs_task:1370) INFO: Setting encoder.encoders.9.attn.linear_out.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,464 (abs_task:1370) INFO: Setting encoder.encoders.9.attn.linear_out.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,464 (abs_task:1370) INFO: Setting encoder.encoders.9.cgmlp.channel_proj1.0.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,464 (abs_task:1370) INFO: Setting encoder.encoders.9.cgmlp.channel_proj1.0.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,464 (abs_task:1370) INFO: Setting encoder.encoders.9.cgmlp.csgu.norm.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,464 (abs_task:1370) INFO: Setting encoder.encoders.9.cgmlp.csgu.norm.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,464 (abs_task:1370) INFO: Setting encoder.encoders.9.cgmlp.csgu.conv.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,464 (abs_task:1370) INFO: Setting encoder.encoders.9.cgmlp.csgu.conv.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,464 (abs_task:1370) INFO: Setting encoder.encoders.9.cgmlp.channel_proj2.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,464 (abs_task:1370) INFO: Setting encoder.encoders.9.cgmlp.channel_proj2.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,464 (abs_task:1370) INFO: Setting encoder.encoders.9.feed_forward.w_1.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,464 (abs_task:1370) INFO: Setting encoder.encoders.9.feed_forward.w_1.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,464 (abs_task:1370) INFO: Setting encoder.encoders.9.feed_forward.w_2.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,464 (abs_task:1370) INFO: Setting encoder.encoders.9.feed_forward.w_2.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,464 (abs_task:1370) INFO: Setting encoder.encoders.9.feed_forward_macaron.w_1.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,464 (abs_task:1370) INFO: Setting encoder.encoders.9.feed_forward_macaron.w_1.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,464 (abs_task:1370) INFO: Setting encoder.encoders.9.feed_forward_macaron.w_2.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,464 (abs_task:1370) INFO: Setting encoder.encoders.9.feed_forward_macaron.w_2.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,464 (abs_task:1370) INFO: Setting encoder.encoders.9.norm_ff.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,464 (abs_task:1370) INFO: Setting encoder.encoders.9.norm_ff.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,464 (abs_task:1370) INFO: Setting encoder.encoders.9.norm_ff_macaron.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,464 (abs_task:1370) INFO: Setting encoder.encoders.9.norm_ff_macaron.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,464 (abs_task:1370) INFO: Setting encoder.encoders.9.norm_mha.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,464 (abs_task:1370) INFO: Setting encoder.encoders.9.norm_mha.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,464 (abs_task:1370) INFO: Setting encoder.encoders.9.norm_mlp.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,464 (abs_task:1370) INFO: Setting encoder.encoders.9.norm_mlp.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,464 (abs_task:1370) INFO: Setting encoder.encoders.9.norm_final.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,464 (abs_task:1370) INFO: Setting encoder.encoders.9.norm_final.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,464 (abs_task:1370) INFO: Setting encoder.encoders.9.depthwise_conv_fusion.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,464 (abs_task:1370) INFO: Setting encoder.encoders.9.depthwise_conv_fusion.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,464 (abs_task:1370) INFO: Setting encoder.encoders.9.merge_proj.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,464 (abs_task:1370) INFO: Setting encoder.encoders.9.merge_proj.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,464 (abs_task:1370) INFO: Setting encoder.encoders.10.attn.linear_q.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,464 (abs_task:1370) INFO: Setting encoder.encoders.10.attn.linear_q.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,464 (abs_task:1370) INFO: Setting encoder.encoders.10.attn.linear_k.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,465 (abs_task:1370) INFO: Setting encoder.encoders.10.attn.linear_k.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,465 (abs_task:1370) INFO: Setting encoder.encoders.10.attn.linear_v.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,465 (abs_task:1370) INFO: Setting encoder.encoders.10.attn.linear_v.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,465 (abs_task:1370) INFO: Setting encoder.encoders.10.attn.linear_out.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,465 (abs_task:1370) INFO: Setting encoder.encoders.10.attn.linear_out.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,465 (abs_task:1370) INFO: Setting encoder.encoders.10.cgmlp.channel_proj1.0.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,465 (abs_task:1370) INFO: Setting encoder.encoders.10.cgmlp.channel_proj1.0.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,465 (abs_task:1370) INFO: Setting encoder.encoders.10.cgmlp.csgu.norm.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,465 (abs_task:1370) INFO: Setting encoder.encoders.10.cgmlp.csgu.norm.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,465 (abs_task:1370) INFO: Setting encoder.encoders.10.cgmlp.csgu.conv.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,465 (abs_task:1370) INFO: Setting encoder.encoders.10.cgmlp.csgu.conv.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,465 (abs_task:1370) INFO: Setting encoder.encoders.10.cgmlp.channel_proj2.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,465 (abs_task:1370) INFO: Setting encoder.encoders.10.cgmlp.channel_proj2.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,465 (abs_task:1370) INFO: Setting encoder.encoders.10.feed_forward.w_1.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,465 (abs_task:1370) INFO: Setting encoder.encoders.10.feed_forward.w_1.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,465 (abs_task:1370) INFO: Setting encoder.encoders.10.feed_forward.w_2.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,465 (abs_task:1370) INFO: Setting encoder.encoders.10.feed_forward.w_2.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,465 (abs_task:1370) INFO: Setting encoder.encoders.10.feed_forward_macaron.w_1.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,465 (abs_task:1370) INFO: Setting encoder.encoders.10.feed_forward_macaron.w_1.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,465 (abs_task:1370) INFO: Setting encoder.encoders.10.feed_forward_macaron.w_2.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,465 (abs_task:1370) INFO: Setting encoder.encoders.10.feed_forward_macaron.w_2.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,465 (abs_task:1370) INFO: Setting encoder.encoders.10.norm_ff.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,465 (abs_task:1370) INFO: Setting encoder.encoders.10.norm_ff.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,465 (abs_task:1370) INFO: Setting encoder.encoders.10.norm_ff_macaron.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,465 (abs_task:1370) INFO: Setting encoder.encoders.10.norm_ff_macaron.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,465 (abs_task:1370) INFO: Setting encoder.encoders.10.norm_mha.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,465 (abs_task:1370) INFO: Setting encoder.encoders.10.norm_mha.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,465 (abs_task:1370) INFO: Setting encoder.encoders.10.norm_mlp.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,465 (abs_task:1370) INFO: Setting encoder.encoders.10.norm_mlp.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,465 (abs_task:1370) INFO: Setting encoder.encoders.10.norm_final.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,465 (abs_task:1370) INFO: Setting encoder.encoders.10.norm_final.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,465 (abs_task:1370) INFO: Setting encoder.encoders.10.depthwise_conv_fusion.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,465 (abs_task:1370) INFO: Setting encoder.encoders.10.depthwise_conv_fusion.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,465 (abs_task:1370) INFO: Setting encoder.encoders.10.merge_proj.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,465 (abs_task:1370) INFO: Setting encoder.encoders.10.merge_proj.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,465 (abs_task:1370) INFO: Setting encoder.encoders.11.attn.linear_q.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,465 (abs_task:1370) INFO: Setting encoder.encoders.11.attn.linear_q.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,465 (abs_task:1370) INFO: Setting encoder.encoders.11.attn.linear_k.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,465 (abs_task:1370) INFO: Setting encoder.encoders.11.attn.linear_k.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,465 (abs_task:1370) INFO: Setting encoder.encoders.11.attn.linear_v.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,465 (abs_task:1370) INFO: Setting encoder.encoders.11.attn.linear_v.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,465 (abs_task:1370) INFO: Setting encoder.encoders.11.attn.linear_out.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,465 (abs_task:1370) INFO: Setting encoder.encoders.11.attn.linear_out.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,465 (abs_task:1370) INFO: Setting encoder.encoders.11.cgmlp.channel_proj1.0.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,465 (abs_task:1370) INFO: Setting encoder.encoders.11.cgmlp.channel_proj1.0.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,465 (abs_task:1370) INFO: Setting encoder.encoders.11.cgmlp.csgu.norm.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,465 (abs_task:1370) INFO: Setting encoder.encoders.11.cgmlp.csgu.norm.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,465 (abs_task:1370) INFO: Setting encoder.encoders.11.cgmlp.csgu.conv.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,465 (abs_task:1370) INFO: Setting encoder.encoders.11.cgmlp.csgu.conv.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,465 (abs_task:1370) INFO: Setting encoder.encoders.11.cgmlp.channel_proj2.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,465 (abs_task:1370) INFO: Setting encoder.encoders.11.cgmlp.channel_proj2.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,465 (abs_task:1370) INFO: Setting encoder.encoders.11.feed_forward.w_1.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,465 (abs_task:1370) INFO: Setting encoder.encoders.11.feed_forward.w_1.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,465 (abs_task:1370) INFO: Setting encoder.encoders.11.feed_forward.w_2.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,465 (abs_task:1370) INFO: Setting encoder.encoders.11.feed_forward.w_2.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,465 (abs_task:1370) INFO: Setting encoder.encoders.11.feed_forward_macaron.w_1.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,465 (abs_task:1370) INFO: Setting encoder.encoders.11.feed_forward_macaron.w_1.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,465 (abs_task:1370) INFO: Setting encoder.encoders.11.feed_forward_macaron.w_2.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,465 (abs_task:1370) INFO: Setting encoder.encoders.11.feed_forward_macaron.w_2.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,465 (abs_task:1370) INFO: Setting encoder.encoders.11.norm_ff.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,465 (abs_task:1370) INFO: Setting encoder.encoders.11.norm_ff.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,465 (abs_task:1370) INFO: Setting encoder.encoders.11.norm_ff_macaron.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,465 (abs_task:1370) INFO: Setting encoder.encoders.11.norm_ff_macaron.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,466 (abs_task:1370) INFO: Setting encoder.encoders.11.norm_mha.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,466 (abs_task:1370) INFO: Setting encoder.encoders.11.norm_mha.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,466 (abs_task:1370) INFO: Setting encoder.encoders.11.norm_mlp.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,466 (abs_task:1370) INFO: Setting encoder.encoders.11.norm_mlp.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,466 (abs_task:1370) INFO: Setting encoder.encoders.11.norm_final.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,466 (abs_task:1370) INFO: Setting encoder.encoders.11.norm_final.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,466 (abs_task:1370) INFO: Setting encoder.encoders.11.depthwise_conv_fusion.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,466 (abs_task:1370) INFO: Setting encoder.encoders.11.depthwise_conv_fusion.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,466 (abs_task:1370) INFO: Setting encoder.encoders.11.merge_proj.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,466 (abs_task:1370) INFO: Setting encoder.encoders.11.merge_proj.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,466 (abs_task:1370) INFO: Setting encoder.encoders.12.attn.linear_q.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,466 (abs_task:1370) INFO: Setting encoder.encoders.12.attn.linear_q.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,466 (abs_task:1370) INFO: Setting encoder.encoders.12.attn.linear_k.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,466 (abs_task:1370) INFO: Setting encoder.encoders.12.attn.linear_k.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,466 (abs_task:1370) INFO: Setting encoder.encoders.12.attn.linear_v.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,466 (abs_task:1370) INFO: Setting encoder.encoders.12.attn.linear_v.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,466 (abs_task:1370) INFO: Setting encoder.encoders.12.attn.linear_out.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,466 (abs_task:1370) INFO: Setting encoder.encoders.12.attn.linear_out.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,466 (abs_task:1370) INFO: Setting encoder.encoders.12.cgmlp.channel_proj1.0.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,466 (abs_task:1370) INFO: Setting encoder.encoders.12.cgmlp.channel_proj1.0.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,466 (abs_task:1370) INFO: Setting encoder.encoders.12.cgmlp.csgu.norm.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,466 (abs_task:1370) INFO: Setting encoder.encoders.12.cgmlp.csgu.norm.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,466 (abs_task:1370) INFO: Setting encoder.encoders.12.cgmlp.csgu.conv.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,466 (abs_task:1370) INFO: Setting encoder.encoders.12.cgmlp.csgu.conv.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,466 (abs_task:1370) INFO: Setting encoder.encoders.12.cgmlp.channel_proj2.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,466 (abs_task:1370) INFO: Setting encoder.encoders.12.cgmlp.channel_proj2.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,466 (abs_task:1370) INFO: Setting encoder.encoders.12.feed_forward.w_1.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,466 (abs_task:1370) INFO: Setting encoder.encoders.12.feed_forward.w_1.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,466 (abs_task:1370) INFO: Setting encoder.encoders.12.feed_forward.w_2.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,466 (abs_task:1370) INFO: Setting encoder.encoders.12.feed_forward.w_2.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,466 (abs_task:1370) INFO: Setting encoder.encoders.12.feed_forward_macaron.w_1.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,466 (abs_task:1370) INFO: Setting encoder.encoders.12.feed_forward_macaron.w_1.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,466 (abs_task:1370) INFO: Setting encoder.encoders.12.feed_forward_macaron.w_2.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,466 (abs_task:1370) INFO: Setting encoder.encoders.12.feed_forward_macaron.w_2.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,466 (abs_task:1370) INFO: Setting encoder.encoders.12.norm_ff.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,466 (abs_task:1370) INFO: Setting encoder.encoders.12.norm_ff.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,466 (abs_task:1370) INFO: Setting encoder.encoders.12.norm_ff_macaron.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,466 (abs_task:1370) INFO: Setting encoder.encoders.12.norm_ff_macaron.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,466 (abs_task:1370) INFO: Setting encoder.encoders.12.norm_mha.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,466 (abs_task:1370) INFO: Setting encoder.encoders.12.norm_mha.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,466 (abs_task:1370) INFO: Setting encoder.encoders.12.norm_mlp.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,466 (abs_task:1370) INFO: Setting encoder.encoders.12.norm_mlp.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,466 (abs_task:1370) INFO: Setting encoder.encoders.12.norm_final.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,466 (abs_task:1370) INFO: Setting encoder.encoders.12.norm_final.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,466 (abs_task:1370) INFO: Setting encoder.encoders.12.depthwise_conv_fusion.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,466 (abs_task:1370) INFO: Setting encoder.encoders.12.depthwise_conv_fusion.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,466 (abs_task:1370) INFO: Setting encoder.encoders.12.merge_proj.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,466 (abs_task:1370) INFO: Setting encoder.encoders.12.merge_proj.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,466 (abs_task:1370) INFO: Setting encoder.encoders.13.attn.linear_q.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,466 (abs_task:1370) INFO: Setting encoder.encoders.13.attn.linear_q.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,466 (abs_task:1370) INFO: Setting encoder.encoders.13.attn.linear_k.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,466 (abs_task:1370) INFO: Setting encoder.encoders.13.attn.linear_k.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,466 (abs_task:1370) INFO: Setting encoder.encoders.13.attn.linear_v.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,466 (abs_task:1370) INFO: Setting encoder.encoders.13.attn.linear_v.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,466 (abs_task:1370) INFO: Setting encoder.encoders.13.attn.linear_out.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,466 (abs_task:1370) INFO: Setting encoder.encoders.13.attn.linear_out.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,466 (abs_task:1370) INFO: Setting encoder.encoders.13.cgmlp.channel_proj1.0.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,466 (abs_task:1370) INFO: Setting encoder.encoders.13.cgmlp.channel_proj1.0.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,466 (abs_task:1370) INFO: Setting encoder.encoders.13.cgmlp.csgu.norm.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,466 (abs_task:1370) INFO: Setting encoder.encoders.13.cgmlp.csgu.norm.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,466 (abs_task:1370) INFO: Setting encoder.encoders.13.cgmlp.csgu.conv.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,466 (abs_task:1370) INFO: Setting encoder.encoders.13.cgmlp.csgu.conv.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,467 (abs_task:1370) INFO: Setting encoder.encoders.13.cgmlp.channel_proj2.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,467 (abs_task:1370) INFO: Setting encoder.encoders.13.cgmlp.channel_proj2.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,467 (abs_task:1370) INFO: Setting encoder.encoders.13.feed_forward.w_1.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,467 (abs_task:1370) INFO: Setting encoder.encoders.13.feed_forward.w_1.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,467 (abs_task:1370) INFO: Setting encoder.encoders.13.feed_forward.w_2.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,467 (abs_task:1370) INFO: Setting encoder.encoders.13.feed_forward.w_2.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,467 (abs_task:1370) INFO: Setting encoder.encoders.13.feed_forward_macaron.w_1.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,467 (abs_task:1370) INFO: Setting encoder.encoders.13.feed_forward_macaron.w_1.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,467 (abs_task:1370) INFO: Setting encoder.encoders.13.feed_forward_macaron.w_2.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,467 (abs_task:1370) INFO: Setting encoder.encoders.13.feed_forward_macaron.w_2.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,467 (abs_task:1370) INFO: Setting encoder.encoders.13.norm_ff.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,467 (abs_task:1370) INFO: Setting encoder.encoders.13.norm_ff.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,467 (abs_task:1370) INFO: Setting encoder.encoders.13.norm_ff_macaron.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,467 (abs_task:1370) INFO: Setting encoder.encoders.13.norm_ff_macaron.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,467 (abs_task:1370) INFO: Setting encoder.encoders.13.norm_mha.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,467 (abs_task:1370) INFO: Setting encoder.encoders.13.norm_mha.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,467 (abs_task:1370) INFO: Setting encoder.encoders.13.norm_mlp.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,467 (abs_task:1370) INFO: Setting encoder.encoders.13.norm_mlp.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,467 (abs_task:1370) INFO: Setting encoder.encoders.13.norm_final.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,467 (abs_task:1370) INFO: Setting encoder.encoders.13.norm_final.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,467 (abs_task:1370) INFO: Setting encoder.encoders.13.depthwise_conv_fusion.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,467 (abs_task:1370) INFO: Setting encoder.encoders.13.depthwise_conv_fusion.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,467 (abs_task:1370) INFO: Setting encoder.encoders.13.merge_proj.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,467 (abs_task:1370) INFO: Setting encoder.encoders.13.merge_proj.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,467 (abs_task:1370) INFO: Setting encoder.encoders.14.attn.linear_q.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,467 (abs_task:1370) INFO: Setting encoder.encoders.14.attn.linear_q.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,467 (abs_task:1370) INFO: Setting encoder.encoders.14.attn.linear_k.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,467 (abs_task:1370) INFO: Setting encoder.encoders.14.attn.linear_k.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,467 (abs_task:1370) INFO: Setting encoder.encoders.14.attn.linear_v.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,467 (abs_task:1370) INFO: Setting encoder.encoders.14.attn.linear_v.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,467 (abs_task:1370) INFO: Setting encoder.encoders.14.attn.linear_out.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,467 (abs_task:1370) INFO: Setting encoder.encoders.14.attn.linear_out.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,467 (abs_task:1370) INFO: Setting encoder.encoders.14.cgmlp.channel_proj1.0.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,467 (abs_task:1370) INFO: Setting encoder.encoders.14.cgmlp.channel_proj1.0.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,467 (abs_task:1370) INFO: Setting encoder.encoders.14.cgmlp.csgu.norm.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,467 (abs_task:1370) INFO: Setting encoder.encoders.14.cgmlp.csgu.norm.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,467 (abs_task:1370) INFO: Setting encoder.encoders.14.cgmlp.csgu.conv.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,467 (abs_task:1370) INFO: Setting encoder.encoders.14.cgmlp.csgu.conv.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,467 (abs_task:1370) INFO: Setting encoder.encoders.14.cgmlp.channel_proj2.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,467 (abs_task:1370) INFO: Setting encoder.encoders.14.cgmlp.channel_proj2.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,467 (abs_task:1370) INFO: Setting encoder.encoders.14.feed_forward.w_1.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,467 (abs_task:1370) INFO: Setting encoder.encoders.14.feed_forward.w_1.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,467 (abs_task:1370) INFO: Setting encoder.encoders.14.feed_forward.w_2.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,467 (abs_task:1370) INFO: Setting encoder.encoders.14.feed_forward.w_2.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,467 (abs_task:1370) INFO: Setting encoder.encoders.14.feed_forward_macaron.w_1.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,467 (abs_task:1370) INFO: Setting encoder.encoders.14.feed_forward_macaron.w_1.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,467 (abs_task:1370) INFO: Setting encoder.encoders.14.feed_forward_macaron.w_2.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,467 (abs_task:1370) INFO: Setting encoder.encoders.14.feed_forward_macaron.w_2.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,467 (abs_task:1370) INFO: Setting encoder.encoders.14.norm_ff.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,467 (abs_task:1370) INFO: Setting encoder.encoders.14.norm_ff.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,467 (abs_task:1370) INFO: Setting encoder.encoders.14.norm_ff_macaron.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,467 (abs_task:1370) INFO: Setting encoder.encoders.14.norm_ff_macaron.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,467 (abs_task:1370) INFO: Setting encoder.encoders.14.norm_mha.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,467 (abs_task:1370) INFO: Setting encoder.encoders.14.norm_mha.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,467 (abs_task:1370) INFO: Setting encoder.encoders.14.norm_mlp.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,467 (abs_task:1370) INFO: Setting encoder.encoders.14.norm_mlp.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,467 (abs_task:1370) INFO: Setting encoder.encoders.14.norm_final.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,467 (abs_task:1370) INFO: Setting encoder.encoders.14.norm_final.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,467 (abs_task:1370) INFO: Setting encoder.encoders.14.depthwise_conv_fusion.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,467 (abs_task:1370) INFO: Setting encoder.encoders.14.depthwise_conv_fusion.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,467 (abs_task:1370) INFO: Setting encoder.encoders.14.merge_proj.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,467 (abs_task:1370) INFO: Setting encoder.encoders.14.merge_proj.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,467 (abs_task:1370) INFO: Setting encoder.encoders.15.attn.linear_q.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,468 (abs_task:1370) INFO: Setting encoder.encoders.15.attn.linear_q.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,468 (abs_task:1370) INFO: Setting encoder.encoders.15.attn.linear_k.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,468 (abs_task:1370) INFO: Setting encoder.encoders.15.attn.linear_k.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,468 (abs_task:1370) INFO: Setting encoder.encoders.15.attn.linear_v.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,468 (abs_task:1370) INFO: Setting encoder.encoders.15.attn.linear_v.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,468 (abs_task:1370) INFO: Setting encoder.encoders.15.attn.linear_out.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,468 (abs_task:1370) INFO: Setting encoder.encoders.15.attn.linear_out.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,468 (abs_task:1370) INFO: Setting encoder.encoders.15.cgmlp.channel_proj1.0.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,468 (abs_task:1370) INFO: Setting encoder.encoders.15.cgmlp.channel_proj1.0.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,468 (abs_task:1370) INFO: Setting encoder.encoders.15.cgmlp.csgu.norm.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,468 (abs_task:1370) INFO: Setting encoder.encoders.15.cgmlp.csgu.norm.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,468 (abs_task:1370) INFO: Setting encoder.encoders.15.cgmlp.csgu.conv.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,468 (abs_task:1370) INFO: Setting encoder.encoders.15.cgmlp.csgu.conv.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,468 (abs_task:1370) INFO: Setting encoder.encoders.15.cgmlp.channel_proj2.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,468 (abs_task:1370) INFO: Setting encoder.encoders.15.cgmlp.channel_proj2.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,468 (abs_task:1370) INFO: Setting encoder.encoders.15.feed_forward.w_1.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,468 (abs_task:1370) INFO: Setting encoder.encoders.15.feed_forward.w_1.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,468 (abs_task:1370) INFO: Setting encoder.encoders.15.feed_forward.w_2.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,468 (abs_task:1370) INFO: Setting encoder.encoders.15.feed_forward.w_2.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,468 (abs_task:1370) INFO: Setting encoder.encoders.15.feed_forward_macaron.w_1.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,468 (abs_task:1370) INFO: Setting encoder.encoders.15.feed_forward_macaron.w_1.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,468 (abs_task:1370) INFO: Setting encoder.encoders.15.feed_forward_macaron.w_2.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,468 (abs_task:1370) INFO: Setting encoder.encoders.15.feed_forward_macaron.w_2.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,468 (abs_task:1370) INFO: Setting encoder.encoders.15.norm_ff.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,468 (abs_task:1370) INFO: Setting encoder.encoders.15.norm_ff.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,468 (abs_task:1370) INFO: Setting encoder.encoders.15.norm_ff_macaron.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,468 (abs_task:1370) INFO: Setting encoder.encoders.15.norm_ff_macaron.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,468 (abs_task:1370) INFO: Setting encoder.encoders.15.norm_mha.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,468 (abs_task:1370) INFO: Setting encoder.encoders.15.norm_mha.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,468 (abs_task:1370) INFO: Setting encoder.encoders.15.norm_mlp.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,468 (abs_task:1370) INFO: Setting encoder.encoders.15.norm_mlp.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,468 (abs_task:1370) INFO: Setting encoder.encoders.15.norm_final.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,468 (abs_task:1370) INFO: Setting encoder.encoders.15.norm_final.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,468 (abs_task:1370) INFO: Setting encoder.encoders.15.depthwise_conv_fusion.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,468 (abs_task:1370) INFO: Setting encoder.encoders.15.depthwise_conv_fusion.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,468 (abs_task:1370) INFO: Setting encoder.encoders.15.merge_proj.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,468 (abs_task:1370) INFO: Setting encoder.encoders.15.merge_proj.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,468 (abs_task:1370) INFO: Setting encoder.encoders.16.attn.linear_q.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,468 (abs_task:1370) INFO: Setting encoder.encoders.16.attn.linear_q.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,468 (abs_task:1370) INFO: Setting encoder.encoders.16.attn.linear_k.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,468 (abs_task:1370) INFO: Setting encoder.encoders.16.attn.linear_k.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,468 (abs_task:1370) INFO: Setting encoder.encoders.16.attn.linear_v.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,468 (abs_task:1370) INFO: Setting encoder.encoders.16.attn.linear_v.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,468 (abs_task:1370) INFO: Setting encoder.encoders.16.attn.linear_out.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,468 (abs_task:1370) INFO: Setting encoder.encoders.16.attn.linear_out.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,468 (abs_task:1370) INFO: Setting encoder.encoders.16.cgmlp.channel_proj1.0.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,468 (abs_task:1370) INFO: Setting encoder.encoders.16.cgmlp.channel_proj1.0.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,468 (abs_task:1370) INFO: Setting encoder.encoders.16.cgmlp.csgu.norm.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,468 (abs_task:1370) INFO: Setting encoder.encoders.16.cgmlp.csgu.norm.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,468 (abs_task:1370) INFO: Setting encoder.encoders.16.cgmlp.csgu.conv.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,468 (abs_task:1370) INFO: Setting encoder.encoders.16.cgmlp.csgu.conv.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,468 (abs_task:1370) INFO: Setting encoder.encoders.16.cgmlp.channel_proj2.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,468 (abs_task:1370) INFO: Setting encoder.encoders.16.cgmlp.channel_proj2.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,468 (abs_task:1370) INFO: Setting encoder.encoders.16.feed_forward.w_1.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,468 (abs_task:1370) INFO: Setting encoder.encoders.16.feed_forward.w_1.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,468 (abs_task:1370) INFO: Setting encoder.encoders.16.feed_forward.w_2.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,468 (abs_task:1370) INFO: Setting encoder.encoders.16.feed_forward.w_2.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,468 (abs_task:1370) INFO: Setting encoder.encoders.16.feed_forward_macaron.w_1.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,468 (abs_task:1370) INFO: Setting encoder.encoders.16.feed_forward_macaron.w_1.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,468 (abs_task:1370) INFO: Setting encoder.encoders.16.feed_forward_macaron.w_2.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,468 (abs_task:1370) INFO: Setting encoder.encoders.16.feed_forward_macaron.w_2.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,468 (abs_task:1370) INFO: Setting encoder.encoders.16.norm_ff.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,469 (abs_task:1370) INFO: Setting encoder.encoders.16.norm_ff.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,469 (abs_task:1370) INFO: Setting encoder.encoders.16.norm_ff_macaron.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,469 (abs_task:1370) INFO: Setting encoder.encoders.16.norm_ff_macaron.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,469 (abs_task:1370) INFO: Setting encoder.encoders.16.norm_mha.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,469 (abs_task:1370) INFO: Setting encoder.encoders.16.norm_mha.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,469 (abs_task:1370) INFO: Setting encoder.encoders.16.norm_mlp.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,469 (abs_task:1370) INFO: Setting encoder.encoders.16.norm_mlp.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,469 (abs_task:1370) INFO: Setting encoder.encoders.16.norm_final.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,469 (abs_task:1370) INFO: Setting encoder.encoders.16.norm_final.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,469 (abs_task:1370) INFO: Setting encoder.encoders.16.depthwise_conv_fusion.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,469 (abs_task:1370) INFO: Setting encoder.encoders.16.depthwise_conv_fusion.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,469 (abs_task:1370) INFO: Setting encoder.encoders.16.merge_proj.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,469 (abs_task:1370) INFO: Setting encoder.encoders.16.merge_proj.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,469 (abs_task:1370) INFO: Setting encoder.encoders.17.attn.linear_q.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,469 (abs_task:1370) INFO: Setting encoder.encoders.17.attn.linear_q.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,469 (abs_task:1370) INFO: Setting encoder.encoders.17.attn.linear_k.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,469 (abs_task:1370) INFO: Setting encoder.encoders.17.attn.linear_k.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,469 (abs_task:1370) INFO: Setting encoder.encoders.17.attn.linear_v.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,469 (abs_task:1370) INFO: Setting encoder.encoders.17.attn.linear_v.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,469 (abs_task:1370) INFO: Setting encoder.encoders.17.attn.linear_out.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,469 (abs_task:1370) INFO: Setting encoder.encoders.17.attn.linear_out.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,469 (abs_task:1370) INFO: Setting encoder.encoders.17.cgmlp.channel_proj1.0.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,469 (abs_task:1370) INFO: Setting encoder.encoders.17.cgmlp.channel_proj1.0.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,469 (abs_task:1370) INFO: Setting encoder.encoders.17.cgmlp.csgu.norm.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,469 (abs_task:1370) INFO: Setting encoder.encoders.17.cgmlp.csgu.norm.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,469 (abs_task:1370) INFO: Setting encoder.encoders.17.cgmlp.csgu.conv.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,469 (abs_task:1370) INFO: Setting encoder.encoders.17.cgmlp.csgu.conv.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,469 (abs_task:1370) INFO: Setting encoder.encoders.17.cgmlp.channel_proj2.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,469 (abs_task:1370) INFO: Setting encoder.encoders.17.cgmlp.channel_proj2.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,469 (abs_task:1370) INFO: Setting encoder.encoders.17.feed_forward.w_1.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,469 (abs_task:1370) INFO: Setting encoder.encoders.17.feed_forward.w_1.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,469 (abs_task:1370) INFO: Setting encoder.encoders.17.feed_forward.w_2.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,469 (abs_task:1370) INFO: Setting encoder.encoders.17.feed_forward.w_2.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,469 (abs_task:1370) INFO: Setting encoder.encoders.17.feed_forward_macaron.w_1.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,469 (abs_task:1370) INFO: Setting encoder.encoders.17.feed_forward_macaron.w_1.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,469 (abs_task:1370) INFO: Setting encoder.encoders.17.feed_forward_macaron.w_2.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,469 (abs_task:1370) INFO: Setting encoder.encoders.17.feed_forward_macaron.w_2.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,469 (abs_task:1370) INFO: Setting encoder.encoders.17.norm_ff.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,469 (abs_task:1370) INFO: Setting encoder.encoders.17.norm_ff.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,469 (abs_task:1370) INFO: Setting encoder.encoders.17.norm_ff_macaron.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,469 (abs_task:1370) INFO: Setting encoder.encoders.17.norm_ff_macaron.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,469 (abs_task:1370) INFO: Setting encoder.encoders.17.norm_mha.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,469 (abs_task:1370) INFO: Setting encoder.encoders.17.norm_mha.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,469 (abs_task:1370) INFO: Setting encoder.encoders.17.norm_mlp.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,469 (abs_task:1370) INFO: Setting encoder.encoders.17.norm_mlp.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,469 (abs_task:1370) INFO: Setting encoder.encoders.17.norm_final.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,469 (abs_task:1370) INFO: Setting encoder.encoders.17.norm_final.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,469 (abs_task:1370) INFO: Setting encoder.encoders.17.depthwise_conv_fusion.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,469 (abs_task:1370) INFO: Setting encoder.encoders.17.depthwise_conv_fusion.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,469 (abs_task:1370) INFO: Setting encoder.encoders.17.merge_proj.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,469 (abs_task:1370) INFO: Setting encoder.encoders.17.merge_proj.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,469 (abs_task:1370) INFO: Setting encoder.after_norm.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,469 (abs_task:1370) INFO: Setting encoder.after_norm.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,471 (abs_task:1370) INFO: Setting decoder.embed.0.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,471 (abs_task:1370) INFO: Setting decoder.after_norm.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,471 (abs_task:1370) INFO: Setting decoder.after_norm.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,471 (abs_task:1370) INFO: Setting decoder.output_layer.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,471 (abs_task:1370) INFO: Setting decoder.output_layer.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,471 (abs_task:1370) INFO: Setting decoder.decoders.0.self_attn.linear_q.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,471 (abs_task:1370) INFO: Setting decoder.decoders.0.self_attn.linear_q.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,471 (abs_task:1370) INFO: Setting decoder.decoders.0.self_attn.linear_k.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,471 (abs_task:1370) INFO: Setting decoder.decoders.0.self_attn.linear_k.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,471 (abs_task:1370) INFO: Setting decoder.decoders.0.self_attn.linear_v.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,471 (abs_task:1370) INFO: Setting decoder.decoders.0.self_attn.linear_v.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,471 (abs_task:1370) INFO: Setting decoder.decoders.0.self_attn.linear_out.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,471 (abs_task:1370) INFO: Setting decoder.decoders.0.self_attn.linear_out.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,471 (abs_task:1370) INFO: Setting decoder.decoders.0.src_attn.linear_q.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,471 (abs_task:1370) INFO: Setting decoder.decoders.0.src_attn.linear_q.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,471 (abs_task:1370) INFO: Setting decoder.decoders.0.src_attn.linear_k.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,471 (abs_task:1370) INFO: Setting decoder.decoders.0.src_attn.linear_k.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,471 (abs_task:1370) INFO: Setting decoder.decoders.0.src_attn.linear_v.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,471 (abs_task:1370) INFO: Setting decoder.decoders.0.src_attn.linear_v.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,471 (abs_task:1370) INFO: Setting decoder.decoders.0.src_attn.linear_out.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,471 (abs_task:1370) INFO: Setting decoder.decoders.0.src_attn.linear_out.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,471 (abs_task:1370) INFO: Setting decoder.decoders.0.feed_forward.w_1.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,471 (abs_task:1370) INFO: Setting decoder.decoders.0.feed_forward.w_1.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,471 (abs_task:1370) INFO: Setting decoder.decoders.0.feed_forward.w_2.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,471 (abs_task:1370) INFO: Setting decoder.decoders.0.feed_forward.w_2.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,471 (abs_task:1370) INFO: Setting decoder.decoders.0.norm1.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,471 (abs_task:1370) INFO: Setting decoder.decoders.0.norm1.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,471 (abs_task:1370) INFO: Setting decoder.decoders.0.norm2.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,471 (abs_task:1370) INFO: Setting decoder.decoders.0.norm2.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,471 (abs_task:1370) INFO: Setting decoder.decoders.0.norm3.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,471 (abs_task:1370) INFO: Setting decoder.decoders.0.norm3.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,471 (abs_task:1370) INFO: Setting decoder.decoders.1.self_attn.linear_q.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,471 (abs_task:1370) INFO: Setting decoder.decoders.1.self_attn.linear_q.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,471 (abs_task:1370) INFO: Setting decoder.decoders.1.self_attn.linear_k.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,471 (abs_task:1370) INFO: Setting decoder.decoders.1.self_attn.linear_k.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,471 (abs_task:1370) INFO: Setting decoder.decoders.1.self_attn.linear_v.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,471 (abs_task:1370) INFO: Setting decoder.decoders.1.self_attn.linear_v.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,471 (abs_task:1370) INFO: Setting decoder.decoders.1.self_attn.linear_out.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,471 (abs_task:1370) INFO: Setting decoder.decoders.1.self_attn.linear_out.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,471 (abs_task:1370) INFO: Setting decoder.decoders.1.src_attn.linear_q.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,471 (abs_task:1370) INFO: Setting decoder.decoders.1.src_attn.linear_q.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,471 (abs_task:1370) INFO: Setting decoder.decoders.1.src_attn.linear_k.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,471 (abs_task:1370) INFO: Setting decoder.decoders.1.src_attn.linear_k.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,471 (abs_task:1370) INFO: Setting decoder.decoders.1.src_attn.linear_v.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,471 (abs_task:1370) INFO: Setting decoder.decoders.1.src_attn.linear_v.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,471 (abs_task:1370) INFO: Setting decoder.decoders.1.src_attn.linear_out.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,472 (abs_task:1370) INFO: Setting decoder.decoders.1.src_attn.linear_out.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,472 (abs_task:1370) INFO: Setting decoder.decoders.1.feed_forward.w_1.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,472 (abs_task:1370) INFO: Setting decoder.decoders.1.feed_forward.w_1.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,472 (abs_task:1370) INFO: Setting decoder.decoders.1.feed_forward.w_2.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,472 (abs_task:1370) INFO: Setting decoder.decoders.1.feed_forward.w_2.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,472 (abs_task:1370) INFO: Setting decoder.decoders.1.norm1.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,472 (abs_task:1370) INFO: Setting decoder.decoders.1.norm1.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,472 (abs_task:1370) INFO: Setting decoder.decoders.1.norm2.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,472 (abs_task:1370) INFO: Setting decoder.decoders.1.norm2.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,472 (abs_task:1370) INFO: Setting decoder.decoders.1.norm3.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,472 (abs_task:1370) INFO: Setting decoder.decoders.1.norm3.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,472 (abs_task:1370) INFO: Setting decoder.decoders.2.self_attn.linear_q.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,472 (abs_task:1370) INFO: Setting decoder.decoders.2.self_attn.linear_q.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,472 (abs_task:1370) INFO: Setting decoder.decoders.2.self_attn.linear_k.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,472 (abs_task:1370) INFO: Setting decoder.decoders.2.self_attn.linear_k.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,472 (abs_task:1370) INFO: Setting decoder.decoders.2.self_attn.linear_v.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,472 (abs_task:1370) INFO: Setting decoder.decoders.2.self_attn.linear_v.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,472 (abs_task:1370) INFO: Setting decoder.decoders.2.self_attn.linear_out.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,472 (abs_task:1370) INFO: Setting decoder.decoders.2.self_attn.linear_out.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,472 (abs_task:1370) INFO: Setting decoder.decoders.2.src_attn.linear_q.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,472 (abs_task:1370) INFO: Setting decoder.decoders.2.src_attn.linear_q.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,472 (abs_task:1370) INFO: Setting decoder.decoders.2.src_attn.linear_k.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,472 (abs_task:1370) INFO: Setting decoder.decoders.2.src_attn.linear_k.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,472 (abs_task:1370) INFO: Setting decoder.decoders.2.src_attn.linear_v.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,472 (abs_task:1370) INFO: Setting decoder.decoders.2.src_attn.linear_v.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,472 (abs_task:1370) INFO: Setting decoder.decoders.2.src_attn.linear_out.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,472 (abs_task:1370) INFO: Setting decoder.decoders.2.src_attn.linear_out.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,472 (abs_task:1370) INFO: Setting decoder.decoders.2.feed_forward.w_1.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,472 (abs_task:1370) INFO: Setting decoder.decoders.2.feed_forward.w_1.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,472 (abs_task:1370) INFO: Setting decoder.decoders.2.feed_forward.w_2.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,472 (abs_task:1370) INFO: Setting decoder.decoders.2.feed_forward.w_2.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,472 (abs_task:1370) INFO: Setting decoder.decoders.2.norm1.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,472 (abs_task:1370) INFO: Setting decoder.decoders.2.norm1.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,472 (abs_task:1370) INFO: Setting decoder.decoders.2.norm2.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,472 (abs_task:1370) INFO: Setting decoder.decoders.2.norm2.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,472 (abs_task:1370) INFO: Setting decoder.decoders.2.norm3.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,472 (abs_task:1370) INFO: Setting decoder.decoders.2.norm3.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,472 (abs_task:1370) INFO: Setting decoder.decoders.3.self_attn.linear_q.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,472 (abs_task:1370) INFO: Setting decoder.decoders.3.self_attn.linear_q.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,472 (abs_task:1370) INFO: Setting decoder.decoders.3.self_attn.linear_k.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,472 (abs_task:1370) INFO: Setting decoder.decoders.3.self_attn.linear_k.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,472 (abs_task:1370) INFO: Setting decoder.decoders.3.self_attn.linear_v.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,472 (abs_task:1370) INFO: Setting decoder.decoders.3.self_attn.linear_v.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,472 (abs_task:1370) INFO: Setting decoder.decoders.3.self_attn.linear_out.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,472 (abs_task:1370) INFO: Setting decoder.decoders.3.self_attn.linear_out.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,472 (abs_task:1370) INFO: Setting decoder.decoders.3.src_attn.linear_q.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,472 (abs_task:1370) INFO: Setting decoder.decoders.3.src_attn.linear_q.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,472 (abs_task:1370) INFO: Setting decoder.decoders.3.src_attn.linear_k.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,472 (abs_task:1370) INFO: Setting decoder.decoders.3.src_attn.linear_k.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,472 (abs_task:1370) INFO: Setting decoder.decoders.3.src_attn.linear_v.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,472 (abs_task:1370) INFO: Setting decoder.decoders.3.src_attn.linear_v.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,472 (abs_task:1370) INFO: Setting decoder.decoders.3.src_attn.linear_out.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,472 (abs_task:1370) INFO: Setting decoder.decoders.3.src_attn.linear_out.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,472 (abs_task:1370) INFO: Setting decoder.decoders.3.feed_forward.w_1.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,472 (abs_task:1370) INFO: Setting decoder.decoders.3.feed_forward.w_1.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,472 (abs_task:1370) INFO: Setting decoder.decoders.3.feed_forward.w_2.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,472 (abs_task:1370) INFO: Setting decoder.decoders.3.feed_forward.w_2.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,472 (abs_task:1370) INFO: Setting decoder.decoders.3.norm1.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,472 (abs_task:1370) INFO: Setting decoder.decoders.3.norm1.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,472 (abs_task:1370) INFO: Setting decoder.decoders.3.norm2.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,472 (abs_task:1370) INFO: Setting decoder.decoders.3.norm2.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,472 (abs_task:1370) INFO: Setting decoder.decoders.3.norm3.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,472 (abs_task:1370) INFO: Setting decoder.decoders.3.norm3.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,472 (abs_task:1370) INFO: Setting decoder.decoders.4.self_attn.linear_q.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,473 (abs_task:1370) INFO: Setting decoder.decoders.4.self_attn.linear_q.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,473 (abs_task:1370) INFO: Setting decoder.decoders.4.self_attn.linear_k.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,473 (abs_task:1370) INFO: Setting decoder.decoders.4.self_attn.linear_k.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,473 (abs_task:1370) INFO: Setting decoder.decoders.4.self_attn.linear_v.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,473 (abs_task:1370) INFO: Setting decoder.decoders.4.self_attn.linear_v.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,473 (abs_task:1370) INFO: Setting decoder.decoders.4.self_attn.linear_out.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,473 (abs_task:1370) INFO: Setting decoder.decoders.4.self_attn.linear_out.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,473 (abs_task:1370) INFO: Setting decoder.decoders.4.src_attn.linear_q.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,473 (abs_task:1370) INFO: Setting decoder.decoders.4.src_attn.linear_q.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,473 (abs_task:1370) INFO: Setting decoder.decoders.4.src_attn.linear_k.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,473 (abs_task:1370) INFO: Setting decoder.decoders.4.src_attn.linear_k.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,473 (abs_task:1370) INFO: Setting decoder.decoders.4.src_attn.linear_v.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,473 (abs_task:1370) INFO: Setting decoder.decoders.4.src_attn.linear_v.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,473 (abs_task:1370) INFO: Setting decoder.decoders.4.src_attn.linear_out.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,473 (abs_task:1370) INFO: Setting decoder.decoders.4.src_attn.linear_out.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,473 (abs_task:1370) INFO: Setting decoder.decoders.4.feed_forward.w_1.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,473 (abs_task:1370) INFO: Setting decoder.decoders.4.feed_forward.w_1.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,473 (abs_task:1370) INFO: Setting decoder.decoders.4.feed_forward.w_2.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,473 (abs_task:1370) INFO: Setting decoder.decoders.4.feed_forward.w_2.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,473 (abs_task:1370) INFO: Setting decoder.decoders.4.norm1.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,473 (abs_task:1370) INFO: Setting decoder.decoders.4.norm1.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,473 (abs_task:1370) INFO: Setting decoder.decoders.4.norm2.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,473 (abs_task:1370) INFO: Setting decoder.decoders.4.norm2.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,473 (abs_task:1370) INFO: Setting decoder.decoders.4.norm3.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,473 (abs_task:1370) INFO: Setting decoder.decoders.4.norm3.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,473 (abs_task:1370) INFO: Setting decoder.decoders.5.self_attn.linear_q.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,473 (abs_task:1370) INFO: Setting decoder.decoders.5.self_attn.linear_q.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,473 (abs_task:1370) INFO: Setting decoder.decoders.5.self_attn.linear_k.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,473 (abs_task:1370) INFO: Setting decoder.decoders.5.self_attn.linear_k.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,473 (abs_task:1370) INFO: Setting decoder.decoders.5.self_attn.linear_v.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,473 (abs_task:1370) INFO: Setting decoder.decoders.5.self_attn.linear_v.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,473 (abs_task:1370) INFO: Setting decoder.decoders.5.self_attn.linear_out.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,473 (abs_task:1370) INFO: Setting decoder.decoders.5.self_attn.linear_out.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,473 (abs_task:1370) INFO: Setting decoder.decoders.5.src_attn.linear_q.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,473 (abs_task:1370) INFO: Setting decoder.decoders.5.src_attn.linear_q.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,473 (abs_task:1370) INFO: Setting decoder.decoders.5.src_attn.linear_k.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,473 (abs_task:1370) INFO: Setting decoder.decoders.5.src_attn.linear_k.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,473 (abs_task:1370) INFO: Setting decoder.decoders.5.src_attn.linear_v.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,473 (abs_task:1370) INFO: Setting decoder.decoders.5.src_attn.linear_v.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,473 (abs_task:1370) INFO: Setting decoder.decoders.5.src_attn.linear_out.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,473 (abs_task:1370) INFO: Setting decoder.decoders.5.src_attn.linear_out.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,473 (abs_task:1370) INFO: Setting decoder.decoders.5.feed_forward.w_1.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,473 (abs_task:1370) INFO: Setting decoder.decoders.5.feed_forward.w_1.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,473 (abs_task:1370) INFO: Setting decoder.decoders.5.feed_forward.w_2.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,473 (abs_task:1370) INFO: Setting decoder.decoders.5.feed_forward.w_2.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,473 (abs_task:1370) INFO: Setting decoder.decoders.5.norm1.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,473 (abs_task:1370) INFO: Setting decoder.decoders.5.norm1.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,473 (abs_task:1370) INFO: Setting decoder.decoders.5.norm2.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,473 (abs_task:1370) INFO: Setting decoder.decoders.5.norm2.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,473 (abs_task:1370) INFO: Setting decoder.decoders.5.norm3.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,473 (abs_task:1370) INFO: Setting decoder.decoders.5.norm3.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,473 (abs_task:1370) INFO: Setting decoder.decoders.6.self_attn.linear_q.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,473 (abs_task:1370) INFO: Setting decoder.decoders.6.self_attn.linear_q.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,473 (abs_task:1370) INFO: Setting decoder.decoders.6.self_attn.linear_k.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,473 (abs_task:1370) INFO: Setting decoder.decoders.6.self_attn.linear_k.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,473 (abs_task:1370) INFO: Setting decoder.decoders.6.self_attn.linear_v.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,473 (abs_task:1370) INFO: Setting decoder.decoders.6.self_attn.linear_v.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,473 (abs_task:1370) INFO: Setting decoder.decoders.6.self_attn.linear_out.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,473 (abs_task:1370) INFO: Setting decoder.decoders.6.self_attn.linear_out.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,473 (abs_task:1370) INFO: Setting decoder.decoders.6.src_attn.linear_q.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,473 (abs_task:1370) INFO: Setting decoder.decoders.6.src_attn.linear_q.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,473 (abs_task:1370) INFO: Setting decoder.decoders.6.src_attn.linear_k.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,474 (abs_task:1370) INFO: Setting decoder.decoders.6.src_attn.linear_k.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,474 (abs_task:1370) INFO: Setting decoder.decoders.6.src_attn.linear_v.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,474 (abs_task:1370) INFO: Setting decoder.decoders.6.src_attn.linear_v.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,474 (abs_task:1370) INFO: Setting decoder.decoders.6.src_attn.linear_out.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,474 (abs_task:1370) INFO: Setting decoder.decoders.6.src_attn.linear_out.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,474 (abs_task:1370) INFO: Setting decoder.decoders.6.feed_forward.w_1.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,474 (abs_task:1370) INFO: Setting decoder.decoders.6.feed_forward.w_1.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,474 (abs_task:1370) INFO: Setting decoder.decoders.6.feed_forward.w_2.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,474 (abs_task:1370) INFO: Setting decoder.decoders.6.feed_forward.w_2.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,474 (abs_task:1370) INFO: Setting decoder.decoders.6.norm1.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,474 (abs_task:1370) INFO: Setting decoder.decoders.6.norm1.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,474 (abs_task:1370) INFO: Setting decoder.decoders.6.norm2.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,474 (abs_task:1370) INFO: Setting decoder.decoders.6.norm2.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,474 (abs_task:1370) INFO: Setting decoder.decoders.6.norm3.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,474 (abs_task:1370) INFO: Setting decoder.decoders.6.norm3.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,474 (abs_task:1370) INFO: Setting decoder.decoders.7.self_attn.linear_q.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,474 (abs_task:1370) INFO: Setting decoder.decoders.7.self_attn.linear_q.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,474 (abs_task:1370) INFO: Setting decoder.decoders.7.self_attn.linear_k.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,474 (abs_task:1370) INFO: Setting decoder.decoders.7.self_attn.linear_k.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,474 (abs_task:1370) INFO: Setting decoder.decoders.7.self_attn.linear_v.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,474 (abs_task:1370) INFO: Setting decoder.decoders.7.self_attn.linear_v.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,474 (abs_task:1370) INFO: Setting decoder.decoders.7.self_attn.linear_out.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,474 (abs_task:1370) INFO: Setting decoder.decoders.7.self_attn.linear_out.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,474 (abs_task:1370) INFO: Setting decoder.decoders.7.src_attn.linear_q.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,474 (abs_task:1370) INFO: Setting decoder.decoders.7.src_attn.linear_q.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,474 (abs_task:1370) INFO: Setting decoder.decoders.7.src_attn.linear_k.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,474 (abs_task:1370) INFO: Setting decoder.decoders.7.src_attn.linear_k.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,474 (abs_task:1370) INFO: Setting decoder.decoders.7.src_attn.linear_v.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,474 (abs_task:1370) INFO: Setting decoder.decoders.7.src_attn.linear_v.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,474 (abs_task:1370) INFO: Setting decoder.decoders.7.src_attn.linear_out.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,474 (abs_task:1370) INFO: Setting decoder.decoders.7.src_attn.linear_out.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,474 (abs_task:1370) INFO: Setting decoder.decoders.7.feed_forward.w_1.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,474 (abs_task:1370) INFO: Setting decoder.decoders.7.feed_forward.w_1.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,474 (abs_task:1370) INFO: Setting decoder.decoders.7.feed_forward.w_2.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,474 (abs_task:1370) INFO: Setting decoder.decoders.7.feed_forward.w_2.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,474 (abs_task:1370) INFO: Setting decoder.decoders.7.norm1.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,474 (abs_task:1370) INFO: Setting decoder.decoders.7.norm1.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,474 (abs_task:1370) INFO: Setting decoder.decoders.7.norm2.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,474 (abs_task:1370) INFO: Setting decoder.decoders.7.norm2.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,474 (abs_task:1370) INFO: Setting decoder.decoders.7.norm3.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,474 (abs_task:1370) INFO: Setting decoder.decoders.7.norm3.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,474 (abs_task:1370) INFO: Setting decoder.decoders.8.self_attn.linear_q.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,474 (abs_task:1370) INFO: Setting decoder.decoders.8.self_attn.linear_q.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,474 (abs_task:1370) INFO: Setting decoder.decoders.8.self_attn.linear_k.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,474 (abs_task:1370) INFO: Setting decoder.decoders.8.self_attn.linear_k.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,474 (abs_task:1370) INFO: Setting decoder.decoders.8.self_attn.linear_v.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,474 (abs_task:1370) INFO: Setting decoder.decoders.8.self_attn.linear_v.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,474 (abs_task:1370) INFO: Setting decoder.decoders.8.self_attn.linear_out.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,474 (abs_task:1370) INFO: Setting decoder.decoders.8.self_attn.linear_out.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,474 (abs_task:1370) INFO: Setting decoder.decoders.8.src_attn.linear_q.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,474 (abs_task:1370) INFO: Setting decoder.decoders.8.src_attn.linear_q.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,474 (abs_task:1370) INFO: Setting decoder.decoders.8.src_attn.linear_k.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,474 (abs_task:1370) INFO: Setting decoder.decoders.8.src_attn.linear_k.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,474 (abs_task:1370) INFO: Setting decoder.decoders.8.src_attn.linear_v.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,474 (abs_task:1370) INFO: Setting decoder.decoders.8.src_attn.linear_v.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,474 (abs_task:1370) INFO: Setting decoder.decoders.8.src_attn.linear_out.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,474 (abs_task:1370) INFO: Setting decoder.decoders.8.src_attn.linear_out.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,474 (abs_task:1370) INFO: Setting decoder.decoders.8.feed_forward.w_1.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,474 (abs_task:1370) INFO: Setting decoder.decoders.8.feed_forward.w_1.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,474 (abs_task:1370) INFO: Setting decoder.decoders.8.feed_forward.w_2.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,474 (abs_task:1370) INFO: Setting decoder.decoders.8.feed_forward.w_2.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,474 (abs_task:1370) INFO: Setting decoder.decoders.8.norm1.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,474 (abs_task:1370) INFO: Setting decoder.decoders.8.norm1.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,474 (abs_task:1370) INFO: Setting decoder.decoders.8.norm2.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,475 (abs_task:1370) INFO: Setting decoder.decoders.8.norm2.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,475 (abs_task:1370) INFO: Setting decoder.decoders.8.norm3.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,475 (abs_task:1370) INFO: Setting decoder.decoders.8.norm3.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,475 (abs_task:1370) INFO: Setting decoder.decoders.9.self_attn.linear_q.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,475 (abs_task:1370) INFO: Setting decoder.decoders.9.self_attn.linear_q.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,475 (abs_task:1370) INFO: Setting decoder.decoders.9.self_attn.linear_k.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,475 (abs_task:1370) INFO: Setting decoder.decoders.9.self_attn.linear_k.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,475 (abs_task:1370) INFO: Setting decoder.decoders.9.self_attn.linear_v.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,475 (abs_task:1370) INFO: Setting decoder.decoders.9.self_attn.linear_v.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,475 (abs_task:1370) INFO: Setting decoder.decoders.9.self_attn.linear_out.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,475 (abs_task:1370) INFO: Setting decoder.decoders.9.self_attn.linear_out.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,475 (abs_task:1370) INFO: Setting decoder.decoders.9.src_attn.linear_q.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,475 (abs_task:1370) INFO: Setting decoder.decoders.9.src_attn.linear_q.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,475 (abs_task:1370) INFO: Setting decoder.decoders.9.src_attn.linear_k.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,475 (abs_task:1370) INFO: Setting decoder.decoders.9.src_attn.linear_k.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,475 (abs_task:1370) INFO: Setting decoder.decoders.9.src_attn.linear_v.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,475 (abs_task:1370) INFO: Setting decoder.decoders.9.src_attn.linear_v.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,475 (abs_task:1370) INFO: Setting decoder.decoders.9.src_attn.linear_out.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,475 (abs_task:1370) INFO: Setting decoder.decoders.9.src_attn.linear_out.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,475 (abs_task:1370) INFO: Setting decoder.decoders.9.feed_forward.w_1.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,475 (abs_task:1370) INFO: Setting decoder.decoders.9.feed_forward.w_1.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,475 (abs_task:1370) INFO: Setting decoder.decoders.9.feed_forward.w_2.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,475 (abs_task:1370) INFO: Setting decoder.decoders.9.feed_forward.w_2.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,475 (abs_task:1370) INFO: Setting decoder.decoders.9.norm1.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,475 (abs_task:1370) INFO: Setting decoder.decoders.9.norm1.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,475 (abs_task:1370) INFO: Setting decoder.decoders.9.norm2.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,475 (abs_task:1370) INFO: Setting decoder.decoders.9.norm2.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,475 (abs_task:1370) INFO: Setting decoder.decoders.9.norm3.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,475 (abs_task:1370) INFO: Setting decoder.decoders.9.norm3.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,475 (abs_task:1370) INFO: Setting decoder.decoders.10.self_attn.linear_q.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,475 (abs_task:1370) INFO: Setting decoder.decoders.10.self_attn.linear_q.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,475 (abs_task:1370) INFO: Setting decoder.decoders.10.self_attn.linear_k.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,475 (abs_task:1370) INFO: Setting decoder.decoders.10.self_attn.linear_k.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,475 (abs_task:1370) INFO: Setting decoder.decoders.10.self_attn.linear_v.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,475 (abs_task:1370) INFO: Setting decoder.decoders.10.self_attn.linear_v.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,475 (abs_task:1370) INFO: Setting decoder.decoders.10.self_attn.linear_out.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,475 (abs_task:1370) INFO: Setting decoder.decoders.10.self_attn.linear_out.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,475 (abs_task:1370) INFO: Setting decoder.decoders.10.src_attn.linear_q.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,475 (abs_task:1370) INFO: Setting decoder.decoders.10.src_attn.linear_q.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,475 (abs_task:1370) INFO: Setting decoder.decoders.10.src_attn.linear_k.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,475 (abs_task:1370) INFO: Setting decoder.decoders.10.src_attn.linear_k.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,475 (abs_task:1370) INFO: Setting decoder.decoders.10.src_attn.linear_v.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,475 (abs_task:1370) INFO: Setting decoder.decoders.10.src_attn.linear_v.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,475 (abs_task:1370) INFO: Setting decoder.decoders.10.src_attn.linear_out.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,475 (abs_task:1370) INFO: Setting decoder.decoders.10.src_attn.linear_out.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,475 (abs_task:1370) INFO: Setting decoder.decoders.10.feed_forward.w_1.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,475 (abs_task:1370) INFO: Setting decoder.decoders.10.feed_forward.w_1.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,475 (abs_task:1370) INFO: Setting decoder.decoders.10.feed_forward.w_2.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,475 (abs_task:1370) INFO: Setting decoder.decoders.10.feed_forward.w_2.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,475 (abs_task:1370) INFO: Setting decoder.decoders.10.norm1.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,475 (abs_task:1370) INFO: Setting decoder.decoders.10.norm1.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,475 (abs_task:1370) INFO: Setting decoder.decoders.10.norm2.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,475 (abs_task:1370) INFO: Setting decoder.decoders.10.norm2.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,475 (abs_task:1370) INFO: Setting decoder.decoders.10.norm3.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,475 (abs_task:1370) INFO: Setting decoder.decoders.10.norm3.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,475 (abs_task:1370) INFO: Setting decoder.decoders.11.self_attn.linear_q.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,475 (abs_task:1370) INFO: Setting decoder.decoders.11.self_attn.linear_q.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,475 (abs_task:1370) INFO: Setting decoder.decoders.11.self_attn.linear_k.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,475 (abs_task:1370) INFO: Setting decoder.decoders.11.self_attn.linear_k.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,475 (abs_task:1370) INFO: Setting decoder.decoders.11.self_attn.linear_v.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,475 (abs_task:1370) INFO: Setting decoder.decoders.11.self_attn.linear_v.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,475 (abs_task:1370) INFO: Setting decoder.decoders.11.self_attn.linear_out.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,476 (abs_task:1370) INFO: Setting decoder.decoders.11.self_attn.linear_out.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,476 (abs_task:1370) INFO: Setting decoder.decoders.11.src_attn.linear_q.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,476 (abs_task:1370) INFO: Setting decoder.decoders.11.src_attn.linear_q.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,476 (abs_task:1370) INFO: Setting decoder.decoders.11.src_attn.linear_k.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,476 (abs_task:1370) INFO: Setting decoder.decoders.11.src_attn.linear_k.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,476 (abs_task:1370) INFO: Setting decoder.decoders.11.src_attn.linear_v.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,476 (abs_task:1370) INFO: Setting decoder.decoders.11.src_attn.linear_v.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,476 (abs_task:1370) INFO: Setting decoder.decoders.11.src_attn.linear_out.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,476 (abs_task:1370) INFO: Setting decoder.decoders.11.src_attn.linear_out.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,476 (abs_task:1370) INFO: Setting decoder.decoders.11.feed_forward.w_1.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,476 (abs_task:1370) INFO: Setting decoder.decoders.11.feed_forward.w_1.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,476 (abs_task:1370) INFO: Setting decoder.decoders.11.feed_forward.w_2.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,476 (abs_task:1370) INFO: Setting decoder.decoders.11.feed_forward.w_2.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,476 (abs_task:1370) INFO: Setting decoder.decoders.11.norm1.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,476 (abs_task:1370) INFO: Setting decoder.decoders.11.norm1.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,476 (abs_task:1370) INFO: Setting decoder.decoders.11.norm2.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,476 (abs_task:1370) INFO: Setting decoder.decoders.11.norm2.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,476 (abs_task:1370) INFO: Setting decoder.decoders.11.norm3.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,476 (abs_task:1370) INFO: Setting decoder.decoders.11.norm3.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,476 (abs_task:1370) INFO: Setting decoder.decoders.12.self_attn.linear_q.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,476 (abs_task:1370) INFO: Setting decoder.decoders.12.self_attn.linear_q.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,476 (abs_task:1370) INFO: Setting decoder.decoders.12.self_attn.linear_k.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,476 (abs_task:1370) INFO: Setting decoder.decoders.12.self_attn.linear_k.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,476 (abs_task:1370) INFO: Setting decoder.decoders.12.self_attn.linear_v.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,476 (abs_task:1370) INFO: Setting decoder.decoders.12.self_attn.linear_v.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,476 (abs_task:1370) INFO: Setting decoder.decoders.12.self_attn.linear_out.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,476 (abs_task:1370) INFO: Setting decoder.decoders.12.self_attn.linear_out.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,476 (abs_task:1370) INFO: Setting decoder.decoders.12.src_attn.linear_q.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,476 (abs_task:1370) INFO: Setting decoder.decoders.12.src_attn.linear_q.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,476 (abs_task:1370) INFO: Setting decoder.decoders.12.src_attn.linear_k.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,476 (abs_task:1370) INFO: Setting decoder.decoders.12.src_attn.linear_k.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,476 (abs_task:1370) INFO: Setting decoder.decoders.12.src_attn.linear_v.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,476 (abs_task:1370) INFO: Setting decoder.decoders.12.src_attn.linear_v.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,476 (abs_task:1370) INFO: Setting decoder.decoders.12.src_attn.linear_out.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,476 (abs_task:1370) INFO: Setting decoder.decoders.12.src_attn.linear_out.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,476 (abs_task:1370) INFO: Setting decoder.decoders.12.feed_forward.w_1.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,476 (abs_task:1370) INFO: Setting decoder.decoders.12.feed_forward.w_1.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,476 (abs_task:1370) INFO: Setting decoder.decoders.12.feed_forward.w_2.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,476 (abs_task:1370) INFO: Setting decoder.decoders.12.feed_forward.w_2.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,476 (abs_task:1370) INFO: Setting decoder.decoders.12.norm1.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,476 (abs_task:1370) INFO: Setting decoder.decoders.12.norm1.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,476 (abs_task:1370) INFO: Setting decoder.decoders.12.norm2.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,476 (abs_task:1370) INFO: Setting decoder.decoders.12.norm2.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,476 (abs_task:1370) INFO: Setting decoder.decoders.12.norm3.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,476 (abs_task:1370) INFO: Setting decoder.decoders.12.norm3.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,476 (abs_task:1370) INFO: Setting decoder.decoders.13.self_attn.linear_q.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,476 (abs_task:1370) INFO: Setting decoder.decoders.13.self_attn.linear_q.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,476 (abs_task:1370) INFO: Setting decoder.decoders.13.self_attn.linear_k.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,476 (abs_task:1370) INFO: Setting decoder.decoders.13.self_attn.linear_k.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,476 (abs_task:1370) INFO: Setting decoder.decoders.13.self_attn.linear_v.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,476 (abs_task:1370) INFO: Setting decoder.decoders.13.self_attn.linear_v.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,476 (abs_task:1370) INFO: Setting decoder.decoders.13.self_attn.linear_out.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,476 (abs_task:1370) INFO: Setting decoder.decoders.13.self_attn.linear_out.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,476 (abs_task:1370) INFO: Setting decoder.decoders.13.src_attn.linear_q.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,476 (abs_task:1370) INFO: Setting decoder.decoders.13.src_attn.linear_q.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,476 (abs_task:1370) INFO: Setting decoder.decoders.13.src_attn.linear_k.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,476 (abs_task:1370) INFO: Setting decoder.decoders.13.src_attn.linear_k.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,476 (abs_task:1370) INFO: Setting decoder.decoders.13.src_attn.linear_v.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,476 (abs_task:1370) INFO: Setting decoder.decoders.13.src_attn.linear_v.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,476 (abs_task:1370) INFO: Setting decoder.decoders.13.src_attn.linear_out.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,477 (abs_task:1370) INFO: Setting decoder.decoders.13.src_attn.linear_out.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,477 (abs_task:1370) INFO: Setting decoder.decoders.13.feed_forward.w_1.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,477 (abs_task:1370) INFO: Setting decoder.decoders.13.feed_forward.w_1.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,477 (abs_task:1370) INFO: Setting decoder.decoders.13.feed_forward.w_2.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,477 (abs_task:1370) INFO: Setting decoder.decoders.13.feed_forward.w_2.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,477 (abs_task:1370) INFO: Setting decoder.decoders.13.norm1.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,477 (abs_task:1370) INFO: Setting decoder.decoders.13.norm1.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,477 (abs_task:1370) INFO: Setting decoder.decoders.13.norm2.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,477 (abs_task:1370) INFO: Setting decoder.decoders.13.norm2.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,477 (abs_task:1370) INFO: Setting decoder.decoders.13.norm3.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,477 (abs_task:1370) INFO: Setting decoder.decoders.13.norm3.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,477 (abs_task:1370) INFO: Setting decoder.decoders.14.self_attn.linear_q.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,477 (abs_task:1370) INFO: Setting decoder.decoders.14.self_attn.linear_q.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,477 (abs_task:1370) INFO: Setting decoder.decoders.14.self_attn.linear_k.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,477 (abs_task:1370) INFO: Setting decoder.decoders.14.self_attn.linear_k.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,477 (abs_task:1370) INFO: Setting decoder.decoders.14.self_attn.linear_v.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,477 (abs_task:1370) INFO: Setting decoder.decoders.14.self_attn.linear_v.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,477 (abs_task:1370) INFO: Setting decoder.decoders.14.self_attn.linear_out.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,477 (abs_task:1370) INFO: Setting decoder.decoders.14.self_attn.linear_out.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,477 (abs_task:1370) INFO: Setting decoder.decoders.14.src_attn.linear_q.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,477 (abs_task:1370) INFO: Setting decoder.decoders.14.src_attn.linear_q.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,477 (abs_task:1370) INFO: Setting decoder.decoders.14.src_attn.linear_k.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,477 (abs_task:1370) INFO: Setting decoder.decoders.14.src_attn.linear_k.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,477 (abs_task:1370) INFO: Setting decoder.decoders.14.src_attn.linear_v.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,477 (abs_task:1370) INFO: Setting decoder.decoders.14.src_attn.linear_v.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,477 (abs_task:1370) INFO: Setting decoder.decoders.14.src_attn.linear_out.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,477 (abs_task:1370) INFO: Setting decoder.decoders.14.src_attn.linear_out.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,477 (abs_task:1370) INFO: Setting decoder.decoders.14.feed_forward.w_1.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,477 (abs_task:1370) INFO: Setting decoder.decoders.14.feed_forward.w_1.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,477 (abs_task:1370) INFO: Setting decoder.decoders.14.feed_forward.w_2.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,477 (abs_task:1370) INFO: Setting decoder.decoders.14.feed_forward.w_2.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,477 (abs_task:1370) INFO: Setting decoder.decoders.14.norm1.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,477 (abs_task:1370) INFO: Setting decoder.decoders.14.norm1.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,477 (abs_task:1370) INFO: Setting decoder.decoders.14.norm2.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,477 (abs_task:1370) INFO: Setting decoder.decoders.14.norm2.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,477 (abs_task:1370) INFO: Setting decoder.decoders.14.norm3.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,477 (abs_task:1370) INFO: Setting decoder.decoders.14.norm3.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,477 (abs_task:1370) INFO: Setting decoder.decoders.15.self_attn.linear_q.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,477 (abs_task:1370) INFO: Setting decoder.decoders.15.self_attn.linear_q.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,477 (abs_task:1370) INFO: Setting decoder.decoders.15.self_attn.linear_k.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,477 (abs_task:1370) INFO: Setting decoder.decoders.15.self_attn.linear_k.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,477 (abs_task:1370) INFO: Setting decoder.decoders.15.self_attn.linear_v.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,477 (abs_task:1370) INFO: Setting decoder.decoders.15.self_attn.linear_v.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,477 (abs_task:1370) INFO: Setting decoder.decoders.15.self_attn.linear_out.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,477 (abs_task:1370) INFO: Setting decoder.decoders.15.self_attn.linear_out.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,477 (abs_task:1370) INFO: Setting decoder.decoders.15.src_attn.linear_q.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,477 (abs_task:1370) INFO: Setting decoder.decoders.15.src_attn.linear_q.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,477 (abs_task:1370) INFO: Setting decoder.decoders.15.src_attn.linear_k.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,477 (abs_task:1370) INFO: Setting decoder.decoders.15.src_attn.linear_k.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,477 (abs_task:1370) INFO: Setting decoder.decoders.15.src_attn.linear_v.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,477 (abs_task:1370) INFO: Setting decoder.decoders.15.src_attn.linear_v.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,477 (abs_task:1370) INFO: Setting decoder.decoders.15.src_attn.linear_out.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,477 (abs_task:1370) INFO: Setting decoder.decoders.15.src_attn.linear_out.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,477 (abs_task:1370) INFO: Setting decoder.decoders.15.feed_forward.w_1.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,477 (abs_task:1370) INFO: Setting decoder.decoders.15.feed_forward.w_1.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,477 (abs_task:1370) INFO: Setting decoder.decoders.15.feed_forward.w_2.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,477 (abs_task:1370) INFO: Setting decoder.decoders.15.feed_forward.w_2.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,477 (abs_task:1370) INFO: Setting decoder.decoders.15.norm1.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,477 (abs_task:1370) INFO: Setting decoder.decoders.15.norm1.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,477 (abs_task:1370) INFO: Setting decoder.decoders.15.norm2.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,477 (abs_task:1370) INFO: Setting decoder.decoders.15.norm2.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,477 (abs_task:1370) INFO: Setting decoder.decoders.15.norm3.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,477 (abs_task:1370) INFO: Setting decoder.decoders.15.norm3.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,477 (abs_task:1370) INFO: Setting decoder.decoders.16.self_attn.linear_q.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,478 (abs_task:1370) INFO: Setting decoder.decoders.16.self_attn.linear_q.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,478 (abs_task:1370) INFO: Setting decoder.decoders.16.self_attn.linear_k.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,478 (abs_task:1370) INFO: Setting decoder.decoders.16.self_attn.linear_k.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,478 (abs_task:1370) INFO: Setting decoder.decoders.16.self_attn.linear_v.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,478 (abs_task:1370) INFO: Setting decoder.decoders.16.self_attn.linear_v.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,478 (abs_task:1370) INFO: Setting decoder.decoders.16.self_attn.linear_out.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,478 (abs_task:1370) INFO: Setting decoder.decoders.16.self_attn.linear_out.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,478 (abs_task:1370) INFO: Setting decoder.decoders.16.src_attn.linear_q.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,478 (abs_task:1370) INFO: Setting decoder.decoders.16.src_attn.linear_q.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,478 (abs_task:1370) INFO: Setting decoder.decoders.16.src_attn.linear_k.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,478 (abs_task:1370) INFO: Setting decoder.decoders.16.src_attn.linear_k.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,478 (abs_task:1370) INFO: Setting decoder.decoders.16.src_attn.linear_v.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,478 (abs_task:1370) INFO: Setting decoder.decoders.16.src_attn.linear_v.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,478 (abs_task:1370) INFO: Setting decoder.decoders.16.src_attn.linear_out.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,478 (abs_task:1370) INFO: Setting decoder.decoders.16.src_attn.linear_out.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,478 (abs_task:1370) INFO: Setting decoder.decoders.16.feed_forward.w_1.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,478 (abs_task:1370) INFO: Setting decoder.decoders.16.feed_forward.w_1.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,478 (abs_task:1370) INFO: Setting decoder.decoders.16.feed_forward.w_2.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,478 (abs_task:1370) INFO: Setting decoder.decoders.16.feed_forward.w_2.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,478 (abs_task:1370) INFO: Setting decoder.decoders.16.norm1.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,478 (abs_task:1370) INFO: Setting decoder.decoders.16.norm1.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,478 (abs_task:1370) INFO: Setting decoder.decoders.16.norm2.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,478 (abs_task:1370) INFO: Setting decoder.decoders.16.norm2.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,478 (abs_task:1370) INFO: Setting decoder.decoders.16.norm3.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,478 (abs_task:1370) INFO: Setting decoder.decoders.16.norm3.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,478 (abs_task:1370) INFO: Setting decoder.decoders.17.self_attn.linear_q.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,478 (abs_task:1370) INFO: Setting decoder.decoders.17.self_attn.linear_q.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,478 (abs_task:1370) INFO: Setting decoder.decoders.17.self_attn.linear_k.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,478 (abs_task:1370) INFO: Setting decoder.decoders.17.self_attn.linear_k.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,478 (abs_task:1370) INFO: Setting decoder.decoders.17.self_attn.linear_v.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,478 (abs_task:1370) INFO: Setting decoder.decoders.17.self_attn.linear_v.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,478 (abs_task:1370) INFO: Setting decoder.decoders.17.self_attn.linear_out.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,478 (abs_task:1370) INFO: Setting decoder.decoders.17.self_attn.linear_out.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,478 (abs_task:1370) INFO: Setting decoder.decoders.17.src_attn.linear_q.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,478 (abs_task:1370) INFO: Setting decoder.decoders.17.src_attn.linear_q.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,478 (abs_task:1370) INFO: Setting decoder.decoders.17.src_attn.linear_k.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,478 (abs_task:1370) INFO: Setting decoder.decoders.17.src_attn.linear_k.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,478 (abs_task:1370) INFO: Setting decoder.decoders.17.src_attn.linear_v.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,478 (abs_task:1370) INFO: Setting decoder.decoders.17.src_attn.linear_v.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,478 (abs_task:1370) INFO: Setting decoder.decoders.17.src_attn.linear_out.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,478 (abs_task:1370) INFO: Setting decoder.decoders.17.src_attn.linear_out.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,478 (abs_task:1370) INFO: Setting decoder.decoders.17.feed_forward.w_1.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,478 (abs_task:1370) INFO: Setting decoder.decoders.17.feed_forward.w_1.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,478 (abs_task:1370) INFO: Setting decoder.decoders.17.feed_forward.w_2.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,478 (abs_task:1370) INFO: Setting decoder.decoders.17.feed_forward.w_2.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,478 (abs_task:1370) INFO: Setting decoder.decoders.17.norm1.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,478 (abs_task:1370) INFO: Setting decoder.decoders.17.norm1.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,478 (abs_task:1370) INFO: Setting decoder.decoders.17.norm2.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,478 (abs_task:1370) INFO: Setting decoder.decoders.17.norm2.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,478 (abs_task:1370) INFO: Setting decoder.decoders.17.norm3.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,478 (abs_task:1370) INFO: Setting decoder.decoders.17.norm3.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:14,481 (abs_task:1370) INFO: Setting ctc.ctc_lo.weight.requires_grad = False |
| [w010] 2025-05-22 06:05:14,481 (abs_task:1370) INFO: Setting ctc.ctc_lo.bias.requires_grad = False |
| [w010] 2025-05-22 06:05:28,680 (abs_task:1398) INFO: pytorch.version=2.1.2, cuda.available=True, cudnn.version=8902, cudnn.benchmark=False, cudnn.deterministic=True |
| [w010] 2025-05-22 06:05:28,691 (abs_task:1399) INFO: Model structure: |
| ESPnetS2TModel( |
| (frontend): DefaultFrontend( |
| (stft): Stft(n_fft=512, win_length=400, hop_length=160, center=True, normalized=False, onesided=True) |
| (frontend): Frontend() |
| (logmel): LogMel(sr=16000, n_fft=512, n_mels=80, fmin=0, fmax=8000.0, htk=False) |
| ) |
| (specaug): SpecAug( |
| (freq_mask): MaskAlongAxis(mask_width_range=[0, 27], num_mask=2, axis=freq) |
| (time_mask): MaskAlongAxisVariableMaxWidth(mask_width_ratio_range=[0.0, 0.05], num_mask=10, axis=time) |
| ) |
| (normalize): GlobalMVN(stats_file=/ocean/projects/cis210027p/pwang10/rota/espnet/egs2/owsm_v3.1/s2t1/exp/s2t_stats_raw_bpe50000_medium/train/feats_stats.npz, norm_means=True, norm_vars=True) |
| (encoder): EBranchformerEncoder( |
| (embed): Conv2dSubsampling( |
| (conv): Sequential( |
| (0): Conv2d(1, 1024, kernel_size=(3, 3), stride=(2, 2)) |
| (1): ReLU() |
| (2): Conv2d(1024, 1024, kernel_size=(3, 3), stride=(2, 2)) |
| (3): ReLU() |
| ) |
| (out): Sequential( |
| (0): Linear(in_features=19456, out_features=1024, bias=True) |
| (1): PositionalEncoding( |
| (dropout): Dropout(p=0.1, inplace=False) |
| ) |
| ) |
| ) |
| (encoders): MultiSequential( |
| (0): EBranchformerEncoderLayer( |
| (attn): MultiHeadedAttention( |
| (linear_q): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_k): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_v): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_out): Linear(in_features=1024, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (q_norm): Identity() |
| (k_norm): Identity() |
| ) |
| (cgmlp): ConvolutionalGatingMLP( |
| (channel_proj1): Sequential( |
| (0): Linear(in_features=1024, out_features=4096, bias=True) |
| (1): GELU(approximate='none') |
| ) |
| (csgu): ConvolutionalSpatialGatingUnit( |
| (norm): LayerNorm((2048,), eps=1e-12, elementwise_affine=True) |
| (conv): Conv1d(2048, 2048, kernel_size=(31,), stride=(1,), padding=(15,), groups=2048) |
| (act): Identity() |
| (dropout): Dropout(p=0.1, inplace=False) |
| ) |
| (channel_proj2): Linear(in_features=2048, out_features=1024, bias=True) |
| ) |
| (feed_forward): PositionwiseFeedForward( |
| (w_1): Linear(in_features=1024, out_features=4096, bias=True) |
| (w_2): Linear(in_features=4096, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (activation): Swish() |
| ) |
| (feed_forward_macaron): PositionwiseFeedForward( |
| (w_1): Linear(in_features=1024, out_features=4096, bias=True) |
| (w_2): Linear(in_features=4096, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (activation): Swish() |
| ) |
| (norm_ff): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm_ff_macaron): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm_mha): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm_mlp): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm_final): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (depthwise_conv_fusion): Conv1d(2048, 2048, kernel_size=(31,), stride=(1,), padding=(15,), groups=2048) |
| (merge_proj): Linear(in_features=2048, out_features=1024, bias=True) |
| ) |
| (1): EBranchformerEncoderLayer( |
| (attn): MultiHeadedAttention( |
| (linear_q): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_k): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_v): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_out): Linear(in_features=1024, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (q_norm): Identity() |
| (k_norm): Identity() |
| ) |
| (cgmlp): ConvolutionalGatingMLP( |
| (channel_proj1): Sequential( |
| (0): Linear(in_features=1024, out_features=4096, bias=True) |
| (1): GELU(approximate='none') |
| ) |
| (csgu): ConvolutionalSpatialGatingUnit( |
| (norm): LayerNorm((2048,), eps=1e-12, elementwise_affine=True) |
| (conv): Conv1d(2048, 2048, kernel_size=(31,), stride=(1,), padding=(15,), groups=2048) |
| (act): Identity() |
| (dropout): Dropout(p=0.1, inplace=False) |
| ) |
| (channel_proj2): Linear(in_features=2048, out_features=1024, bias=True) |
| ) |
| (feed_forward): PositionwiseFeedForward( |
| (w_1): Linear(in_features=1024, out_features=4096, bias=True) |
| (w_2): Linear(in_features=4096, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (activation): Swish() |
| ) |
| (feed_forward_macaron): PositionwiseFeedForward( |
| (w_1): Linear(in_features=1024, out_features=4096, bias=True) |
| (w_2): Linear(in_features=4096, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (activation): Swish() |
| ) |
| (norm_ff): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm_ff_macaron): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm_mha): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm_mlp): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm_final): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (depthwise_conv_fusion): Conv1d(2048, 2048, kernel_size=(31,), stride=(1,), padding=(15,), groups=2048) |
| (merge_proj): Linear(in_features=2048, out_features=1024, bias=True) |
| ) |
| (2): EBranchformerEncoderLayer( |
| (attn): MultiHeadedAttention( |
| (linear_q): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_k): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_v): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_out): Linear(in_features=1024, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (q_norm): Identity() |
| (k_norm): Identity() |
| ) |
| (cgmlp): ConvolutionalGatingMLP( |
| (channel_proj1): Sequential( |
| (0): Linear(in_features=1024, out_features=4096, bias=True) |
| (1): GELU(approximate='none') |
| ) |
| (csgu): ConvolutionalSpatialGatingUnit( |
| (norm): LayerNorm((2048,), eps=1e-12, elementwise_affine=True) |
| (conv): Conv1d(2048, 2048, kernel_size=(31,), stride=(1,), padding=(15,), groups=2048) |
| (act): Identity() |
| (dropout): Dropout(p=0.1, inplace=False) |
| ) |
| (channel_proj2): Linear(in_features=2048, out_features=1024, bias=True) |
| ) |
| (feed_forward): PositionwiseFeedForward( |
| (w_1): Linear(in_features=1024, out_features=4096, bias=True) |
| (w_2): Linear(in_features=4096, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (activation): Swish() |
| ) |
| (feed_forward_macaron): PositionwiseFeedForward( |
| (w_1): Linear(in_features=1024, out_features=4096, bias=True) |
| (w_2): Linear(in_features=4096, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (activation): Swish() |
| ) |
| (norm_ff): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm_ff_macaron): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm_mha): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm_mlp): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm_final): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (depthwise_conv_fusion): Conv1d(2048, 2048, kernel_size=(31,), stride=(1,), padding=(15,), groups=2048) |
| (merge_proj): Linear(in_features=2048, out_features=1024, bias=True) |
| ) |
| (3): EBranchformerEncoderLayer( |
| (attn): MultiHeadedAttention( |
| (linear_q): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_k): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_v): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_out): Linear(in_features=1024, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (q_norm): Identity() |
| (k_norm): Identity() |
| ) |
| (cgmlp): ConvolutionalGatingMLP( |
| (channel_proj1): Sequential( |
| (0): Linear(in_features=1024, out_features=4096, bias=True) |
| (1): GELU(approximate='none') |
| ) |
| (csgu): ConvolutionalSpatialGatingUnit( |
| (norm): LayerNorm((2048,), eps=1e-12, elementwise_affine=True) |
| (conv): Conv1d(2048, 2048, kernel_size=(31,), stride=(1,), padding=(15,), groups=2048) |
| (act): Identity() |
| (dropout): Dropout(p=0.1, inplace=False) |
| ) |
| (channel_proj2): Linear(in_features=2048, out_features=1024, bias=True) |
| ) |
| (feed_forward): PositionwiseFeedForward( |
| (w_1): Linear(in_features=1024, out_features=4096, bias=True) |
| (w_2): Linear(in_features=4096, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (activation): Swish() |
| ) |
| (feed_forward_macaron): PositionwiseFeedForward( |
| (w_1): Linear(in_features=1024, out_features=4096, bias=True) |
| (w_2): Linear(in_features=4096, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (activation): Swish() |
| ) |
| (norm_ff): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm_ff_macaron): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm_mha): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm_mlp): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm_final): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (depthwise_conv_fusion): Conv1d(2048, 2048, kernel_size=(31,), stride=(1,), padding=(15,), groups=2048) |
| (merge_proj): Linear(in_features=2048, out_features=1024, bias=True) |
| ) |
| (4): EBranchformerEncoderLayer( |
| (attn): MultiHeadedAttention( |
| (linear_q): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_k): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_v): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_out): Linear(in_features=1024, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (q_norm): Identity() |
| (k_norm): Identity() |
| ) |
| (cgmlp): ConvolutionalGatingMLP( |
| (channel_proj1): Sequential( |
| (0): Linear(in_features=1024, out_features=4096, bias=True) |
| (1): GELU(approximate='none') |
| ) |
| (csgu): ConvolutionalSpatialGatingUnit( |
| (norm): LayerNorm((2048,), eps=1e-12, elementwise_affine=True) |
| (conv): Conv1d(2048, 2048, kernel_size=(31,), stride=(1,), padding=(15,), groups=2048) |
| (act): Identity() |
| (dropout): Dropout(p=0.1, inplace=False) |
| ) |
| (channel_proj2): Linear(in_features=2048, out_features=1024, bias=True) |
| ) |
| (feed_forward): PositionwiseFeedForward( |
| (w_1): Linear(in_features=1024, out_features=4096, bias=True) |
| (w_2): Linear(in_features=4096, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (activation): Swish() |
| ) |
| (feed_forward_macaron): PositionwiseFeedForward( |
| (w_1): Linear(in_features=1024, out_features=4096, bias=True) |
| (w_2): Linear(in_features=4096, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (activation): Swish() |
| ) |
| (norm_ff): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm_ff_macaron): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm_mha): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm_mlp): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm_final): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (depthwise_conv_fusion): Conv1d(2048, 2048, kernel_size=(31,), stride=(1,), padding=(15,), groups=2048) |
| (merge_proj): Linear(in_features=2048, out_features=1024, bias=True) |
| ) |
| (5): EBranchformerEncoderLayer( |
| (attn): MultiHeadedAttention( |
| (linear_q): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_k): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_v): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_out): Linear(in_features=1024, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (q_norm): Identity() |
| (k_norm): Identity() |
| ) |
| (cgmlp): ConvolutionalGatingMLP( |
| (channel_proj1): Sequential( |
| (0): Linear(in_features=1024, out_features=4096, bias=True) |
| (1): GELU(approximate='none') |
| ) |
| (csgu): ConvolutionalSpatialGatingUnit( |
| (norm): LayerNorm((2048,), eps=1e-12, elementwise_affine=True) |
| (conv): Conv1d(2048, 2048, kernel_size=(31,), stride=(1,), padding=(15,), groups=2048) |
| (act): Identity() |
| (dropout): Dropout(p=0.1, inplace=False) |
| ) |
| (channel_proj2): Linear(in_features=2048, out_features=1024, bias=True) |
| ) |
| (feed_forward): PositionwiseFeedForward( |
| (w_1): Linear(in_features=1024, out_features=4096, bias=True) |
| (w_2): Linear(in_features=4096, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (activation): Swish() |
| ) |
| (feed_forward_macaron): PositionwiseFeedForward( |
| (w_1): Linear(in_features=1024, out_features=4096, bias=True) |
| (w_2): Linear(in_features=4096, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (activation): Swish() |
| ) |
| (norm_ff): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm_ff_macaron): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm_mha): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm_mlp): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm_final): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (depthwise_conv_fusion): Conv1d(2048, 2048, kernel_size=(31,), stride=(1,), padding=(15,), groups=2048) |
| (merge_proj): Linear(in_features=2048, out_features=1024, bias=True) |
| ) |
| (6): EBranchformerEncoderLayer( |
| (attn): MultiHeadedAttention( |
| (linear_q): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_k): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_v): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_out): Linear(in_features=1024, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (q_norm): Identity() |
| (k_norm): Identity() |
| ) |
| (cgmlp): ConvolutionalGatingMLP( |
| (channel_proj1): Sequential( |
| (0): Linear(in_features=1024, out_features=4096, bias=True) |
| (1): GELU(approximate='none') |
| ) |
| (csgu): ConvolutionalSpatialGatingUnit( |
| (norm): LayerNorm((2048,), eps=1e-12, elementwise_affine=True) |
| (conv): Conv1d(2048, 2048, kernel_size=(31,), stride=(1,), padding=(15,), groups=2048) |
| (act): Identity() |
| (dropout): Dropout(p=0.1, inplace=False) |
| ) |
| (channel_proj2): Linear(in_features=2048, out_features=1024, bias=True) |
| ) |
| (feed_forward): PositionwiseFeedForward( |
| (w_1): Linear(in_features=1024, out_features=4096, bias=True) |
| (w_2): Linear(in_features=4096, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (activation): Swish() |
| ) |
| (feed_forward_macaron): PositionwiseFeedForward( |
| (w_1): Linear(in_features=1024, out_features=4096, bias=True) |
| (w_2): Linear(in_features=4096, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (activation): Swish() |
| ) |
| (norm_ff): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm_ff_macaron): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm_mha): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm_mlp): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm_final): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (depthwise_conv_fusion): Conv1d(2048, 2048, kernel_size=(31,), stride=(1,), padding=(15,), groups=2048) |
| (merge_proj): Linear(in_features=2048, out_features=1024, bias=True) |
| ) |
| (7): EBranchformerEncoderLayer( |
| (attn): MultiHeadedAttention( |
| (linear_q): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_k): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_v): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_out): Linear(in_features=1024, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (q_norm): Identity() |
| (k_norm): Identity() |
| ) |
| (cgmlp): ConvolutionalGatingMLP( |
| (channel_proj1): Sequential( |
| (0): Linear(in_features=1024, out_features=4096, bias=True) |
| (1): GELU(approximate='none') |
| ) |
| (csgu): ConvolutionalSpatialGatingUnit( |
| (norm): LayerNorm((2048,), eps=1e-12, elementwise_affine=True) |
| (conv): Conv1d(2048, 2048, kernel_size=(31,), stride=(1,), padding=(15,), groups=2048) |
| (act): Identity() |
| (dropout): Dropout(p=0.1, inplace=False) |
| ) |
| (channel_proj2): Linear(in_features=2048, out_features=1024, bias=True) |
| ) |
| (feed_forward): PositionwiseFeedForward( |
| (w_1): Linear(in_features=1024, out_features=4096, bias=True) |
| (w_2): Linear(in_features=4096, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (activation): Swish() |
| ) |
| (feed_forward_macaron): PositionwiseFeedForward( |
| (w_1): Linear(in_features=1024, out_features=4096, bias=True) |
| (w_2): Linear(in_features=4096, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (activation): Swish() |
| ) |
| (norm_ff): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm_ff_macaron): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm_mha): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm_mlp): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm_final): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (depthwise_conv_fusion): Conv1d(2048, 2048, kernel_size=(31,), stride=(1,), padding=(15,), groups=2048) |
| (merge_proj): Linear(in_features=2048, out_features=1024, bias=True) |
| ) |
| (8): EBranchformerEncoderLayer( |
| (attn): MultiHeadedAttention( |
| (linear_q): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_k): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_v): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_out): Linear(in_features=1024, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (q_norm): Identity() |
| (k_norm): Identity() |
| ) |
| (cgmlp): ConvolutionalGatingMLP( |
| (channel_proj1): Sequential( |
| (0): Linear(in_features=1024, out_features=4096, bias=True) |
| (1): GELU(approximate='none') |
| ) |
| (csgu): ConvolutionalSpatialGatingUnit( |
| (norm): LayerNorm((2048,), eps=1e-12, elementwise_affine=True) |
| (conv): Conv1d(2048, 2048, kernel_size=(31,), stride=(1,), padding=(15,), groups=2048) |
| (act): Identity() |
| (dropout): Dropout(p=0.1, inplace=False) |
| ) |
| (channel_proj2): Linear(in_features=2048, out_features=1024, bias=True) |
| ) |
| (feed_forward): PositionwiseFeedForward( |
| (w_1): Linear(in_features=1024, out_features=4096, bias=True) |
| (w_2): Linear(in_features=4096, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (activation): Swish() |
| ) |
| (feed_forward_macaron): PositionwiseFeedForward( |
| (w_1): Linear(in_features=1024, out_features=4096, bias=True) |
| (w_2): Linear(in_features=4096, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (activation): Swish() |
| ) |
| (norm_ff): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm_ff_macaron): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm_mha): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm_mlp): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm_final): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (depthwise_conv_fusion): Conv1d(2048, 2048, kernel_size=(31,), stride=(1,), padding=(15,), groups=2048) |
| (merge_proj): Linear(in_features=2048, out_features=1024, bias=True) |
| ) |
| (9): EBranchformerEncoderLayer( |
| (attn): MultiHeadedAttention( |
| (linear_q): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_k): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_v): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_out): Linear(in_features=1024, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (q_norm): Identity() |
| (k_norm): Identity() |
| ) |
| (cgmlp): ConvolutionalGatingMLP( |
| (channel_proj1): Sequential( |
| (0): Linear(in_features=1024, out_features=4096, bias=True) |
| (1): GELU(approximate='none') |
| ) |
| (csgu): ConvolutionalSpatialGatingUnit( |
| (norm): LayerNorm((2048,), eps=1e-12, elementwise_affine=True) |
| (conv): Conv1d(2048, 2048, kernel_size=(31,), stride=(1,), padding=(15,), groups=2048) |
| (act): Identity() |
| (dropout): Dropout(p=0.1, inplace=False) |
| ) |
| (channel_proj2): Linear(in_features=2048, out_features=1024, bias=True) |
| ) |
| (feed_forward): PositionwiseFeedForward( |
| (w_1): Linear(in_features=1024, out_features=4096, bias=True) |
| (w_2): Linear(in_features=4096, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (activation): Swish() |
| ) |
| (feed_forward_macaron): PositionwiseFeedForward( |
| (w_1): Linear(in_features=1024, out_features=4096, bias=True) |
| (w_2): Linear(in_features=4096, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (activation): Swish() |
| ) |
| (norm_ff): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm_ff_macaron): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm_mha): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm_mlp): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm_final): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (depthwise_conv_fusion): Conv1d(2048, 2048, kernel_size=(31,), stride=(1,), padding=(15,), groups=2048) |
| (merge_proj): Linear(in_features=2048, out_features=1024, bias=True) |
| ) |
| (10): EBranchformerEncoderLayer( |
| (attn): MultiHeadedAttention( |
| (linear_q): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_k): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_v): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_out): Linear(in_features=1024, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (q_norm): Identity() |
| (k_norm): Identity() |
| ) |
| (cgmlp): ConvolutionalGatingMLP( |
| (channel_proj1): Sequential( |
| (0): Linear(in_features=1024, out_features=4096, bias=True) |
| (1): GELU(approximate='none') |
| ) |
| (csgu): ConvolutionalSpatialGatingUnit( |
| (norm): LayerNorm((2048,), eps=1e-12, elementwise_affine=True) |
| (conv): Conv1d(2048, 2048, kernel_size=(31,), stride=(1,), padding=(15,), groups=2048) |
| (act): Identity() |
| (dropout): Dropout(p=0.1, inplace=False) |
| ) |
| (channel_proj2): Linear(in_features=2048, out_features=1024, bias=True) |
| ) |
| (feed_forward): PositionwiseFeedForward( |
| (w_1): Linear(in_features=1024, out_features=4096, bias=True) |
| (w_2): Linear(in_features=4096, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (activation): Swish() |
| ) |
| (feed_forward_macaron): PositionwiseFeedForward( |
| (w_1): Linear(in_features=1024, out_features=4096, bias=True) |
| (w_2): Linear(in_features=4096, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (activation): Swish() |
| ) |
| (norm_ff): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm_ff_macaron): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm_mha): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm_mlp): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm_final): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (depthwise_conv_fusion): Conv1d(2048, 2048, kernel_size=(31,), stride=(1,), padding=(15,), groups=2048) |
| (merge_proj): Linear(in_features=2048, out_features=1024, bias=True) |
| ) |
| (11): EBranchformerEncoderLayer( |
| (attn): MultiHeadedAttention( |
| (linear_q): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_k): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_v): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_out): Linear(in_features=1024, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (q_norm): Identity() |
| (k_norm): Identity() |
| ) |
| (cgmlp): ConvolutionalGatingMLP( |
| (channel_proj1): Sequential( |
| (0): Linear(in_features=1024, out_features=4096, bias=True) |
| (1): GELU(approximate='none') |
| ) |
| (csgu): ConvolutionalSpatialGatingUnit( |
| (norm): LayerNorm((2048,), eps=1e-12, elementwise_affine=True) |
| (conv): Conv1d(2048, 2048, kernel_size=(31,), stride=(1,), padding=(15,), groups=2048) |
| (act): Identity() |
| (dropout): Dropout(p=0.1, inplace=False) |
| ) |
| (channel_proj2): Linear(in_features=2048, out_features=1024, bias=True) |
| ) |
| (feed_forward): PositionwiseFeedForward( |
| (w_1): Linear(in_features=1024, out_features=4096, bias=True) |
| (w_2): Linear(in_features=4096, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (activation): Swish() |
| ) |
| (feed_forward_macaron): PositionwiseFeedForward( |
| (w_1): Linear(in_features=1024, out_features=4096, bias=True) |
| (w_2): Linear(in_features=4096, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (activation): Swish() |
| ) |
| (norm_ff): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm_ff_macaron): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm_mha): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm_mlp): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm_final): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (depthwise_conv_fusion): Conv1d(2048, 2048, kernel_size=(31,), stride=(1,), padding=(15,), groups=2048) |
| (merge_proj): Linear(in_features=2048, out_features=1024, bias=True) |
| ) |
| (12): EBranchformerEncoderLayer( |
| (attn): MultiHeadedAttention( |
| (linear_q): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_k): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_v): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_out): Linear(in_features=1024, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (q_norm): Identity() |
| (k_norm): Identity() |
| ) |
| (cgmlp): ConvolutionalGatingMLP( |
| (channel_proj1): Sequential( |
| (0): Linear(in_features=1024, out_features=4096, bias=True) |
| (1): GELU(approximate='none') |
| ) |
| (csgu): ConvolutionalSpatialGatingUnit( |
| (norm): LayerNorm((2048,), eps=1e-12, elementwise_affine=True) |
| (conv): Conv1d(2048, 2048, kernel_size=(31,), stride=(1,), padding=(15,), groups=2048) |
| (act): Identity() |
| (dropout): Dropout(p=0.1, inplace=False) |
| ) |
| (channel_proj2): Linear(in_features=2048, out_features=1024, bias=True) |
| ) |
| (feed_forward): PositionwiseFeedForward( |
| (w_1): Linear(in_features=1024, out_features=4096, bias=True) |
| (w_2): Linear(in_features=4096, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (activation): Swish() |
| ) |
| (feed_forward_macaron): PositionwiseFeedForward( |
| (w_1): Linear(in_features=1024, out_features=4096, bias=True) |
| (w_2): Linear(in_features=4096, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (activation): Swish() |
| ) |
| (norm_ff): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm_ff_macaron): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm_mha): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm_mlp): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm_final): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (depthwise_conv_fusion): Conv1d(2048, 2048, kernel_size=(31,), stride=(1,), padding=(15,), groups=2048) |
| (merge_proj): Linear(in_features=2048, out_features=1024, bias=True) |
| ) |
| (13): EBranchformerEncoderLayer( |
| (attn): MultiHeadedAttention( |
| (linear_q): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_k): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_v): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_out): Linear(in_features=1024, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (q_norm): Identity() |
| (k_norm): Identity() |
| ) |
| (cgmlp): ConvolutionalGatingMLP( |
| (channel_proj1): Sequential( |
| (0): Linear(in_features=1024, out_features=4096, bias=True) |
| (1): GELU(approximate='none') |
| ) |
| (csgu): ConvolutionalSpatialGatingUnit( |
| (norm): LayerNorm((2048,), eps=1e-12, elementwise_affine=True) |
| (conv): Conv1d(2048, 2048, kernel_size=(31,), stride=(1,), padding=(15,), groups=2048) |
| (act): Identity() |
| (dropout): Dropout(p=0.1, inplace=False) |
| ) |
| (channel_proj2): Linear(in_features=2048, out_features=1024, bias=True) |
| ) |
| (feed_forward): PositionwiseFeedForward( |
| (w_1): Linear(in_features=1024, out_features=4096, bias=True) |
| (w_2): Linear(in_features=4096, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (activation): Swish() |
| ) |
| (feed_forward_macaron): PositionwiseFeedForward( |
| (w_1): Linear(in_features=1024, out_features=4096, bias=True) |
| (w_2): Linear(in_features=4096, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (activation): Swish() |
| ) |
| (norm_ff): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm_ff_macaron): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm_mha): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm_mlp): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm_final): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (depthwise_conv_fusion): Conv1d(2048, 2048, kernel_size=(31,), stride=(1,), padding=(15,), groups=2048) |
| (merge_proj): Linear(in_features=2048, out_features=1024, bias=True) |
| ) |
| (14): EBranchformerEncoderLayer( |
| (attn): MultiHeadedAttention( |
| (linear_q): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_k): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_v): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_out): Linear(in_features=1024, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (q_norm): Identity() |
| (k_norm): Identity() |
| ) |
| (cgmlp): ConvolutionalGatingMLP( |
| (channel_proj1): Sequential( |
| (0): Linear(in_features=1024, out_features=4096, bias=True) |
| (1): GELU(approximate='none') |
| ) |
| (csgu): ConvolutionalSpatialGatingUnit( |
| (norm): LayerNorm((2048,), eps=1e-12, elementwise_affine=True) |
| (conv): Conv1d(2048, 2048, kernel_size=(31,), stride=(1,), padding=(15,), groups=2048) |
| (act): Identity() |
| (dropout): Dropout(p=0.1, inplace=False) |
| ) |
| (channel_proj2): Linear(in_features=2048, out_features=1024, bias=True) |
| ) |
| (feed_forward): PositionwiseFeedForward( |
| (w_1): Linear(in_features=1024, out_features=4096, bias=True) |
| (w_2): Linear(in_features=4096, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (activation): Swish() |
| ) |
| (feed_forward_macaron): PositionwiseFeedForward( |
| (w_1): Linear(in_features=1024, out_features=4096, bias=True) |
| (w_2): Linear(in_features=4096, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (activation): Swish() |
| ) |
| (norm_ff): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm_ff_macaron): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm_mha): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm_mlp): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm_final): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (depthwise_conv_fusion): Conv1d(2048, 2048, kernel_size=(31,), stride=(1,), padding=(15,), groups=2048) |
| (merge_proj): Linear(in_features=2048, out_features=1024, bias=True) |
| ) |
| (15): EBranchformerEncoderLayer( |
| (attn): MultiHeadedAttention( |
| (linear_q): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_k): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_v): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_out): Linear(in_features=1024, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (q_norm): Identity() |
| (k_norm): Identity() |
| ) |
| (cgmlp): ConvolutionalGatingMLP( |
| (channel_proj1): Sequential( |
| (0): Linear(in_features=1024, out_features=4096, bias=True) |
| (1): GELU(approximate='none') |
| ) |
| (csgu): ConvolutionalSpatialGatingUnit( |
| (norm): LayerNorm((2048,), eps=1e-12, elementwise_affine=True) |
| (conv): Conv1d(2048, 2048, kernel_size=(31,), stride=(1,), padding=(15,), groups=2048) |
| (act): Identity() |
| (dropout): Dropout(p=0.1, inplace=False) |
| ) |
| (channel_proj2): Linear(in_features=2048, out_features=1024, bias=True) |
| ) |
| (feed_forward): PositionwiseFeedForward( |
| (w_1): Linear(in_features=1024, out_features=4096, bias=True) |
| (w_2): Linear(in_features=4096, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (activation): Swish() |
| ) |
| (feed_forward_macaron): PositionwiseFeedForward( |
| (w_1): Linear(in_features=1024, out_features=4096, bias=True) |
| (w_2): Linear(in_features=4096, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (activation): Swish() |
| ) |
| (norm_ff): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm_ff_macaron): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm_mha): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm_mlp): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm_final): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (depthwise_conv_fusion): Conv1d(2048, 2048, kernel_size=(31,), stride=(1,), padding=(15,), groups=2048) |
| (merge_proj): Linear(in_features=2048, out_features=1024, bias=True) |
| ) |
| (16): EBranchformerEncoderLayer( |
| (attn): MultiHeadedAttention( |
| (linear_q): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_k): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_v): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_out): Linear(in_features=1024, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (q_norm): Identity() |
| (k_norm): Identity() |
| ) |
| (cgmlp): ConvolutionalGatingMLP( |
| (channel_proj1): Sequential( |
| (0): Linear(in_features=1024, out_features=4096, bias=True) |
| (1): GELU(approximate='none') |
| ) |
| (csgu): ConvolutionalSpatialGatingUnit( |
| (norm): LayerNorm((2048,), eps=1e-12, elementwise_affine=True) |
| (conv): Conv1d(2048, 2048, kernel_size=(31,), stride=(1,), padding=(15,), groups=2048) |
| (act): Identity() |
| (dropout): Dropout(p=0.1, inplace=False) |
| ) |
| (channel_proj2): Linear(in_features=2048, out_features=1024, bias=True) |
| ) |
| (feed_forward): PositionwiseFeedForward( |
| (w_1): Linear(in_features=1024, out_features=4096, bias=True) |
| (w_2): Linear(in_features=4096, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (activation): Swish() |
| ) |
| (feed_forward_macaron): PositionwiseFeedForward( |
| (w_1): Linear(in_features=1024, out_features=4096, bias=True) |
| (w_2): Linear(in_features=4096, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (activation): Swish() |
| ) |
| (norm_ff): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm_ff_macaron): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm_mha): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm_mlp): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm_final): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (depthwise_conv_fusion): Conv1d(2048, 2048, kernel_size=(31,), stride=(1,), padding=(15,), groups=2048) |
| (merge_proj): Linear(in_features=2048, out_features=1024, bias=True) |
| ) |
| (17): EBranchformerEncoderLayer( |
| (attn): MultiHeadedAttention( |
| (linear_q): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_k): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_v): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_out): Linear(in_features=1024, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (q_norm): Identity() |
| (k_norm): Identity() |
| ) |
| (cgmlp): ConvolutionalGatingMLP( |
| (channel_proj1): Sequential( |
| (0): Linear(in_features=1024, out_features=4096, bias=True) |
| (1): GELU(approximate='none') |
| ) |
| (csgu): ConvolutionalSpatialGatingUnit( |
| (norm): LayerNorm((2048,), eps=1e-12, elementwise_affine=True) |
| (conv): Conv1d(2048, 2048, kernel_size=(31,), stride=(1,), padding=(15,), groups=2048) |
| (act): Identity() |
| (dropout): Dropout(p=0.1, inplace=False) |
| ) |
| (channel_proj2): Linear(in_features=2048, out_features=1024, bias=True) |
| ) |
| (feed_forward): PositionwiseFeedForward( |
| (w_1): Linear(in_features=1024, out_features=4096, bias=True) |
| (w_2): Linear(in_features=4096, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (activation): Swish() |
| ) |
| (feed_forward_macaron): PositionwiseFeedForward( |
| (w_1): Linear(in_features=1024, out_features=4096, bias=True) |
| (w_2): Linear(in_features=4096, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (activation): Swish() |
| ) |
| (norm_ff): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm_ff_macaron): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm_mha): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm_mlp): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm_final): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (depthwise_conv_fusion): Conv1d(2048, 2048, kernel_size=(31,), stride=(1,), padding=(15,), groups=2048) |
| (merge_proj): Linear(in_features=2048, out_features=1024, bias=True) |
| ) |
| ) |
| (after_norm): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| ) |
| (decoder): TransformerDecoder( |
| (embed): Sequential( |
| (0): Embedding(50002, 1024) |
| (1): PositionalEncoding( |
| (dropout): Dropout(p=0.1, inplace=False) |
| ) |
| ) |
| (after_norm): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (output_layer): Linear(in_features=1024, out_features=50002, bias=True) |
| (decoders): MultiSequential( |
| (0): DecoderLayer( |
| (self_attn): MultiHeadedAttention( |
| (linear_q): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_k): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_v): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_out): Linear(in_features=1024, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (q_norm): Identity() |
| (k_norm): Identity() |
| ) |
| (src_attn): MultiHeadedAttention( |
| (linear_q): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_k): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_v): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_out): Linear(in_features=1024, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (q_norm): Identity() |
| (k_norm): Identity() |
| ) |
| (feed_forward): PositionwiseFeedForward( |
| (w_1): Linear(in_features=1024, out_features=4096, bias=True) |
| (w_2): Linear(in_features=4096, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (activation): ReLU() |
| ) |
| (norm1): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm2): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm3): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| ) |
| (1): DecoderLayer( |
| (self_attn): MultiHeadedAttention( |
| (linear_q): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_k): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_v): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_out): Linear(in_features=1024, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (q_norm): Identity() |
| (k_norm): Identity() |
| ) |
| (src_attn): MultiHeadedAttention( |
| (linear_q): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_k): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_v): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_out): Linear(in_features=1024, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (q_norm): Identity() |
| (k_norm): Identity() |
| ) |
| (feed_forward): PositionwiseFeedForward( |
| (w_1): Linear(in_features=1024, out_features=4096, bias=True) |
| (w_2): Linear(in_features=4096, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (activation): ReLU() |
| ) |
| (norm1): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm2): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm3): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| ) |
| (2): DecoderLayer( |
| (self_attn): MultiHeadedAttention( |
| (linear_q): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_k): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_v): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_out): Linear(in_features=1024, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (q_norm): Identity() |
| (k_norm): Identity() |
| ) |
| (src_attn): MultiHeadedAttention( |
| (linear_q): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_k): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_v): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_out): Linear(in_features=1024, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (q_norm): Identity() |
| (k_norm): Identity() |
| ) |
| (feed_forward): PositionwiseFeedForward( |
| (w_1): Linear(in_features=1024, out_features=4096, bias=True) |
| (w_2): Linear(in_features=4096, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (activation): ReLU() |
| ) |
| (norm1): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm2): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm3): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| ) |
| (3): DecoderLayer( |
| (self_attn): MultiHeadedAttention( |
| (linear_q): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_k): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_v): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_out): Linear(in_features=1024, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (q_norm): Identity() |
| (k_norm): Identity() |
| ) |
| (src_attn): MultiHeadedAttention( |
| (linear_q): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_k): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_v): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_out): Linear(in_features=1024, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (q_norm): Identity() |
| (k_norm): Identity() |
| ) |
| (feed_forward): PositionwiseFeedForward( |
| (w_1): Linear(in_features=1024, out_features=4096, bias=True) |
| (w_2): Linear(in_features=4096, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (activation): ReLU() |
| ) |
| (norm1): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm2): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm3): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| ) |
| (4): DecoderLayer( |
| (self_attn): MultiHeadedAttention( |
| (linear_q): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_k): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_v): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_out): Linear(in_features=1024, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (q_norm): Identity() |
| (k_norm): Identity() |
| ) |
| (src_attn): MultiHeadedAttention( |
| (linear_q): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_k): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_v): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_out): Linear(in_features=1024, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (q_norm): Identity() |
| (k_norm): Identity() |
| ) |
| (feed_forward): PositionwiseFeedForward( |
| (w_1): Linear(in_features=1024, out_features=4096, bias=True) |
| (w_2): Linear(in_features=4096, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (activation): ReLU() |
| ) |
| (norm1): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm2): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm3): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| ) |
| (5): DecoderLayer( |
| (self_attn): MultiHeadedAttention( |
| (linear_q): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_k): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_v): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_out): Linear(in_features=1024, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (q_norm): Identity() |
| (k_norm): Identity() |
| ) |
| (src_attn): MultiHeadedAttention( |
| (linear_q): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_k): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_v): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_out): Linear(in_features=1024, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (q_norm): Identity() |
| (k_norm): Identity() |
| ) |
| (feed_forward): PositionwiseFeedForward( |
| (w_1): Linear(in_features=1024, out_features=4096, bias=True) |
| (w_2): Linear(in_features=4096, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (activation): ReLU() |
| ) |
| (norm1): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm2): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm3): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| ) |
| (6): DecoderLayer( |
| (self_attn): MultiHeadedAttention( |
| (linear_q): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_k): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_v): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_out): Linear(in_features=1024, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (q_norm): Identity() |
| (k_norm): Identity() |
| ) |
| (src_attn): MultiHeadedAttention( |
| (linear_q): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_k): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_v): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_out): Linear(in_features=1024, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (q_norm): Identity() |
| (k_norm): Identity() |
| ) |
| (feed_forward): PositionwiseFeedForward( |
| (w_1): Linear(in_features=1024, out_features=4096, bias=True) |
| (w_2): Linear(in_features=4096, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (activation): ReLU() |
| ) |
| (norm1): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm2): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm3): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| ) |
| (7): DecoderLayer( |
| (self_attn): MultiHeadedAttention( |
| (linear_q): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_k): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_v): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_out): Linear(in_features=1024, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (q_norm): Identity() |
| (k_norm): Identity() |
| ) |
| (src_attn): MultiHeadedAttention( |
| (linear_q): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_k): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_v): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_out): Linear(in_features=1024, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (q_norm): Identity() |
| (k_norm): Identity() |
| ) |
| (feed_forward): PositionwiseFeedForward( |
| (w_1): Linear(in_features=1024, out_features=4096, bias=True) |
| (w_2): Linear(in_features=4096, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (activation): ReLU() |
| ) |
| (norm1): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm2): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm3): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| ) |
| (8): DecoderLayer( |
| (self_attn): MultiHeadedAttention( |
| (linear_q): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_k): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_v): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_out): Linear(in_features=1024, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (q_norm): Identity() |
| (k_norm): Identity() |
| ) |
| (src_attn): MultiHeadedAttention( |
| (linear_q): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_k): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_v): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_out): Linear(in_features=1024, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (q_norm): Identity() |
| (k_norm): Identity() |
| ) |
| (feed_forward): PositionwiseFeedForward( |
| (w_1): Linear(in_features=1024, out_features=4096, bias=True) |
| (w_2): Linear(in_features=4096, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (activation): ReLU() |
| ) |
| (norm1): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm2): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm3): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| ) |
| (9): DecoderLayer( |
| (self_attn): MultiHeadedAttention( |
| (linear_q): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_k): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_v): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_out): Linear(in_features=1024, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (q_norm): Identity() |
| (k_norm): Identity() |
| ) |
| (src_attn): MultiHeadedAttention( |
| (linear_q): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_k): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_v): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_out): Linear(in_features=1024, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (q_norm): Identity() |
| (k_norm): Identity() |
| ) |
| (feed_forward): PositionwiseFeedForward( |
| (w_1): Linear(in_features=1024, out_features=4096, bias=True) |
| (w_2): Linear(in_features=4096, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (activation): ReLU() |
| ) |
| (norm1): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm2): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm3): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| ) |
| (10): DecoderLayer( |
| (self_attn): MultiHeadedAttention( |
| (linear_q): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_k): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_v): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_out): Linear(in_features=1024, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (q_norm): Identity() |
| (k_norm): Identity() |
| ) |
| (src_attn): MultiHeadedAttention( |
| (linear_q): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_k): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_v): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_out): Linear(in_features=1024, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (q_norm): Identity() |
| (k_norm): Identity() |
| ) |
| (feed_forward): PositionwiseFeedForward( |
| (w_1): Linear(in_features=1024, out_features=4096, bias=True) |
| (w_2): Linear(in_features=4096, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (activation): ReLU() |
| ) |
| (norm1): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm2): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm3): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| ) |
| (11): DecoderLayer( |
| (self_attn): MultiHeadedAttention( |
| (linear_q): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_k): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_v): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_out): Linear(in_features=1024, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (q_norm): Identity() |
| (k_norm): Identity() |
| ) |
| (src_attn): MultiHeadedAttention( |
| (linear_q): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_k): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_v): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_out): Linear(in_features=1024, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (q_norm): Identity() |
| (k_norm): Identity() |
| ) |
| (feed_forward): PositionwiseFeedForward( |
| (w_1): Linear(in_features=1024, out_features=4096, bias=True) |
| (w_2): Linear(in_features=4096, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (activation): ReLU() |
| ) |
| (norm1): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm2): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm3): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| ) |
| (12): DecoderLayer( |
| (self_attn): MultiHeadedAttention( |
| (linear_q): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_k): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_v): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_out): Linear(in_features=1024, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (q_norm): Identity() |
| (k_norm): Identity() |
| ) |
| (src_attn): MultiHeadedAttention( |
| (linear_q): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_k): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_v): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_out): Linear(in_features=1024, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (q_norm): Identity() |
| (k_norm): Identity() |
| ) |
| (feed_forward): PositionwiseFeedForward( |
| (w_1): Linear(in_features=1024, out_features=4096, bias=True) |
| (w_2): Linear(in_features=4096, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (activation): ReLU() |
| ) |
| (norm1): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm2): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm3): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| ) |
| (13): DecoderLayer( |
| (self_attn): MultiHeadedAttention( |
| (linear_q): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_k): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_v): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_out): Linear(in_features=1024, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (q_norm): Identity() |
| (k_norm): Identity() |
| ) |
| (src_attn): MultiHeadedAttention( |
| (linear_q): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_k): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_v): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_out): Linear(in_features=1024, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (q_norm): Identity() |
| (k_norm): Identity() |
| ) |
| (feed_forward): PositionwiseFeedForward( |
| (w_1): Linear(in_features=1024, out_features=4096, bias=True) |
| (w_2): Linear(in_features=4096, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (activation): ReLU() |
| ) |
| (norm1): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm2): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm3): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| ) |
| (14): DecoderLayer( |
| (self_attn): MultiHeadedAttention( |
| (linear_q): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_k): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_v): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_out): Linear(in_features=1024, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (q_norm): Identity() |
| (k_norm): Identity() |
| ) |
| (src_attn): MultiHeadedAttention( |
| (linear_q): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_k): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_v): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_out): Linear(in_features=1024, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (q_norm): Identity() |
| (k_norm): Identity() |
| ) |
| (feed_forward): PositionwiseFeedForward( |
| (w_1): Linear(in_features=1024, out_features=4096, bias=True) |
| (w_2): Linear(in_features=4096, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (activation): ReLU() |
| ) |
| (norm1): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm2): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm3): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| ) |
| (15): DecoderLayer( |
| (self_attn): MultiHeadedAttention( |
| (linear_q): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_k): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_v): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_out): Linear(in_features=1024, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (q_norm): Identity() |
| (k_norm): Identity() |
| ) |
| (src_attn): MultiHeadedAttention( |
| (linear_q): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_k): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_v): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_out): Linear(in_features=1024, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (q_norm): Identity() |
| (k_norm): Identity() |
| ) |
| (feed_forward): PositionwiseFeedForward( |
| (w_1): Linear(in_features=1024, out_features=4096, bias=True) |
| (w_2): Linear(in_features=4096, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (activation): ReLU() |
| ) |
| (norm1): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm2): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm3): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| ) |
| (16): DecoderLayer( |
| (self_attn): MultiHeadedAttention( |
| (linear_q): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_k): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_v): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_out): Linear(in_features=1024, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (q_norm): Identity() |
| (k_norm): Identity() |
| ) |
| (src_attn): MultiHeadedAttention( |
| (linear_q): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_k): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_v): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_out): Linear(in_features=1024, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (q_norm): Identity() |
| (k_norm): Identity() |
| ) |
| (feed_forward): PositionwiseFeedForward( |
| (w_1): Linear(in_features=1024, out_features=4096, bias=True) |
| (w_2): Linear(in_features=4096, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (activation): ReLU() |
| ) |
| (norm1): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm2): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm3): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| ) |
| (17): DecoderLayer( |
| (self_attn): MultiHeadedAttention( |
| (linear_q): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_k): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_v): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_out): Linear(in_features=1024, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (q_norm): Identity() |
| (k_norm): Identity() |
| ) |
| (src_attn): MultiHeadedAttention( |
| (linear_q): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_k): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_v): Linear(in_features=1024, out_features=1024, bias=True) |
| (linear_out): Linear(in_features=1024, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (q_norm): Identity() |
| (k_norm): Identity() |
| ) |
| (feed_forward): PositionwiseFeedForward( |
| (w_1): Linear(in_features=1024, out_features=4096, bias=True) |
| (w_2): Linear(in_features=4096, out_features=1024, bias=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| (activation): ReLU() |
| ) |
| (norm1): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm2): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (norm3): LayerNorm((1024,), eps=1e-12, elementwise_affine=True) |
| (dropout): Dropout(p=0.1, inplace=False) |
| ) |
| ) |
| ) |
| (criterion_att): LabelSmoothingLoss( |
| (criterion): KLDivLoss() |
| ) |
| (ctc): CTC( |
| (ctc_lo): Linear(in_features=1024, out_features=50002, bias=True) |
| (ctc_loss): CTCLoss() |
| ) |
| ) |
|
|
| Model summary: |
| Class Name: ESPnetS2TModel |
| Total Number of model parameters: 1.04 B |
| Number of trainable parameters: 21.13 M (2.0%) |
| Size: 84.52 MB |
| Type: torch.float32 |
| [w010] 2025-05-22 06:05:28,691 (abs_task:1402) INFO: Optimizer: |
| AdamW ( |
| Parameter Group 0 |
| amsgrad: False |
| betas: [0.9, 0.98] |
| capturable: False |
| differentiable: False |
| eps: 1e-06 |
| foreach: None |
| fused: None |
| initial_lr: 0.0001 |
| lr: 2.5e-08 |
| maximize: False |
| weight_decay: 0.0 |
| ) |
| [w010] 2025-05-22 06:05:28,691 (abs_task:1403) INFO: Scheduler: PiecewiseLinearWarmupLR(warmup_steps_list=[0, 10000, 50000], warmup_lr_list=[0.0, 0.00025, 0.0001]) |
| [w010] 2025-05-22 06:05:28,735 (abs_task:1412) INFO: Saving the configuration in exp/s2t_lora_2/config.yaml |
| [w010] 2025-05-22 06:05:29,306 (abs_task:1477) INFO: Loading pretrained params from /ocean/projects/cis210027p/pwang10/rota/espnet/egs2/owsm_v3.1/s2t1/exp/owsm_v3.1_ebf/valid.total_count.ave_5best.till45epoch.pth |
| [w010] 2025-05-22 06:05:57,908 (abs_task:1826) INFO: [train] Batch sampler: UnsortedBatchSampler(N-batch=22430, batch_size=8, key_file=/ocean/projects/cis210027p/pwang10/rota/espnet/egs2/owsm_v3.1/s2t1/exp/s2t_stats_raw_bpe50000_medium//train/speech_shape, |
| [w010] 2025-05-22 06:05:57,935 (abs_task:1827) INFO: [train] mini-batch sizes summary: N-batch=22430, mean=8.0, min=8, max=8 |
| [w010] 2025-05-22 06:05:58,311 (read_text:31) INFO: keys_to_load is not None, only loading 179440 keys from dump/raw/cgn_train/text.prev |
| [w010] 2025-05-22 06:05:58,475 (read_text:31) INFO: keys_to_load is not None, only loading 179440 keys from dump/raw/cgn_train/text.ctc |
| [w010] 2025-05-22 06:05:59,043 (read_text:31) INFO: keys_to_load is not None, only loading 179440 keys from dump/raw/cgn_train/text |
| [w010] 2025-05-22 06:05:59,832 (s2t:444) INFO: Optional Data Names: ('text_prev', 'text_ctc', 'text_spk2', 'text_spk3', 'text_spk4') |
| [w010] 2025-05-22 06:05:59,836 (abs_task:1851) INFO: [train] dataset: |
| ESPnetDataset( |
| speech: {"path": "dump/raw/cgn_train/wav.scp", "type": "kaldi_ark"} |
| text_prev: {"path": "dump/raw/cgn_train/text.prev", "type": "text"} |
| text_ctc: {"path": "dump/raw/cgn_train/text.ctc", "type": "text"} |
| text: {"path": "dump/raw/cgn_train/text", "type": "text"} |
| preprocess: <espnet2.train.preprocessor.S2TPreprocessor object at 0x147d082b1b40>) |
| [w010] 2025-05-22 06:05:59,901 (abs_task:1826) INFO: [valid] Batch sampler: UnsortedBatchSampler(N-batch=3220, batch_size=8, key_file=/ocean/projects/cis210027p/pwang10/rota/espnet/egs2/owsm_v3.1/s2t1/exp/s2t_stats_raw_bpe50000_medium//valid/speech_shape, |
| [w010] 2025-05-22 06:05:59,902 (abs_task:1827) INFO: [valid] mini-batch sizes summary: N-batch=3220, mean=8.0, min=8, max=9 |
| [w010] 2025-05-22 06:05:59,992 (read_text:31) INFO: keys_to_load is not None, only loading 25766 keys from dump/raw/cgn_valid/text.prev |
| [w010] 2025-05-22 06:06:00,043 (read_text:31) INFO: keys_to_load is not None, only loading 25766 keys from dump/raw/cgn_valid/text.ctc |
| [w010] 2025-05-22 06:06:00,115 (read_text:31) INFO: keys_to_load is not None, only loading 25766 keys from dump/raw/cgn_valid/text |
| [w010] 2025-05-22 06:06:00,209 (s2t:444) INFO: Optional Data Names: ('text_prev', 'text_ctc', 'text_spk2', 'text_spk3', 'text_spk4') |
| [w010] 2025-05-22 06:06:00,209 (abs_task:1851) INFO: [valid] dataset: |
| ESPnetDataset( |
| speech: {"path": "dump/raw/cgn_valid/wav.scp", "type": "kaldi_ark"} |
| text_prev: {"path": "dump/raw/cgn_valid/text.prev", "type": "text"} |
| text_ctc: {"path": "dump/raw/cgn_valid/text.ctc", "type": "text"} |
| text: {"path": "dump/raw/cgn_valid/text", "type": "text"} |
| preprocess: <espnet2.train.preprocessor.S2TPreprocessor object at 0x147d0134bd00>) |
| [w010] 2025-05-22 06:06:29,000 (trainer:177) INFO: The training was resumed using exp/s2t_lora_2/checkpoint.pth |
| [w010] 2025-05-22 06:06:32,706 (trainer:336) INFO: 10/10epoch started |
| Failed to import Flash Attention, using ESPnet default: /ocean/projects/cis210027p/pwang10/miniconda3/envs/rota/lib/python3.10/site-packages/flash_attn_2_cuda.cpython-310-x86_64-linux-gnu.so: undefined symbol: _ZNK3c105Error4whatEv |
| [w010] 2025-05-22 06:11:44,505 (trainer:811) INFO: 10epoch:train:1-750batch: iter_time=0.001, forward_time=0.195, loss_ctc=52.649, loss_att=26.823, acc=0.794, loss=8.643, backward_time=0.183, grad_norm=33.032, clip=100.000, loss_scale=4.295e+09, optim_step_time=0.026, optim0_lr0=1.606e-04, train_time=1.662 |
| [w010] 2025-05-22 06:16:36,212 (trainer:811) INFO: 10epoch:train:751-1500batch: iter_time=1.414e-04, forward_time=0.175, loss_ctc=53.001, loss_att=27.259, acc=0.792, loss=8.745, backward_time=0.180, grad_norm=32.148, clip=100.000, loss_scale=7.151e+09, optim_step_time=0.023, optim0_lr0=1.599e-04, train_time=1.556 |
| [w010] 2025-05-22 06:21:28,172 (trainer:811) INFO: 10epoch:train:1501-2250batch: iter_time=1.342e-04, forward_time=0.175, loss_ctc=53.373, loss_att=27.494, acc=0.796, loss=8.814, backward_time=0.180, grad_norm=31.730, clip=100.000, loss_scale=8.590e+09, optim_step_time=0.023, optim0_lr0=1.592e-04, train_time=1.557 |
| [w010] 2025-05-22 06:26:20,190 (trainer:811) INFO: 10epoch:train:2251-3000batch: iter_time=1.312e-04, forward_time=0.175, loss_ctc=52.888, loss_att=27.156, acc=0.795, loss=8.719, backward_time=0.180, grad_norm=32.980, clip=100.000, loss_scale=8.590e+09, optim_step_time=0.024, optim0_lr0=1.585e-04, train_time=1.557 |
| [w010] 2025-05-22 06:31:12,225 (trainer:811) INFO: 10epoch:train:3001-3750batch: iter_time=1.332e-04, forward_time=0.175, loss_ctc=53.500, loss_att=27.397, acc=0.790, loss=8.807, backward_time=0.181, grad_norm=31.821, clip=100.000, loss_scale=8.590e+09, optim_step_time=0.023, optim0_lr0=1.578e-04, train_time=1.558 |
| [w010] 2025-05-22 06:36:04,448 (trainer:811) INFO: 10epoch:train:3751-4500batch: iter_time=1.357e-04, forward_time=0.175, loss_ctc=52.429, loss_att=26.906, acc=0.794, loss=8.641, backward_time=0.180, grad_norm=31.859, clip=100.000, loss_scale=8.590e+09, optim_step_time=0.023, optim0_lr0=1.571e-04, train_time=1.558 |
| [w010] 2025-05-22 06:40:56,299 (trainer:811) INFO: 10epoch:train:4501-5250batch: iter_time=1.361e-04, forward_time=0.175, loss_ctc=52.756, loss_att=27.137, acc=0.795, loss=8.706, backward_time=0.180, grad_norm=32.116, clip=100.000, loss_scale=8.590e+09, optim_step_time=0.023, optim0_lr0=1.564e-04, train_time=1.557 |
| [w010] 2025-05-22 06:45:48,238 (trainer:811) INFO: 10epoch:train:5251-6000batch: iter_time=1.462e-04, forward_time=0.175, loss_ctc=52.924, loss_att=27.060, acc=0.794, loss=8.705, backward_time=0.180, grad_norm=33.698, clip=100.000, loss_scale=8.590e+09, optim_step_time=0.023, optim0_lr0=1.557e-04, train_time=1.557 |
| [w010] 2025-05-22 06:50:40,153 (trainer:811) INFO: 10epoch:train:6001-6750batch: iter_time=1.408e-04, forward_time=0.175, loss_ctc=51.753, loss_att=26.608, acc=0.794, loss=8.538, backward_time=0.180, grad_norm=31.946, clip=100.000, loss_scale=8.590e+09, optim_step_time=0.023, optim0_lr0=1.550e-04, train_time=1.557 |
| [w010] 2025-05-22 06:55:32,420 (trainer:811) INFO: 10epoch:train:6751-7500batch: iter_time=1.376e-04, forward_time=0.175, loss_ctc=53.525, loss_att=27.433, acc=0.792, loss=8.815, backward_time=0.180, grad_norm=32.358, clip=100.000, loss_scale=8.590e+09, optim_step_time=0.024, optim0_lr0=1.543e-04, train_time=1.558 |
| [w010] 2025-05-22 07:00:24,454 (trainer:811) INFO: 10epoch:train:7501-8250batch: iter_time=1.503e-04, forward_time=0.175, loss_ctc=52.813, loss_att=27.087, acc=0.792, loss=8.701, backward_time=0.180, grad_norm=31.724, clip=100.000, loss_scale=8.590e+09, optim_step_time=0.023, optim0_lr0=1.535e-04, train_time=1.558 |
| [w010] 2025-05-22 07:05:16,609 (trainer:811) INFO: 10epoch:train:8251-9000batch: iter_time=1.440e-04, forward_time=0.175, loss_ctc=52.329, loss_att=26.912, acc=0.790, loss=8.634, backward_time=0.180, grad_norm=32.826, clip=100.000, loss_scale=8.590e+09, optim_step_time=0.023, optim0_lr0=1.528e-04, train_time=1.558 |
| [w010] 2025-05-22 07:10:08,613 (trainer:811) INFO: 10epoch:train:9001-9750batch: iter_time=1.392e-04, forward_time=0.175, loss_ctc=52.473, loss_att=26.945, acc=0.794, loss=8.651, backward_time=0.180, grad_norm=32.387, clip=100.000, loss_scale=1.718e+10, optim_step_time=0.023, optim0_lr0=1.521e-04, train_time=1.557 |
| [w010] 2025-05-22 07:15:06,622 (trainer:811) INFO: 10epoch:train:9751-10500batch: iter_time=2.150e-04, forward_time=0.178, loss_ctc=52.651, loss_att=26.990, acc=0.792, loss=8.672, backward_time=0.185, grad_norm=34.262, clip=100.000, loss_scale=1.718e+10, optim_step_time=0.024, optim0_lr0=1.514e-04, train_time=1.589 |
| [w010] 2025-05-22 07:19:58,673 (trainer:811) INFO: 10epoch:train:10501-11250batch: iter_time=1.515e-04, forward_time=0.175, loss_ctc=52.042, loss_att=26.677, acc=0.795, loss=8.572, backward_time=0.180, grad_norm=32.595, clip=100.000, loss_scale=1.718e+10, optim_step_time=0.023, optim0_lr0=1.507e-04, train_time=1.558 |
| [w010] 2025-05-22 07:24:50,819 (trainer:811) INFO: 10epoch:train:11251-12000batch: iter_time=1.467e-04, forward_time=0.175, loss_ctc=51.372, loss_att=26.309, acc=0.796, loss=8.457, backward_time=0.180, grad_norm=32.802, clip=100.000, loss_scale=1.718e+10, optim_step_time=0.023, optim0_lr0=1.500e-04, train_time=1.558 |
| [w010] 2025-05-22 07:29:43,242 (trainer:811) INFO: 10epoch:train:12001-12750batch: iter_time=1.430e-04, forward_time=0.175, loss_ctc=51.942, loss_att=26.860, acc=0.789, loss=8.596, backward_time=0.180, grad_norm=31.719, clip=100.000, loss_scale=1.718e+10, optim_step_time=0.024, optim0_lr0=1.493e-04, train_time=1.560 |
| [w010] 2025-05-22 07:34:35,572 (trainer:811) INFO: 10epoch:train:12751-13500batch: iter_time=1.492e-04, forward_time=0.175, loss_ctc=52.045, loss_att=26.692, acc=0.798, loss=8.574, backward_time=0.180, grad_norm=32.037, clip=100.000, loss_scale=1.718e+10, optim_step_time=0.023, optim0_lr0=1.486e-04, train_time=1.559 |
| [w010] 2025-05-22 07:39:27,841 (trainer:811) INFO: 10epoch:train:13501-14250batch: iter_time=1.602e-04, forward_time=0.175, loss_ctc=52.006, loss_att=26.704, acc=0.796, loss=8.574, backward_time=0.180, grad_norm=32.506, clip=100.000, loss_scale=1.718e+10, optim_step_time=0.023, optim0_lr0=1.479e-04, train_time=1.559 |
| [w010] 2025-05-22 07:44:19,831 (trainer:811) INFO: 10epoch:train:14251-15000batch: iter_time=1.532e-04, forward_time=0.175, loss_ctc=52.998, loss_att=27.192, acc=0.793, loss=8.733, backward_time=0.180, grad_norm=32.775, clip=100.000, loss_scale=1.718e+10, optim_step_time=0.023, optim0_lr0=1.472e-04, train_time=1.557 |
| [w010] 2025-05-22 07:52:05,739 (trainer:394) INFO: 10epoch results: [train] iter_time=2.026e-04, forward_time=0.176, loss_ctc=52.573, loss_att=26.982, acc=0.794, loss=8.665, backward_time=0.181, grad_norm=32.467, clip=100.000, loss_scale=1.174e+10, optim_step_time=0.023, optim0_lr0=1.539e-04, train_time=1.564, time=1 hour, 37 minutes and 47.34 seconds, total_count=150000, gpu_max_cached_mem_GB=43.805, [valid] loss_ctc=19.584, cer_ctc=0.104, loss_att=9.716, acc=0.893, cer=0.183, wer=1.000, loss=12.676, time=7 minutes and 45.41 seconds, total_count=32200, gpu_max_cached_mem_GB=43.805 |
| [w010] 2025-05-22 07:52:36,265 (trainer:462) INFO: The best model has been updated: valid.total_count |
| [w010] 2025-05-22 07:52:36,285 (trainer:516) INFO: The model files were removed: exp/s2t_lora_2/9epoch.pth |
| [w010] 2025-05-22 07:52:36,285 (trainer:534) INFO: The training was finished at 10 epochs |
| # Accounting: time=6616 threads=1 |
| # Ended (code 0) at Thu May 22 07:53:01 EDT 2025, elapsed time 6616 seconds |
|
|
