ms180 commited on
Commit
eb68f33
·
verified ·
1 Parent(s): 2789751

Upload folder using huggingface_hub

Browse files
bpe_30/train_tokenizer.log CHANGED
@@ -1,12 +1,12 @@
1
- 2026-01-13 23:22:06 | INFO | espnet3 | === ESPnet3 run started: 2026-01-13T23:22:06.727677 ===
2
- 2026-01-13 23:22:06 | INFO | espnet3 | Command: /data/user_data/msomeki/espnet3/.venv/bin/python3 run.py --stages create_dataset train_tokenizer collect_stats train infer measure --train_config conf/train.yaml --infer_config conf/infer.yaml --measure_config conf/measure.yaml
3
- 2026-01-13 23:22:06 | INFO | espnet3 | Python: 3.11.13 (main, Aug 18 2025, 19:19:13) [Clang 20.1.4 ]
4
- 2026-01-13 23:22:06 | INFO | espnet3 | Working directory: /home/msomeki/00_systems/espnet3/egs3/mini_an4/asr
5
- 2026-01-13 23:22:06 | INFO | espnet3 | train config: /home/msomeki/00_systems/espnet3/egs3/mini_an4/asr/conf/train_asr_rnn_data_aug_debug.yaml
6
- 2026-01-13 23:22:06 | INFO | espnet3 | infer config: /home/msomeki/00_systems/espnet3/egs3/mini_an4/asr/conf/infer.yaml
7
- 2026-01-13 23:22:06 | INFO | espnet3 | measure config: /home/msomeki/00_systems/espnet3/egs3/mini_an4/asr/conf/measure.yaml
8
- 2026-01-13 23:22:06 | INFO | espnet3 | Git: commit=8509faad9811b58d5024f29fb9d68ffb026b5e73, short_commit=8509faad9, branch=espnet3/recipe/asr_ls100, worktree=dirty
9
- 2026-01-13 23:22:06 | INFO | espnet3 | Cluster env:
10
  OMPI_MCA_plm_slurm_args=--external-launcher
11
  SLURM_CLUSTER_NAME=babel
12
  SLURM_CONF=/var/spool/slurmd/conf-cache/slurm.conf
@@ -65,11 +65,11 @@ SLURM_TOPOLOGY_ADDR=babel-o9-16
65
  SLURM_TOPOLOGY_ADDR_PATTERN=node
66
  SLURM_TRES_PER_TASK=cpu=1
67
  SLURM_UMASK=0027
68
- 2026-01-13 23:22:06 | INFO | espnet3 | Runtime env:
69
- LD_LIBRARY_PATH=/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:
70
  PATH=/home/msomeki/00_systems/espnet3/tools/ffmpeg-release:/home/msomeki/00_systems/espnet3/tools/festival/bin:/home/msomeki/00_systems/espnet3/tools/MBROLA/Bin:/home/msomeki/00_systems/espnet3/tools/espeak-ng/bin:/home/msomeki/00_systems/espnet3/tools/BeamformIt:/home/msomeki/00_systems/espnet3/tools/kenlm/build/bin:/home/msomeki/00_systems/espnet3/tools/PESQ/P862_annex_A_2005_CD/source:/home/msomeki/00_systems/espnet3/tools/nkf/nkf-2.1.4:/home/msomeki/00_systems/espnet3/tools/moses/scripts/tokenizer:/home/msomeki/00_systems/espnet3/tools/moses/scripts/generic:/home/msomeki/00_systems/espnet3/tools/tools/moses/scripts/recaser:/home/msomeki/00_systems/espnet3/tools/moses/scripts/training:/home/msomeki/00_systems/espnet3/tools/mwerSegmenter:/home/msomeki/00_systems/espnet3/tools/sctk/bin:/home/msomeki/00_systems/espnet3/tools/sph2pipe:/home/msomeki/00_systems/espnet3/tools/sentencepiece_commands:/data/user_data/msomeki/espnet3/.venv/bin:/home/msomeki/.pixi/bin:/home/msomeki/local/bin:/home/msomeki/utils:/usr/share/Modules/bin:/home/msomeki/00_systems/espnet3/tools/ffmpeg-release:/home/msomeki/00_systems/espnet3/tools/festival/bin:/home/msomeki/00_systems/espnet3/tools/MBROLA/Bin:/home/msomeki/00_systems/espnet3/tools/espeak-ng/bin:/home/msomeki/00_systems/espnet3/tools/BeamformIt:/home/msomeki/00_systems/espnet3/tools/kenlm/build/bin:/home/msomeki/00_systems/espnet3/tools/PESQ/P862_annex_A_2005_CD/source:/home/msomeki/00_systems/espnet3/tools/nkf/nkf-2.1.4:/home/msomeki/00_systems/espnet3/tools/moses/scripts/tokenizer:/home/msomeki/00_systems/espnet3/tools/moses/scripts/generic:/home/msomeki/00_systems/espnet3/tools/tools/moses/scripts/recaser:/home/msomeki/00_systems/espnet3/tools/moses/scripts/training:/home/msomeki/00_systems/espnet3/tools/mwerSegmenter:/home/msomeki/00_systems/espnet3/tools/sctk/bin:/home/msomeki/00_systems/espnet3/tools/sph2pipe:/home/msomeki/00_systems/espnet3/tools/sentencepiece_commands:/home/msomeki/00_systems/espnet3/tools/ffmpeg-release:/home/msomeki/00_systems/espnet3/tools/festival/bin:/home/msomeki/00_systems/espnet3/tools/MBROLA/Bin:/home/msomeki/00_systems/espnet3/tools/espeak-ng/bin:/home/msomeki/00_systems/espnet3/tools/BeamformIt:/home/msomeki/00_systems/espnet3/tools/kenlm/build/bin:/home/msomeki/00_systems/espnet3/tools/PESQ/P862_annex_A_2005_CD/source:/home/msomeki/00_systems/espnet3/tools/nkf/nkf-2.1.4:/home/msomeki/00_systems/espnet3/tools/moses/scripts/tokenizer:/home/msomeki/00_systems/espnet3/tools/moses/scripts/generic:/home/msomeki/00_systems/espnet3/tools/tools/moses/scripts/recaser:/home/msomeki/00_systems/espnet3/tools/moses/scripts/training:/home/msomeki/00_systems/espnet3/tools/mwerSegmenter:/home/msomeki/00_systems/espnet3/tools/sctk/bin:/home/msomeki/00_systems/espnet3/tools/sph2pipe:/home/msomeki/00_systems/espnet3/tools/sentencepiece_commands:/home/msomeki/.pixi/bin:/home/msomeki/local/bin:/home/msomeki/utils:/home/msomeki/.local/bin:/home/msomeki/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin
71
- PYTHONPATH=/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:
72
- 2026-01-13 23:22:06 | INFO | espnet3 | Train config content:
73
  num_device: 1
74
  num_nodes: 1
75
  task: espnet3.systems.asr.task.ASRTask
@@ -231,7 +231,7 @@ model:
231
  win_length: 400
232
  hop_length: 160
233
 
234
- 2026-01-13 23:22:07 | INFO | espnet3 | Infer config content:
235
  num_device: 1
236
  num_nodes: 1
237
  recipe_dir: .
@@ -263,7 +263,7 @@ tokenizer:
263
  model_type: bpe
264
  save_path: ./data/bpe_30
265
 
266
- 2026-01-13 23:22:07 | INFO | espnet3 | Measure config content:
267
  recipe_dir: .
268
  data_dir: ./data
269
  exp_tag: train_asr_rnn_data_aug_debug
@@ -286,6 +286,6 @@ metrics:
286
  _target_: espnet3.systems.asr.metrics.cer.CER
287
  clean_types: null
288
 
289
- 2026-01-13 23:22:07 | INFO | espnet3 | === [START] stage: train_tokenizer ===
290
- 2026-01-13 23:22:07 | INFO | espnet3.systems.asr.system | Tokenizer already exists. Skipping train_tokenizer().
291
- 2026-01-13 23:22:07 | INFO | espnet3 | === [DONE] stage: train_tokenizer (0.00s) ===
 
1
+ 2026-01-13 23:28:00 | INFO | espnet3 | === ESPnet3 run started: 2026-01-13T23:28:00.836459 ===
2
+ 2026-01-13 23:28:00 | INFO | espnet3 | Command: /data/user_data/msomeki/espnet3/.venv/bin/python3 run.py --stages create_dataset train_tokenizer collect_stats train infer measure --train_config conf/train.yaml --infer_config conf/infer.yaml --measure_config conf/measure.yaml
3
+ 2026-01-13 23:28:00 | INFO | espnet3 | Python: 3.11.13 (main, Aug 18 2025, 19:19:13) [Clang 20.1.4 ]
4
+ 2026-01-13 23:28:00 | INFO | espnet3 | Working directory: /home/msomeki/00_systems/espnet3/egs3/mini_an4/asr
5
+ 2026-01-13 23:28:00 | INFO | espnet3 | train config: /home/msomeki/00_systems/espnet3/egs3/mini_an4/asr/conf/train_asr_rnn_data_aug_debug.yaml
6
+ 2026-01-13 23:28:00 | INFO | espnet3 | infer config: /home/msomeki/00_systems/espnet3/egs3/mini_an4/asr/conf/infer.yaml
7
+ 2026-01-13 23:28:00 | INFO | espnet3 | measure config: /home/msomeki/00_systems/espnet3/egs3/mini_an4/asr/conf/measure.yaml
8
+ 2026-01-13 23:28:01 | INFO | espnet3 | Git: commit=8509faad9811b58d5024f29fb9d68ffb026b5e73, short_commit=8509faad9, branch=espnet3/recipe/asr_ls100, worktree=dirty
9
+ 2026-01-13 23:28:01 | INFO | espnet3 | Cluster env:
10
  OMPI_MCA_plm_slurm_args=--external-launcher
11
  SLURM_CLUSTER_NAME=babel
12
  SLURM_CONF=/var/spool/slurmd/conf-cache/slurm.conf
 
65
  SLURM_TOPOLOGY_ADDR_PATTERN=node
66
  SLURM_TRES_PER_TASK=cpu=1
67
  SLURM_UMASK=0027
68
+ 2026-01-13 23:28:01 | INFO | espnet3 | Runtime env:
69
+ LD_LIBRARY_PATH=/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:
70
  PATH=/home/msomeki/00_systems/espnet3/tools/ffmpeg-release:/home/msomeki/00_systems/espnet3/tools/festival/bin:/home/msomeki/00_systems/espnet3/tools/MBROLA/Bin:/home/msomeki/00_systems/espnet3/tools/espeak-ng/bin:/home/msomeki/00_systems/espnet3/tools/BeamformIt:/home/msomeki/00_systems/espnet3/tools/kenlm/build/bin:/home/msomeki/00_systems/espnet3/tools/PESQ/P862_annex_A_2005_CD/source:/home/msomeki/00_systems/espnet3/tools/nkf/nkf-2.1.4:/home/msomeki/00_systems/espnet3/tools/moses/scripts/tokenizer:/home/msomeki/00_systems/espnet3/tools/moses/scripts/generic:/home/msomeki/00_systems/espnet3/tools/tools/moses/scripts/recaser:/home/msomeki/00_systems/espnet3/tools/moses/scripts/training:/home/msomeki/00_systems/espnet3/tools/mwerSegmenter:/home/msomeki/00_systems/espnet3/tools/sctk/bin:/home/msomeki/00_systems/espnet3/tools/sph2pipe:/home/msomeki/00_systems/espnet3/tools/sentencepiece_commands:/data/user_data/msomeki/espnet3/.venv/bin:/home/msomeki/.pixi/bin:/home/msomeki/local/bin:/home/msomeki/utils:/usr/share/Modules/bin:/home/msomeki/00_systems/espnet3/tools/ffmpeg-release:/home/msomeki/00_systems/espnet3/tools/festival/bin:/home/msomeki/00_systems/espnet3/tools/MBROLA/Bin:/home/msomeki/00_systems/espnet3/tools/espeak-ng/bin:/home/msomeki/00_systems/espnet3/tools/BeamformIt:/home/msomeki/00_systems/espnet3/tools/kenlm/build/bin:/home/msomeki/00_systems/espnet3/tools/PESQ/P862_annex_A_2005_CD/source:/home/msomeki/00_systems/espnet3/tools/nkf/nkf-2.1.4:/home/msomeki/00_systems/espnet3/tools/moses/scripts/tokenizer:/home/msomeki/00_systems/espnet3/tools/moses/scripts/generic:/home/msomeki/00_systems/espnet3/tools/tools/moses/scripts/recaser:/home/msomeki/00_systems/espnet3/tools/moses/scripts/training:/home/msomeki/00_systems/espnet3/tools/mwerSegmenter:/home/msomeki/00_systems/espnet3/tools/sctk/bin:/home/msomeki/00_systems/espnet3/tools/sph2pipe:/home/msomeki/00_systems/espnet3/tools/sentencepiece_commands:/home/msomeki/00_systems/espnet3/tools/ffmpeg-release:/home/msomeki/00_systems/espnet3/tools/festival/bin:/home/msomeki/00_systems/espnet3/tools/MBROLA/Bin:/home/msomeki/00_systems/espnet3/tools/espeak-ng/bin:/home/msomeki/00_systems/espnet3/tools/BeamformIt:/home/msomeki/00_systems/espnet3/tools/kenlm/build/bin:/home/msomeki/00_systems/espnet3/tools/PESQ/P862_annex_A_2005_CD/source:/home/msomeki/00_systems/espnet3/tools/nkf/nkf-2.1.4:/home/msomeki/00_systems/espnet3/tools/moses/scripts/tokenizer:/home/msomeki/00_systems/espnet3/tools/moses/scripts/generic:/home/msomeki/00_systems/espnet3/tools/tools/moses/scripts/recaser:/home/msomeki/00_systems/espnet3/tools/moses/scripts/training:/home/msomeki/00_systems/espnet3/tools/mwerSegmenter:/home/msomeki/00_systems/espnet3/tools/sctk/bin:/home/msomeki/00_systems/espnet3/tools/sph2pipe:/home/msomeki/00_systems/espnet3/tools/sentencepiece_commands:/home/msomeki/.pixi/bin:/home/msomeki/local/bin:/home/msomeki/utils:/home/msomeki/.local/bin:/home/msomeki/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin
71
+ PYTHONPATH=/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:
72
+ 2026-01-13 23:28:01 | INFO | espnet3 | Train config content:
73
  num_device: 1
74
  num_nodes: 1
75
  task: espnet3.systems.asr.task.ASRTask
 
231
  win_length: 400
232
  hop_length: 160
233
 
234
+ 2026-01-13 23:28:01 | INFO | espnet3 | Infer config content:
235
  num_device: 1
236
  num_nodes: 1
237
  recipe_dir: .
 
263
  model_type: bpe
264
  save_path: ./data/bpe_30
265
 
266
+ 2026-01-13 23:28:01 | INFO | espnet3 | Measure config content:
267
  recipe_dir: .
268
  data_dir: ./data
269
  exp_tag: train_asr_rnn_data_aug_debug
 
286
  _target_: espnet3.systems.asr.metrics.cer.CER
287
  clean_types: null
288
 
289
+ 2026-01-13 23:28:01 | INFO | espnet3 | === [START] stage: train_tokenizer ===
290
+ 2026-01-13 23:28:01 | INFO | espnet3.systems.asr.system | Tokenizer already exists. Skipping train_tokenizer().
291
+ 2026-01-13 23:28:01 | INFO | espnet3 | === [DONE] stage: train_tokenizer (0.00s) ===
exp/epoch0_step1_valid.acc.ckpt CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:3101b1183af1df6b5271033698d613ced6a76927516bd9e3374de9870ee9df05
3
  size 1325498
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:430abc8aa726ab4ad6e6800bb3e115992ec0432d985a89e305f8f9abf7681ca8
3
  size 1325498
exp/last.ckpt CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:6dddc84f039f4f7ec625463bcebb7f44c3d169c07e8ecc443ce65ca910209eb8
3
  size 3813993
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c81299ba3b337456be422428a045a4582f77baec78740df51a3c8ff89cabacb4
3
  size 3813993
exp/pack_model.log CHANGED
@@ -1,11 +1,11 @@
1
- 2026-01-13 23:24:34 | INFO | espnet3 | === ESPnet3 run started: 2026-01-13T23:24:34.594498 ===
2
- 2026-01-13 23:24:34 | INFO | espnet3 | Command: /data/user_data/msomeki/espnet3/.venv/bin/python run.py --stage pack_model upload_model --publish_config conf/publish.yaml --train_config conf/train.yaml
3
- 2026-01-13 23:24:34 | INFO | espnet3 | Python: 3.11.13 (main, Aug 18 2025, 19:19:13) [Clang 20.1.4 ]
4
- 2026-01-13 23:24:34 | INFO | espnet3 | Working directory: /home/msomeki/00_systems/espnet3/egs3/mini_an4/asr
5
- 2026-01-13 23:24:34 | INFO | espnet3 | train config: /home/msomeki/00_systems/espnet3/egs3/mini_an4/asr/conf/train_asr_rnn_data_aug_debug.yaml
6
- 2026-01-13 23:24:34 | INFO | espnet3 | publish config: /home/msomeki/00_systems/espnet3/egs3/mini_an4/asr/conf/publish.yaml
7
- 2026-01-13 23:24:34 | INFO | espnet3 | Git: commit=8509faad9811b58d5024f29fb9d68ffb026b5e73, short_commit=8509faad9, branch=espnet3/recipe/asr_ls100, worktree=dirty
8
- 2026-01-13 23:24:34 | INFO | espnet3 | Cluster env:
9
  OMPI_MCA_plm_slurm_args=--external-launcher
10
  SLURM_CLUSTER_NAME=babel
11
  SLURM_CONF=/var/spool/slurmd/conf-cache/slurm.conf
@@ -64,11 +64,11 @@ SLURM_TOPOLOGY_ADDR=babel-o9-16
64
  SLURM_TOPOLOGY_ADDR_PATTERN=node
65
  SLURM_TRES_PER_TASK=cpu=1
66
  SLURM_UMASK=0027
67
- 2026-01-13 23:24:34 | INFO | espnet3 | Runtime env:
68
- LD_LIBRARY_PATH=/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:
69
  PATH=/home/msomeki/00_systems/espnet3/tools/ffmpeg-release:/home/msomeki/00_systems/espnet3/tools/festival/bin:/home/msomeki/00_systems/espnet3/tools/MBROLA/Bin:/home/msomeki/00_systems/espnet3/tools/espeak-ng/bin:/home/msomeki/00_systems/espnet3/tools/BeamformIt:/home/msomeki/00_systems/espnet3/tools/kenlm/build/bin:/home/msomeki/00_systems/espnet3/tools/PESQ/P862_annex_A_2005_CD/source:/home/msomeki/00_systems/espnet3/tools/nkf/nkf-2.1.4:/home/msomeki/00_systems/espnet3/tools/moses/scripts/tokenizer:/home/msomeki/00_systems/espnet3/tools/moses/scripts/generic:/home/msomeki/00_systems/espnet3/tools/tools/moses/scripts/recaser:/home/msomeki/00_systems/espnet3/tools/moses/scripts/training:/home/msomeki/00_systems/espnet3/tools/mwerSegmenter:/home/msomeki/00_systems/espnet3/tools/sctk/bin:/home/msomeki/00_systems/espnet3/tools/sph2pipe:/home/msomeki/00_systems/espnet3/tools/sentencepiece_commands:/data/user_data/msomeki/espnet3/.venv/bin:/home/msomeki/.pixi/bin:/home/msomeki/local/bin:/home/msomeki/utils:/usr/share/Modules/bin:/home/msomeki/00_systems/espnet3/tools/ffmpeg-release:/home/msomeki/00_systems/espnet3/tools/festival/bin:/home/msomeki/00_systems/espnet3/tools/MBROLA/Bin:/home/msomeki/00_systems/espnet3/tools/espeak-ng/bin:/home/msomeki/00_systems/espnet3/tools/BeamformIt:/home/msomeki/00_systems/espnet3/tools/kenlm/build/bin:/home/msomeki/00_systems/espnet3/tools/PESQ/P862_annex_A_2005_CD/source:/home/msomeki/00_systems/espnet3/tools/nkf/nkf-2.1.4:/home/msomeki/00_systems/espnet3/tools/moses/scripts/tokenizer:/home/msomeki/00_systems/espnet3/tools/moses/scripts/generic:/home/msomeki/00_systems/espnet3/tools/tools/moses/scripts/recaser:/home/msomeki/00_systems/espnet3/tools/moses/scripts/training:/home/msomeki/00_systems/espnet3/tools/mwerSegmenter:/home/msomeki/00_systems/espnet3/tools/sctk/bin:/home/msomeki/00_systems/espnet3/tools/sph2pipe:/home/msomeki/00_systems/espnet3/tools/sentencepiece_commands:/home/msomeki/00_systems/espnet3/tools/ffmpeg-release:/home/msomeki/00_systems/espnet3/tools/festival/bin:/home/msomeki/00_systems/espnet3/tools/MBROLA/Bin:/home/msomeki/00_systems/espnet3/tools/espeak-ng/bin:/home/msomeki/00_systems/espnet3/tools/BeamformIt:/home/msomeki/00_systems/espnet3/tools/kenlm/build/bin:/home/msomeki/00_systems/espnet3/tools/PESQ/P862_annex_A_2005_CD/source:/home/msomeki/00_systems/espnet3/tools/nkf/nkf-2.1.4:/home/msomeki/00_systems/espnet3/tools/moses/scripts/tokenizer:/home/msomeki/00_systems/espnet3/tools/moses/scripts/generic:/home/msomeki/00_systems/espnet3/tools/tools/moses/scripts/recaser:/home/msomeki/00_systems/espnet3/tools/moses/scripts/training:/home/msomeki/00_systems/espnet3/tools/mwerSegmenter:/home/msomeki/00_systems/espnet3/tools/sctk/bin:/home/msomeki/00_systems/espnet3/tools/sph2pipe:/home/msomeki/00_systems/espnet3/tools/sentencepiece_commands:/home/msomeki/.pixi/bin:/home/msomeki/local/bin:/home/msomeki/utils:/home/msomeki/.local/bin:/home/msomeki/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin
70
- PYTHONPATH=/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:
71
- 2026-01-13 23:24:35 | INFO | espnet3 | Train config content:
72
  num_device: 1
73
  num_nodes: 1
74
  task: espnet3.systems.asr.task.ASRTask
@@ -230,7 +230,7 @@ model:
230
  win_length: 400
231
  hop_length: 160
232
 
233
- 2026-01-13 23:24:35 | INFO | espnet3 | Publish config content:
234
  pack_model:
235
  strategy: auto
236
  out_dir: exp/model_pack
@@ -240,6 +240,10 @@ pack_model:
240
  - '**/*.log'
241
  - '**/tensorboard/**'
242
  - '**/wandb/**'
 
 
 
 
243
  espnet2:
244
  task: asr
245
  yaml_files: {}
@@ -248,4 +252,4 @@ pack_model:
248
  upload_model:
249
  hf_repo: ms180/mini_an4_integration_test
250
 
251
- 2026-01-13 23:24:35 | INFO | espnet3 | === [START] stage: pack_model ===
 
1
+ 2026-01-13 23:45:12 | INFO | espnet3 | === ESPnet3 run started: 2026-01-13T23:45:12.239969 ===
2
+ 2026-01-13 23:45:12 | INFO | espnet3 | Command: /data/user_data/msomeki/espnet3/.venv/bin/python run.py --stage pack_model --publish_config conf/publish.yaml --train_config conf/train.yaml
3
+ 2026-01-13 23:45:12 | INFO | espnet3 | Python: 3.11.13 (main, Aug 18 2025, 19:19:13) [Clang 20.1.4 ]
4
+ 2026-01-13 23:45:12 | INFO | espnet3 | Working directory: /home/msomeki/00_systems/espnet3/egs3/mini_an4/asr
5
+ 2026-01-13 23:45:12 | INFO | espnet3 | train config: /home/msomeki/00_systems/espnet3/egs3/mini_an4/asr/conf/train_asr_rnn_data_aug_debug.yaml
6
+ 2026-01-13 23:45:12 | INFO | espnet3 | publish config: /home/msomeki/00_systems/espnet3/egs3/mini_an4/asr/conf/publish.yaml
7
+ 2026-01-13 23:45:12 | INFO | espnet3 | Git: commit=8509faad9811b58d5024f29fb9d68ffb026b5e73, short_commit=8509faad9, branch=espnet3/recipe/asr_ls100, worktree=dirty
8
+ 2026-01-13 23:45:12 | INFO | espnet3 | Cluster env:
9
  OMPI_MCA_plm_slurm_args=--external-launcher
10
  SLURM_CLUSTER_NAME=babel
11
  SLURM_CONF=/var/spool/slurmd/conf-cache/slurm.conf
 
64
  SLURM_TOPOLOGY_ADDR_PATTERN=node
65
  SLURM_TRES_PER_TASK=cpu=1
66
  SLURM_UMASK=0027
67
+ 2026-01-13 23:45:12 | INFO | espnet3 | Runtime env:
68
+ LD_LIBRARY_PATH=/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:
69
  PATH=/home/msomeki/00_systems/espnet3/tools/ffmpeg-release:/home/msomeki/00_systems/espnet3/tools/festival/bin:/home/msomeki/00_systems/espnet3/tools/MBROLA/Bin:/home/msomeki/00_systems/espnet3/tools/espeak-ng/bin:/home/msomeki/00_systems/espnet3/tools/BeamformIt:/home/msomeki/00_systems/espnet3/tools/kenlm/build/bin:/home/msomeki/00_systems/espnet3/tools/PESQ/P862_annex_A_2005_CD/source:/home/msomeki/00_systems/espnet3/tools/nkf/nkf-2.1.4:/home/msomeki/00_systems/espnet3/tools/moses/scripts/tokenizer:/home/msomeki/00_systems/espnet3/tools/moses/scripts/generic:/home/msomeki/00_systems/espnet3/tools/tools/moses/scripts/recaser:/home/msomeki/00_systems/espnet3/tools/moses/scripts/training:/home/msomeki/00_systems/espnet3/tools/mwerSegmenter:/home/msomeki/00_systems/espnet3/tools/sctk/bin:/home/msomeki/00_systems/espnet3/tools/sph2pipe:/home/msomeki/00_systems/espnet3/tools/sentencepiece_commands:/data/user_data/msomeki/espnet3/.venv/bin:/home/msomeki/.pixi/bin:/home/msomeki/local/bin:/home/msomeki/utils:/usr/share/Modules/bin:/home/msomeki/00_systems/espnet3/tools/ffmpeg-release:/home/msomeki/00_systems/espnet3/tools/festival/bin:/home/msomeki/00_systems/espnet3/tools/MBROLA/Bin:/home/msomeki/00_systems/espnet3/tools/espeak-ng/bin:/home/msomeki/00_systems/espnet3/tools/BeamformIt:/home/msomeki/00_systems/espnet3/tools/kenlm/build/bin:/home/msomeki/00_systems/espnet3/tools/PESQ/P862_annex_A_2005_CD/source:/home/msomeki/00_systems/espnet3/tools/nkf/nkf-2.1.4:/home/msomeki/00_systems/espnet3/tools/moses/scripts/tokenizer:/home/msomeki/00_systems/espnet3/tools/moses/scripts/generic:/home/msomeki/00_systems/espnet3/tools/tools/moses/scripts/recaser:/home/msomeki/00_systems/espnet3/tools/moses/scripts/training:/home/msomeki/00_systems/espnet3/tools/mwerSegmenter:/home/msomeki/00_systems/espnet3/tools/sctk/bin:/home/msomeki/00_systems/espnet3/tools/sph2pipe:/home/msomeki/00_systems/espnet3/tools/sentencepiece_commands:/home/msomeki/00_systems/espnet3/tools/ffmpeg-release:/home/msomeki/00_systems/espnet3/tools/festival/bin:/home/msomeki/00_systems/espnet3/tools/MBROLA/Bin:/home/msomeki/00_systems/espnet3/tools/espeak-ng/bin:/home/msomeki/00_systems/espnet3/tools/BeamformIt:/home/msomeki/00_systems/espnet3/tools/kenlm/build/bin:/home/msomeki/00_systems/espnet3/tools/PESQ/P862_annex_A_2005_CD/source:/home/msomeki/00_systems/espnet3/tools/nkf/nkf-2.1.4:/home/msomeki/00_systems/espnet3/tools/moses/scripts/tokenizer:/home/msomeki/00_systems/espnet3/tools/moses/scripts/generic:/home/msomeki/00_systems/espnet3/tools/tools/moses/scripts/recaser:/home/msomeki/00_systems/espnet3/tools/moses/scripts/training:/home/msomeki/00_systems/espnet3/tools/mwerSegmenter:/home/msomeki/00_systems/espnet3/tools/sctk/bin:/home/msomeki/00_systems/espnet3/tools/sph2pipe:/home/msomeki/00_systems/espnet3/tools/sentencepiece_commands:/home/msomeki/.pixi/bin:/home/msomeki/local/bin:/home/msomeki/utils:/home/msomeki/.local/bin:/home/msomeki/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin
70
+ PYTHONPATH=/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:
71
+ 2026-01-13 23:45:12 | INFO | espnet3 | Train config content:
72
  num_device: 1
73
  num_nodes: 1
74
  task: espnet3.systems.asr.task.ASRTask
 
230
  win_length: 400
231
  hop_length: 160
232
 
233
+ 2026-01-13 23:45:12 | INFO | espnet3 | Publish config content:
234
  pack_model:
235
  strategy: auto
236
  out_dir: exp/model_pack
 
240
  - '**/*.log'
241
  - '**/tensorboard/**'
242
  - '**/wandb/**'
243
+ files:
244
+ asr_model_file: exp/train_asr_rnn_data_aug_debug/epoch0_step1_valid.acc.ckpt
245
+ yaml_files:
246
+ asr_train_config: exp/train_asr_rnn_data_aug_debug/config.yaml
247
  espnet2:
248
  task: asr
249
  yaml_files: {}
 
252
  upload_model:
253
  hf_repo: ms180/mini_an4_integration_test
254
 
255
+ 2026-01-13 23:45:12 | INFO | espnet3 | === [START] stage: pack_model ===
exp/pack_model1.log CHANGED
@@ -1,11 +1,11 @@
1
- 2026-01-13 23:23:03 | INFO | espnet3 | === ESPnet3 run started: 2026-01-13T23:23:03.228643 ===
2
- 2026-01-13 23:23:03 | INFO | espnet3 | Command: /data/user_data/msomeki/espnet3/.venv/bin/python run.py --stage pack_model upload_model --publish_config conf/publish.yaml --train_config conf/train.yaml
3
- 2026-01-13 23:23:03 | INFO | espnet3 | Python: 3.11.13 (main, Aug 18 2025, 19:19:13) [Clang 20.1.4 ]
4
- 2026-01-13 23:23:03 | INFO | espnet3 | Working directory: /home/msomeki/00_systems/espnet3/egs3/mini_an4/asr
5
- 2026-01-13 23:23:03 | INFO | espnet3 | train config: /home/msomeki/00_systems/espnet3/egs3/mini_an4/asr/conf/train_asr_rnn_data_aug_debug.yaml
6
- 2026-01-13 23:23:03 | INFO | espnet3 | publish config: /home/msomeki/00_systems/espnet3/egs3/mini_an4/asr/conf/publish.yaml
7
- 2026-01-13 23:23:03 | INFO | espnet3 | Git: commit=8509faad9811b58d5024f29fb9d68ffb026b5e73, short_commit=8509faad9, branch=espnet3/recipe/asr_ls100, worktree=dirty
8
- 2026-01-13 23:23:03 | INFO | espnet3 | Cluster env:
9
  OMPI_MCA_plm_slurm_args=--external-launcher
10
  SLURM_CLUSTER_NAME=babel
11
  SLURM_CONF=/var/spool/slurmd/conf-cache/slurm.conf
@@ -64,11 +64,11 @@ SLURM_TOPOLOGY_ADDR=babel-o9-16
64
  SLURM_TOPOLOGY_ADDR_PATTERN=node
65
  SLURM_TRES_PER_TASK=cpu=1
66
  SLURM_UMASK=0027
67
- 2026-01-13 23:23:03 | INFO | espnet3 | Runtime env:
68
- LD_LIBRARY_PATH=/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:
69
  PATH=/home/msomeki/00_systems/espnet3/tools/ffmpeg-release:/home/msomeki/00_systems/espnet3/tools/festival/bin:/home/msomeki/00_systems/espnet3/tools/MBROLA/Bin:/home/msomeki/00_systems/espnet3/tools/espeak-ng/bin:/home/msomeki/00_systems/espnet3/tools/BeamformIt:/home/msomeki/00_systems/espnet3/tools/kenlm/build/bin:/home/msomeki/00_systems/espnet3/tools/PESQ/P862_annex_A_2005_CD/source:/home/msomeki/00_systems/espnet3/tools/nkf/nkf-2.1.4:/home/msomeki/00_systems/espnet3/tools/moses/scripts/tokenizer:/home/msomeki/00_systems/espnet3/tools/moses/scripts/generic:/home/msomeki/00_systems/espnet3/tools/tools/moses/scripts/recaser:/home/msomeki/00_systems/espnet3/tools/moses/scripts/training:/home/msomeki/00_systems/espnet3/tools/mwerSegmenter:/home/msomeki/00_systems/espnet3/tools/sctk/bin:/home/msomeki/00_systems/espnet3/tools/sph2pipe:/home/msomeki/00_systems/espnet3/tools/sentencepiece_commands:/data/user_data/msomeki/espnet3/.venv/bin:/home/msomeki/.pixi/bin:/home/msomeki/local/bin:/home/msomeki/utils:/usr/share/Modules/bin:/home/msomeki/00_systems/espnet3/tools/ffmpeg-release:/home/msomeki/00_systems/espnet3/tools/festival/bin:/home/msomeki/00_systems/espnet3/tools/MBROLA/Bin:/home/msomeki/00_systems/espnet3/tools/espeak-ng/bin:/home/msomeki/00_systems/espnet3/tools/BeamformIt:/home/msomeki/00_systems/espnet3/tools/kenlm/build/bin:/home/msomeki/00_systems/espnet3/tools/PESQ/P862_annex_A_2005_CD/source:/home/msomeki/00_systems/espnet3/tools/nkf/nkf-2.1.4:/home/msomeki/00_systems/espnet3/tools/moses/scripts/tokenizer:/home/msomeki/00_systems/espnet3/tools/moses/scripts/generic:/home/msomeki/00_systems/espnet3/tools/tools/moses/scripts/recaser:/home/msomeki/00_systems/espnet3/tools/moses/scripts/training:/home/msomeki/00_systems/espnet3/tools/mwerSegmenter:/home/msomeki/00_systems/espnet3/tools/sctk/bin:/home/msomeki/00_systems/espnet3/tools/sph2pipe:/home/msomeki/00_systems/espnet3/tools/sentencepiece_commands:/home/msomeki/00_systems/espnet3/tools/ffmpeg-release:/home/msomeki/00_systems/espnet3/tools/festival/bin:/home/msomeki/00_systems/espnet3/tools/MBROLA/Bin:/home/msomeki/00_systems/espnet3/tools/espeak-ng/bin:/home/msomeki/00_systems/espnet3/tools/BeamformIt:/home/msomeki/00_systems/espnet3/tools/kenlm/build/bin:/home/msomeki/00_systems/espnet3/tools/PESQ/P862_annex_A_2005_CD/source:/home/msomeki/00_systems/espnet3/tools/nkf/nkf-2.1.4:/home/msomeki/00_systems/espnet3/tools/moses/scripts/tokenizer:/home/msomeki/00_systems/espnet3/tools/moses/scripts/generic:/home/msomeki/00_systems/espnet3/tools/tools/moses/scripts/recaser:/home/msomeki/00_systems/espnet3/tools/moses/scripts/training:/home/msomeki/00_systems/espnet3/tools/mwerSegmenter:/home/msomeki/00_systems/espnet3/tools/sctk/bin:/home/msomeki/00_systems/espnet3/tools/sph2pipe:/home/msomeki/00_systems/espnet3/tools/sentencepiece_commands:/home/msomeki/.pixi/bin:/home/msomeki/local/bin:/home/msomeki/utils:/home/msomeki/.local/bin:/home/msomeki/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin
70
- PYTHONPATH=/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:
71
- 2026-01-13 23:23:03 | INFO | espnet3 | Train config content:
72
  num_device: 1
73
  num_nodes: 1
74
  task: espnet3.systems.asr.task.ASRTask
@@ -230,7 +230,7 @@ model:
230
  win_length: 400
231
  hop_length: 160
232
 
233
- 2026-01-13 23:23:03 | INFO | espnet3 | Publish config content:
234
  pack_model:
235
  strategy: auto
236
  out_dir: exp/model_pack
@@ -240,6 +240,8 @@ pack_model:
240
  - '**/*.log'
241
  - '**/tensorboard/**'
242
  - '**/wandb/**'
 
 
243
  espnet2:
244
  task: asr
245
  yaml_files: {}
@@ -248,6 +250,6 @@ pack_model:
248
  upload_model:
249
  hf_repo: ms180/mini_an4_integration_test
250
 
251
- 2026-01-13 23:23:03 | INFO | espnet3 | === [START] stage: pack_model ===
252
- 2026-01-13 23:23:03 | INFO | espnet3.utils.publish | Packed model to exp/model_pack
253
- 2026-01-13 23:23:03 | INFO | espnet3 | === [DONE] stage: pack_model (0.04s) ===
 
1
+ 2026-01-13 23:29:44 | INFO | espnet3 | === ESPnet3 run started: 2026-01-13T23:29:44.576870 ===
2
+ 2026-01-13 23:29:44 | INFO | espnet3 | Command: /data/user_data/msomeki/espnet3/.venv/bin/python run.py --stage pack_model --publish_config conf/publish.yaml --train_config conf/train.yaml
3
+ 2026-01-13 23:29:44 | INFO | espnet3 | Python: 3.11.13 (main, Aug 18 2025, 19:19:13) [Clang 20.1.4 ]
4
+ 2026-01-13 23:29:44 | INFO | espnet3 | Working directory: /home/msomeki/00_systems/espnet3/egs3/mini_an4/asr
5
+ 2026-01-13 23:29:44 | INFO | espnet3 | train config: /home/msomeki/00_systems/espnet3/egs3/mini_an4/asr/conf/train_asr_rnn_data_aug_debug.yaml
6
+ 2026-01-13 23:29:44 | INFO | espnet3 | publish config: /home/msomeki/00_systems/espnet3/egs3/mini_an4/asr/conf/publish.yaml
7
+ 2026-01-13 23:29:45 | INFO | espnet3 | Git: commit=8509faad9811b58d5024f29fb9d68ffb026b5e73, short_commit=8509faad9, branch=espnet3/recipe/asr_ls100, worktree=dirty
8
+ 2026-01-13 23:29:45 | INFO | espnet3 | Cluster env:
9
  OMPI_MCA_plm_slurm_args=--external-launcher
10
  SLURM_CLUSTER_NAME=babel
11
  SLURM_CONF=/var/spool/slurmd/conf-cache/slurm.conf
 
64
  SLURM_TOPOLOGY_ADDR_PATTERN=node
65
  SLURM_TRES_PER_TASK=cpu=1
66
  SLURM_UMASK=0027
67
+ 2026-01-13 23:29:45 | INFO | espnet3 | Runtime env:
68
+ LD_LIBRARY_PATH=/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:
69
  PATH=/home/msomeki/00_systems/espnet3/tools/ffmpeg-release:/home/msomeki/00_systems/espnet3/tools/festival/bin:/home/msomeki/00_systems/espnet3/tools/MBROLA/Bin:/home/msomeki/00_systems/espnet3/tools/espeak-ng/bin:/home/msomeki/00_systems/espnet3/tools/BeamformIt:/home/msomeki/00_systems/espnet3/tools/kenlm/build/bin:/home/msomeki/00_systems/espnet3/tools/PESQ/P862_annex_A_2005_CD/source:/home/msomeki/00_systems/espnet3/tools/nkf/nkf-2.1.4:/home/msomeki/00_systems/espnet3/tools/moses/scripts/tokenizer:/home/msomeki/00_systems/espnet3/tools/moses/scripts/generic:/home/msomeki/00_systems/espnet3/tools/tools/moses/scripts/recaser:/home/msomeki/00_systems/espnet3/tools/moses/scripts/training:/home/msomeki/00_systems/espnet3/tools/mwerSegmenter:/home/msomeki/00_systems/espnet3/tools/sctk/bin:/home/msomeki/00_systems/espnet3/tools/sph2pipe:/home/msomeki/00_systems/espnet3/tools/sentencepiece_commands:/data/user_data/msomeki/espnet3/.venv/bin:/home/msomeki/.pixi/bin:/home/msomeki/local/bin:/home/msomeki/utils:/usr/share/Modules/bin:/home/msomeki/00_systems/espnet3/tools/ffmpeg-release:/home/msomeki/00_systems/espnet3/tools/festival/bin:/home/msomeki/00_systems/espnet3/tools/MBROLA/Bin:/home/msomeki/00_systems/espnet3/tools/espeak-ng/bin:/home/msomeki/00_systems/espnet3/tools/BeamformIt:/home/msomeki/00_systems/espnet3/tools/kenlm/build/bin:/home/msomeki/00_systems/espnet3/tools/PESQ/P862_annex_A_2005_CD/source:/home/msomeki/00_systems/espnet3/tools/nkf/nkf-2.1.4:/home/msomeki/00_systems/espnet3/tools/moses/scripts/tokenizer:/home/msomeki/00_systems/espnet3/tools/moses/scripts/generic:/home/msomeki/00_systems/espnet3/tools/tools/moses/scripts/recaser:/home/msomeki/00_systems/espnet3/tools/moses/scripts/training:/home/msomeki/00_systems/espnet3/tools/mwerSegmenter:/home/msomeki/00_systems/espnet3/tools/sctk/bin:/home/msomeki/00_systems/espnet3/tools/sph2pipe:/home/msomeki/00_systems/espnet3/tools/sentencepiece_commands:/home/msomeki/00_systems/espnet3/tools/ffmpeg-release:/home/msomeki/00_systems/espnet3/tools/festival/bin:/home/msomeki/00_systems/espnet3/tools/MBROLA/Bin:/home/msomeki/00_systems/espnet3/tools/espeak-ng/bin:/home/msomeki/00_systems/espnet3/tools/BeamformIt:/home/msomeki/00_systems/espnet3/tools/kenlm/build/bin:/home/msomeki/00_systems/espnet3/tools/PESQ/P862_annex_A_2005_CD/source:/home/msomeki/00_systems/espnet3/tools/nkf/nkf-2.1.4:/home/msomeki/00_systems/espnet3/tools/moses/scripts/tokenizer:/home/msomeki/00_systems/espnet3/tools/moses/scripts/generic:/home/msomeki/00_systems/espnet3/tools/tools/moses/scripts/recaser:/home/msomeki/00_systems/espnet3/tools/moses/scripts/training:/home/msomeki/00_systems/espnet3/tools/mwerSegmenter:/home/msomeki/00_systems/espnet3/tools/sctk/bin:/home/msomeki/00_systems/espnet3/tools/sph2pipe:/home/msomeki/00_systems/espnet3/tools/sentencepiece_commands:/home/msomeki/.pixi/bin:/home/msomeki/local/bin:/home/msomeki/utils:/home/msomeki/.local/bin:/home/msomeki/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin
70
+ PYTHONPATH=/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:
71
+ 2026-01-13 23:29:45 | INFO | espnet3 | Train config content:
72
  num_device: 1
73
  num_nodes: 1
74
  task: espnet3.systems.asr.task.ASRTask
 
230
  win_length: 400
231
  hop_length: 160
232
 
233
+ 2026-01-13 23:29:45 | INFO | espnet3 | Publish config content:
234
  pack_model:
235
  strategy: auto
236
  out_dir: exp/model_pack
 
240
  - '**/*.log'
241
  - '**/tensorboard/**'
242
  - '**/wandb/**'
243
+ files: {}
244
+ yaml_files: {}
245
  espnet2:
246
  task: asr
247
  yaml_files: {}
 
250
  upload_model:
251
  hf_repo: ms180/mini_an4_integration_test
252
 
253
+ 2026-01-13 23:29:45 | INFO | espnet3 | === [START] stage: pack_model ===
254
+ 2026-01-13 23:29:45 | INFO | espnet3.utils.publish | Packed model to exp/model_pack
255
+ 2026-01-13 23:29:45 | INFO | espnet3 | === [DONE] stage: pack_model (0.05s) ===
exp/step1.ckpt CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:6dddc84f039f4f7ec625463bcebb7f44c3d169c07e8ecc443ce65ca910209eb8
3
  size 3813993
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c81299ba3b337456be422428a045a4582f77baec78740df51a3c8ff89cabacb4
3
  size 3813993
exp/train.log CHANGED
@@ -1,12 +1,12 @@
1
- 2026-01-13 23:22:10 | INFO | espnet3 | === ESPnet3 run started: 2026-01-13T23:22:10.979705 ===
2
- 2026-01-13 23:22:10 | INFO | espnet3 | Command: /data/user_data/msomeki/espnet3/.venv/bin/python3 run.py --stages create_dataset train_tokenizer collect_stats train infer measure --train_config conf/train.yaml --infer_config conf/infer.yaml --measure_config conf/measure.yaml
3
- 2026-01-13 23:22:10 | INFO | espnet3 | Python: 3.11.13 (main, Aug 18 2025, 19:19:13) [Clang 20.1.4 ]
4
- 2026-01-13 23:22:10 | INFO | espnet3 | Working directory: /home/msomeki/00_systems/espnet3/egs3/mini_an4/asr
5
- 2026-01-13 23:22:10 | INFO | espnet3 | train config: /home/msomeki/00_systems/espnet3/egs3/mini_an4/asr/conf/train_asr_rnn_data_aug_debug.yaml
6
- 2026-01-13 23:22:10 | INFO | espnet3 | infer config: /home/msomeki/00_systems/espnet3/egs3/mini_an4/asr/conf/infer.yaml
7
- 2026-01-13 23:22:10 | INFO | espnet3 | measure config: /home/msomeki/00_systems/espnet3/egs3/mini_an4/asr/conf/measure.yaml
8
- 2026-01-13 23:22:11 | INFO | espnet3 | Git: commit=8509faad9811b58d5024f29fb9d68ffb026b5e73, short_commit=8509faad9, branch=espnet3/recipe/asr_ls100, worktree=dirty
9
- 2026-01-13 23:22:11 | INFO | espnet3 | Cluster env:
10
  OMPI_MCA_plm_slurm_args=--external-launcher
11
  SLURM_CLUSTER_NAME=babel
12
  SLURM_CONF=/var/spool/slurmd/conf-cache/slurm.conf
@@ -65,11 +65,11 @@ SLURM_TOPOLOGY_ADDR=babel-o9-16
65
  SLURM_TOPOLOGY_ADDR_PATTERN=node
66
  SLURM_TRES_PER_TASK=cpu=1
67
  SLURM_UMASK=0027
68
- 2026-01-13 23:22:11 | INFO | espnet3 | Runtime env:
69
- LD_LIBRARY_PATH=/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:
70
  PATH=/home/msomeki/00_systems/espnet3/tools/ffmpeg-release:/home/msomeki/00_systems/espnet3/tools/festival/bin:/home/msomeki/00_systems/espnet3/tools/MBROLA/Bin:/home/msomeki/00_systems/espnet3/tools/espeak-ng/bin:/home/msomeki/00_systems/espnet3/tools/BeamformIt:/home/msomeki/00_systems/espnet3/tools/kenlm/build/bin:/home/msomeki/00_systems/espnet3/tools/PESQ/P862_annex_A_2005_CD/source:/home/msomeki/00_systems/espnet3/tools/nkf/nkf-2.1.4:/home/msomeki/00_systems/espnet3/tools/moses/scripts/tokenizer:/home/msomeki/00_systems/espnet3/tools/moses/scripts/generic:/home/msomeki/00_systems/espnet3/tools/tools/moses/scripts/recaser:/home/msomeki/00_systems/espnet3/tools/moses/scripts/training:/home/msomeki/00_systems/espnet3/tools/mwerSegmenter:/home/msomeki/00_systems/espnet3/tools/sctk/bin:/home/msomeki/00_systems/espnet3/tools/sph2pipe:/home/msomeki/00_systems/espnet3/tools/sentencepiece_commands:/data/user_data/msomeki/espnet3/.venv/bin:/home/msomeki/.pixi/bin:/home/msomeki/local/bin:/home/msomeki/utils:/usr/share/Modules/bin:/home/msomeki/00_systems/espnet3/tools/ffmpeg-release:/home/msomeki/00_systems/espnet3/tools/festival/bin:/home/msomeki/00_systems/espnet3/tools/MBROLA/Bin:/home/msomeki/00_systems/espnet3/tools/espeak-ng/bin:/home/msomeki/00_systems/espnet3/tools/BeamformIt:/home/msomeki/00_systems/espnet3/tools/kenlm/build/bin:/home/msomeki/00_systems/espnet3/tools/PESQ/P862_annex_A_2005_CD/source:/home/msomeki/00_systems/espnet3/tools/nkf/nkf-2.1.4:/home/msomeki/00_systems/espnet3/tools/moses/scripts/tokenizer:/home/msomeki/00_systems/espnet3/tools/moses/scripts/generic:/home/msomeki/00_systems/espnet3/tools/tools/moses/scripts/recaser:/home/msomeki/00_systems/espnet3/tools/moses/scripts/training:/home/msomeki/00_systems/espnet3/tools/mwerSegmenter:/home/msomeki/00_systems/espnet3/tools/sctk/bin:/home/msomeki/00_systems/espnet3/tools/sph2pipe:/home/msomeki/00_systems/espnet3/tools/sentencepiece_commands:/home/msomeki/00_systems/espnet3/tools/ffmpeg-release:/home/msomeki/00_systems/espnet3/tools/festival/bin:/home/msomeki/00_systems/espnet3/tools/MBROLA/Bin:/home/msomeki/00_systems/espnet3/tools/espeak-ng/bin:/home/msomeki/00_systems/espnet3/tools/BeamformIt:/home/msomeki/00_systems/espnet3/tools/kenlm/build/bin:/home/msomeki/00_systems/espnet3/tools/PESQ/P862_annex_A_2005_CD/source:/home/msomeki/00_systems/espnet3/tools/nkf/nkf-2.1.4:/home/msomeki/00_systems/espnet3/tools/moses/scripts/tokenizer:/home/msomeki/00_systems/espnet3/tools/moses/scripts/generic:/home/msomeki/00_systems/espnet3/tools/tools/moses/scripts/recaser:/home/msomeki/00_systems/espnet3/tools/moses/scripts/training:/home/msomeki/00_systems/espnet3/tools/mwerSegmenter:/home/msomeki/00_systems/espnet3/tools/sctk/bin:/home/msomeki/00_systems/espnet3/tools/sph2pipe:/home/msomeki/00_systems/espnet3/tools/sentencepiece_commands:/home/msomeki/.pixi/bin:/home/msomeki/local/bin:/home/msomeki/utils:/home/msomeki/.local/bin:/home/msomeki/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin
71
- PYTHONPATH=/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:
72
- 2026-01-13 23:22:11 | INFO | espnet3 | Train config content:
73
  num_device: 1
74
  num_nodes: 1
75
  task: espnet3.systems.asr.task.ASRTask
@@ -226,7 +226,7 @@ model:
226
  win_length: 400
227
  hop_length: 160
228
 
229
- 2026-01-13 23:22:11 | INFO | espnet3 | Infer config content:
230
  num_device: 1
231
  num_nodes: 1
232
  recipe_dir: .
@@ -258,7 +258,7 @@ tokenizer:
258
  model_type: bpe
259
  save_path: ./data/bpe_30
260
 
261
- 2026-01-13 23:22:11 | INFO | espnet3 | Measure config content:
262
  recipe_dir: .
263
  data_dir: ./data
264
  exp_tag: train_asr_rnn_data_aug_debug
@@ -281,11 +281,11 @@ metrics:
281
  _target_: espnet3.systems.asr.metrics.cer.CER
282
  clean_types: null
283
 
284
- 2026-01-13 23:22:11 | INFO | espnet3 | === [START] stage: train ===
285
- 2026-01-13 23:22:11 | INFO | espnet3.systems.asr.system | ASRSystem.train(): starting training process
286
- 2026-01-13 23:22:11 | INFO | espnet3.systems.base.system | Training start | exp_dir=./exp/train_asr_rnn_data_aug_debug model=<unknown>
287
- 2026-01-13 23:22:11 | INFO | root | Vocabulary size: 30
288
- 2026-01-13 23:22:11 | INFO | espnet3.systems.base.train | Model:
289
  ESPnetASRModel(
290
  (frontend): DefaultFrontend(
291
  (stft): Stft(n_fft=512, win_length=400, hop_length=160, center=True, normalized=False, onesided=True)
@@ -335,15 +335,15 @@ ESPnetASRModel(
335
  (ctc_loss): CTCLoss()
336
  )
337
  )
338
- 2026-01-13 23:22:11 | WARNING | py.warnings | /data/user_data/msomeki/espnet3/.venv/lib/python3.11/site-packages/lightning/fabric/plugins/environments/slurm.py:204: The `srun` command is available on your system but is not used. HINT: If your intention is to run Lightning on SLURM, prepend your python command with `srun` like so: srun python3 run.py --stages create_dataset train_tokenizer coll ...
339
 
340
- 2026-01-13 23:22:11 | INFO | lightning.pytorch.utilities.rank_zero | GPU available: False, used: False
341
- 2026-01-13 23:22:11 | INFO | lightning.pytorch.utilities.rank_zero | TPU available: False, using: 0 TPU cores
342
- 2026-01-13 23:22:11 | INFO | lightning.pytorch.utilities.rank_zero | `Trainer(limit_train_batches=1)` was configured so 1 batch per epoch will be used.
343
- 2026-01-13 23:22:11 | INFO | lightning.pytorch.utilities.rank_zero | `Trainer(limit_val_batches=1)` was configured so 1 batch will be used.
344
- 2026-01-13 23:22:11 | WARNING | py.warnings | /data/user_data/msomeki/espnet3/.venv/lib/python3.11/site-packages/lightning/pytorch/callbacks/model_checkpoint.py:881: Checkpoint directory /home/msomeki/00_systems/espnet3/egs3/mini_an4/asr/exp/train_asr_rnn_data_aug_debug exists and is not empty.
345
 
346
- 2026-01-13 23:22:11 | INFO | lightning.pytorch.callbacks.model_summary |
347
  | Name | Type | Params | Mode | FLOPs
348
  ---------------------------------------------------------
349
  0 | model | ESPnetASRModel | 307 K | train | 0
@@ -355,17 +355,17 @@ ESPnetASRModel(
355
  35 Modules in train mode
356
  1 Modules in eval mode
357
  0 Total Flops
358
- 2026-01-13 23:22:11 | WARNING | py.warnings | /home/msomeki/00_systems/espnet3/espnet2/asr/espnet_model.py:402: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
359
  with autocast(self.autocast_frontend, dtype=autocast_type):
360
 
361
- 2026-01-13 23:22:11 | WARNING | root | Using make_pad_mask with a list of lengths is not tracable. If you try to trace this function with type(lengths) == list, please change the type of lengths to torch.LongTensor.
362
- 2026-01-13 23:22:11 | WARNING | root | Using make_pad_mask with a list of lengths is not tracable. If you try to trace this function with type(lengths) == list, please change the type of lengths to torch.LongTensor.
363
- 2026-01-13 23:22:11 | WARNING | py.warnings | /data/user_data/msomeki/espnet3/.venv/lib/python3.11/site-packages/lightning/pytorch/loops/fit_loop.py:534: Found 1 module(s) in eval mode at the start of training. This may lead to unexpected behavior during training. If this is intentional, you can ignore this warning.
364
 
365
- 2026-01-13 23:22:11 | WARNING | root | Using make_pad_mask with a list of lengths is not tracable. If you try to trace this function with type(lengths) == list, please change the type of lengths to torch.LongTensor.
366
- 2026-01-13 23:22:11 | WARNING | root | Using make_pad_mask with a list of lengths is not tracable. If you try to trace this function with type(lengths) == list, please change the type of lengths to torch.LongTensor.
367
- 2026-01-13 23:22:12 | WARNING | root | Using make_pad_mask with a list of lengths is not tracable. If you try to trace this function with type(lengths) == list, please change the type of lengths to torch.LongTensor.
368
- 2026-01-13 23:22:12 | WARNING | root | Using make_pad_mask with a list of lengths is not tracable. If you try to trace this function with type(lengths) == list, please change the type of lengths to torch.LongTensor.
369
- 2026-01-13 23:22:12 | INFO | lightning.pytorch.utilities.rank_zero | `Trainer.fit` stopped: `max_epochs=1` reached.
370
- 2026-01-13 23:22:12 | INFO | espnet3.systems.base.train | Training finished in 0.49s | exp_dir=./exp/train_asr_rnn_data_aug_debug model=None
371
- 2026-01-13 23:22:12 | INFO | espnet3 | === [DONE] stage: train (0.49s) ===
 
1
+ 2026-01-13 23:28:06 | INFO | espnet3 | === ESPnet3 run started: 2026-01-13T23:28:06.212771 ===
2
+ 2026-01-13 23:28:06 | INFO | espnet3 | Command: /data/user_data/msomeki/espnet3/.venv/bin/python3 run.py --stages create_dataset train_tokenizer collect_stats train infer measure --train_config conf/train.yaml --infer_config conf/infer.yaml --measure_config conf/measure.yaml
3
+ 2026-01-13 23:28:06 | INFO | espnet3 | Python: 3.11.13 (main, Aug 18 2025, 19:19:13) [Clang 20.1.4 ]
4
+ 2026-01-13 23:28:06 | INFO | espnet3 | Working directory: /home/msomeki/00_systems/espnet3/egs3/mini_an4/asr
5
+ 2026-01-13 23:28:06 | INFO | espnet3 | train config: /home/msomeki/00_systems/espnet3/egs3/mini_an4/asr/conf/train_asr_rnn_data_aug_debug.yaml
6
+ 2026-01-13 23:28:06 | INFO | espnet3 | infer config: /home/msomeki/00_systems/espnet3/egs3/mini_an4/asr/conf/infer.yaml
7
+ 2026-01-13 23:28:06 | INFO | espnet3 | measure config: /home/msomeki/00_systems/espnet3/egs3/mini_an4/asr/conf/measure.yaml
8
+ 2026-01-13 23:28:06 | INFO | espnet3 | Git: commit=8509faad9811b58d5024f29fb9d68ffb026b5e73, short_commit=8509faad9, branch=espnet3/recipe/asr_ls100, worktree=dirty
9
+ 2026-01-13 23:28:06 | INFO | espnet3 | Cluster env:
10
  OMPI_MCA_plm_slurm_args=--external-launcher
11
  SLURM_CLUSTER_NAME=babel
12
  SLURM_CONF=/var/spool/slurmd/conf-cache/slurm.conf
 
65
  SLURM_TOPOLOGY_ADDR_PATTERN=node
66
  SLURM_TRES_PER_TASK=cpu=1
67
  SLURM_UMASK=0027
68
+ 2026-01-13 23:28:06 | INFO | espnet3 | Runtime env:
69
+ LD_LIBRARY_PATH=/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:
70
  PATH=/home/msomeki/00_systems/espnet3/tools/ffmpeg-release:/home/msomeki/00_systems/espnet3/tools/festival/bin:/home/msomeki/00_systems/espnet3/tools/MBROLA/Bin:/home/msomeki/00_systems/espnet3/tools/espeak-ng/bin:/home/msomeki/00_systems/espnet3/tools/BeamformIt:/home/msomeki/00_systems/espnet3/tools/kenlm/build/bin:/home/msomeki/00_systems/espnet3/tools/PESQ/P862_annex_A_2005_CD/source:/home/msomeki/00_systems/espnet3/tools/nkf/nkf-2.1.4:/home/msomeki/00_systems/espnet3/tools/moses/scripts/tokenizer:/home/msomeki/00_systems/espnet3/tools/moses/scripts/generic:/home/msomeki/00_systems/espnet3/tools/tools/moses/scripts/recaser:/home/msomeki/00_systems/espnet3/tools/moses/scripts/training:/home/msomeki/00_systems/espnet3/tools/mwerSegmenter:/home/msomeki/00_systems/espnet3/tools/sctk/bin:/home/msomeki/00_systems/espnet3/tools/sph2pipe:/home/msomeki/00_systems/espnet3/tools/sentencepiece_commands:/data/user_data/msomeki/espnet3/.venv/bin:/home/msomeki/.pixi/bin:/home/msomeki/local/bin:/home/msomeki/utils:/usr/share/Modules/bin:/home/msomeki/00_systems/espnet3/tools/ffmpeg-release:/home/msomeki/00_systems/espnet3/tools/festival/bin:/home/msomeki/00_systems/espnet3/tools/MBROLA/Bin:/home/msomeki/00_systems/espnet3/tools/espeak-ng/bin:/home/msomeki/00_systems/espnet3/tools/BeamformIt:/home/msomeki/00_systems/espnet3/tools/kenlm/build/bin:/home/msomeki/00_systems/espnet3/tools/PESQ/P862_annex_A_2005_CD/source:/home/msomeki/00_systems/espnet3/tools/nkf/nkf-2.1.4:/home/msomeki/00_systems/espnet3/tools/moses/scripts/tokenizer:/home/msomeki/00_systems/espnet3/tools/moses/scripts/generic:/home/msomeki/00_systems/espnet3/tools/tools/moses/scripts/recaser:/home/msomeki/00_systems/espnet3/tools/moses/scripts/training:/home/msomeki/00_systems/espnet3/tools/mwerSegmenter:/home/msomeki/00_systems/espnet3/tools/sctk/bin:/home/msomeki/00_systems/espnet3/tools/sph2pipe:/home/msomeki/00_systems/espnet3/tools/sentencepiece_commands:/home/msomeki/00_systems/espnet3/tools/ffmpeg-release:/home/msomeki/00_systems/espnet3/tools/festival/bin:/home/msomeki/00_systems/espnet3/tools/MBROLA/Bin:/home/msomeki/00_systems/espnet3/tools/espeak-ng/bin:/home/msomeki/00_systems/espnet3/tools/BeamformIt:/home/msomeki/00_systems/espnet3/tools/kenlm/build/bin:/home/msomeki/00_systems/espnet3/tools/PESQ/P862_annex_A_2005_CD/source:/home/msomeki/00_systems/espnet3/tools/nkf/nkf-2.1.4:/home/msomeki/00_systems/espnet3/tools/moses/scripts/tokenizer:/home/msomeki/00_systems/espnet3/tools/moses/scripts/generic:/home/msomeki/00_systems/espnet3/tools/tools/moses/scripts/recaser:/home/msomeki/00_systems/espnet3/tools/moses/scripts/training:/home/msomeki/00_systems/espnet3/tools/mwerSegmenter:/home/msomeki/00_systems/espnet3/tools/sctk/bin:/home/msomeki/00_systems/espnet3/tools/sph2pipe:/home/msomeki/00_systems/espnet3/tools/sentencepiece_commands:/home/msomeki/.pixi/bin:/home/msomeki/local/bin:/home/msomeki/utils:/home/msomeki/.local/bin:/home/msomeki/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin
71
+ PYTHONPATH=/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:
72
+ 2026-01-13 23:28:06 | INFO | espnet3 | Train config content:
73
  num_device: 1
74
  num_nodes: 1
75
  task: espnet3.systems.asr.task.ASRTask
 
226
  win_length: 400
227
  hop_length: 160
228
 
229
+ 2026-01-13 23:28:06 | INFO | espnet3 | Infer config content:
230
  num_device: 1
231
  num_nodes: 1
232
  recipe_dir: .
 
258
  model_type: bpe
259
  save_path: ./data/bpe_30
260
 
261
+ 2026-01-13 23:28:06 | INFO | espnet3 | Measure config content:
262
  recipe_dir: .
263
  data_dir: ./data
264
  exp_tag: train_asr_rnn_data_aug_debug
 
281
  _target_: espnet3.systems.asr.metrics.cer.CER
282
  clean_types: null
283
 
284
+ 2026-01-13 23:28:06 | INFO | espnet3 | === [START] stage: train ===
285
+ 2026-01-13 23:28:06 | INFO | espnet3.systems.asr.system | ASRSystem.train(): starting training process
286
+ 2026-01-13 23:28:06 | INFO | espnet3.systems.base.system | Training start | exp_dir=./exp/train_asr_rnn_data_aug_debug model=<unknown>
287
+ 2026-01-13 23:28:06 | INFO | root | Vocabulary size: 30
288
+ 2026-01-13 23:28:06 | INFO | espnet3.systems.base.train | Model:
289
  ESPnetASRModel(
290
  (frontend): DefaultFrontend(
291
  (stft): Stft(n_fft=512, win_length=400, hop_length=160, center=True, normalized=False, onesided=True)
 
335
  (ctc_loss): CTCLoss()
336
  )
337
  )
338
+ 2026-01-13 23:28:06 | WARNING | py.warnings | /data/user_data/msomeki/espnet3/.venv/lib/python3.11/site-packages/lightning/fabric/plugins/environments/slurm.py:204: The `srun` command is available on your system but is not used. HINT: If your intention is to run Lightning on SLURM, prepend your python command with `srun` like so: srun python3 run.py --stages create_dataset train_tokenizer coll ...
339
 
340
+ 2026-01-13 23:28:06 | INFO | lightning.pytorch.utilities.rank_zero | GPU available: False, used: False
341
+ 2026-01-13 23:28:06 | INFO | lightning.pytorch.utilities.rank_zero | TPU available: False, using: 0 TPU cores
342
+ 2026-01-13 23:28:06 | INFO | lightning.pytorch.utilities.rank_zero | `Trainer(limit_train_batches=1)` was configured so 1 batch per epoch will be used.
343
+ 2026-01-13 23:28:06 | INFO | lightning.pytorch.utilities.rank_zero | `Trainer(limit_val_batches=1)` was configured so 1 batch will be used.
344
+ 2026-01-13 23:28:07 | WARNING | py.warnings | /data/user_data/msomeki/espnet3/.venv/lib/python3.11/site-packages/lightning/pytorch/callbacks/model_checkpoint.py:881: Checkpoint directory /home/msomeki/00_systems/espnet3/egs3/mini_an4/asr/exp/train_asr_rnn_data_aug_debug exists and is not empty.
345
 
346
+ 2026-01-13 23:28:07 | INFO | lightning.pytorch.callbacks.model_summary |
347
  | Name | Type | Params | Mode | FLOPs
348
  ---------------------------------------------------------
349
  0 | model | ESPnetASRModel | 307 K | train | 0
 
355
  35 Modules in train mode
356
  1 Modules in eval mode
357
  0 Total Flops
358
+ 2026-01-13 23:28:07 | WARNING | py.warnings | /home/msomeki/00_systems/espnet3/espnet2/asr/espnet_model.py:402: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
359
  with autocast(self.autocast_frontend, dtype=autocast_type):
360
 
361
+ 2026-01-13 23:28:07 | WARNING | root | Using make_pad_mask with a list of lengths is not tracable. If you try to trace this function with type(lengths) == list, please change the type of lengths to torch.LongTensor.
362
+ 2026-01-13 23:28:07 | WARNING | root | Using make_pad_mask with a list of lengths is not tracable. If you try to trace this function with type(lengths) == list, please change the type of lengths to torch.LongTensor.
363
+ 2026-01-13 23:28:07 | WARNING | py.warnings | /data/user_data/msomeki/espnet3/.venv/lib/python3.11/site-packages/lightning/pytorch/loops/fit_loop.py:534: Found 1 module(s) in eval mode at the start of training. This may lead to unexpected behavior during training. If this is intentional, you can ignore this warning.
364
 
365
+ 2026-01-13 23:28:07 | WARNING | root | Using make_pad_mask with a list of lengths is not tracable. If you try to trace this function with type(lengths) == list, please change the type of lengths to torch.LongTensor.
366
+ 2026-01-13 23:28:07 | WARNING | root | Using make_pad_mask with a list of lengths is not tracable. If you try to trace this function with type(lengths) == list, please change the type of lengths to torch.LongTensor.
367
+ 2026-01-13 23:28:07 | WARNING | root | Using make_pad_mask with a list of lengths is not tracable. If you try to trace this function with type(lengths) == list, please change the type of lengths to torch.LongTensor.
368
+ 2026-01-13 23:28:07 | WARNING | root | Using make_pad_mask with a list of lengths is not tracable. If you try to trace this function with type(lengths) == list, please change the type of lengths to torch.LongTensor.
369
+ 2026-01-13 23:28:07 | INFO | lightning.pytorch.utilities.rank_zero | `Trainer.fit` stopped: `max_epochs=1` reached.
370
+ 2026-01-13 23:28:07 | INFO | espnet3.systems.base.train | Training finished in 0.59s | exp_dir=./exp/train_asr_rnn_data_aug_debug model=None
371
+ 2026-01-13 23:28:07 | INFO | espnet3 | === [DONE] stage: train (0.60s) ===
meta.yaml CHANGED
@@ -1,16 +1,8 @@
1
- created_at: '2026-01-13T23:24:35.051895'
2
- pack_strategy: espnet3
3
- system: ASRSystem
4
- pack_spec:
5
- include:
6
- - exp/train_asr_rnn_data_aug_debug
7
- extra:
8
- - data/bpe_30
9
- - exp/stats
10
- exclude:
11
- - '[''**/*.log'', ''**/tensorboard/**'', ''**/wandb/**'']'
12
- - decode
13
- - decode_*
14
- - decode_dir
15
- - publish
16
- - model_pack
 
1
+ files:
2
+ asr_model_file: exp/train_asr_rnn_data_aug_debug/epoch0_step1_valid.acc.ckpt
3
+ yaml_files:
4
+ asr_train_config: exp/train_asr_rnn_data_aug_debug/config.yaml
5
+ timestamp: 1768365912.731334
6
+ python: 3.11.13 (main, Aug 18 2025, 19:19:13) [Clang 20.1.4 ]
7
+ torch: 2.9.1+cu128
8
+ espnet: '202511'
 
 
 
 
 
 
 
 
scores.json CHANGED
@@ -6,7 +6,7 @@
6
  },
7
  "espnet3.systems.asr.metrics.cer.CER": {
8
  "test": {
9
- "CER": 100.0
10
  }
11
  }
12
  }
 
6
  },
7
  "espnet3.systems.asr.metrics.cer.CER": {
8
  "test": {
9
+ "CER": 170.15
10
  }
11
  }
12
  }
stats/collect_stats.log CHANGED
@@ -1,12 +1,12 @@
1
- 2026-01-13 23:22:07 | INFO | espnet3 | === ESPnet3 run started: 2026-01-13T23:22:07.281340 ===
2
- 2026-01-13 23:22:07 | INFO | espnet3 | Command: /data/user_data/msomeki/espnet3/.venv/bin/python3 run.py --stages create_dataset train_tokenizer collect_stats train infer measure --train_config conf/train.yaml --infer_config conf/infer.yaml --measure_config conf/measure.yaml
3
- 2026-01-13 23:22:07 | INFO | espnet3 | Python: 3.11.13 (main, Aug 18 2025, 19:19:13) [Clang 20.1.4 ]
4
- 2026-01-13 23:22:07 | INFO | espnet3 | Working directory: /home/msomeki/00_systems/espnet3/egs3/mini_an4/asr
5
- 2026-01-13 23:22:07 | INFO | espnet3 | train config: /home/msomeki/00_systems/espnet3/egs3/mini_an4/asr/conf/train_asr_rnn_data_aug_debug.yaml
6
- 2026-01-13 23:22:07 | INFO | espnet3 | infer config: /home/msomeki/00_systems/espnet3/egs3/mini_an4/asr/conf/infer.yaml
7
- 2026-01-13 23:22:07 | INFO | espnet3 | measure config: /home/msomeki/00_systems/espnet3/egs3/mini_an4/asr/conf/measure.yaml
8
- 2026-01-13 23:22:07 | INFO | espnet3 | Git: commit=8509faad9811b58d5024f29fb9d68ffb026b5e73, short_commit=8509faad9, branch=espnet3/recipe/asr_ls100, worktree=dirty
9
- 2026-01-13 23:22:07 | INFO | espnet3 | Cluster env:
10
  OMPI_MCA_plm_slurm_args=--external-launcher
11
  SLURM_CLUSTER_NAME=babel
12
  SLURM_CONF=/var/spool/slurmd/conf-cache/slurm.conf
@@ -65,11 +65,11 @@ SLURM_TOPOLOGY_ADDR=babel-o9-16
65
  SLURM_TOPOLOGY_ADDR_PATTERN=node
66
  SLURM_TRES_PER_TASK=cpu=1
67
  SLURM_UMASK=0027
68
- 2026-01-13 23:22:07 | INFO | espnet3 | Runtime env:
69
- LD_LIBRARY_PATH=/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:
70
  PATH=/home/msomeki/00_systems/espnet3/tools/ffmpeg-release:/home/msomeki/00_systems/espnet3/tools/festival/bin:/home/msomeki/00_systems/espnet3/tools/MBROLA/Bin:/home/msomeki/00_systems/espnet3/tools/espeak-ng/bin:/home/msomeki/00_systems/espnet3/tools/BeamformIt:/home/msomeki/00_systems/espnet3/tools/kenlm/build/bin:/home/msomeki/00_systems/espnet3/tools/PESQ/P862_annex_A_2005_CD/source:/home/msomeki/00_systems/espnet3/tools/nkf/nkf-2.1.4:/home/msomeki/00_systems/espnet3/tools/moses/scripts/tokenizer:/home/msomeki/00_systems/espnet3/tools/moses/scripts/generic:/home/msomeki/00_systems/espnet3/tools/tools/moses/scripts/recaser:/home/msomeki/00_systems/espnet3/tools/moses/scripts/training:/home/msomeki/00_systems/espnet3/tools/mwerSegmenter:/home/msomeki/00_systems/espnet3/tools/sctk/bin:/home/msomeki/00_systems/espnet3/tools/sph2pipe:/home/msomeki/00_systems/espnet3/tools/sentencepiece_commands:/data/user_data/msomeki/espnet3/.venv/bin:/home/msomeki/.pixi/bin:/home/msomeki/local/bin:/home/msomeki/utils:/usr/share/Modules/bin:/home/msomeki/00_systems/espnet3/tools/ffmpeg-release:/home/msomeki/00_systems/espnet3/tools/festival/bin:/home/msomeki/00_systems/espnet3/tools/MBROLA/Bin:/home/msomeki/00_systems/espnet3/tools/espeak-ng/bin:/home/msomeki/00_systems/espnet3/tools/BeamformIt:/home/msomeki/00_systems/espnet3/tools/kenlm/build/bin:/home/msomeki/00_systems/espnet3/tools/PESQ/P862_annex_A_2005_CD/source:/home/msomeki/00_systems/espnet3/tools/nkf/nkf-2.1.4:/home/msomeki/00_systems/espnet3/tools/moses/scripts/tokenizer:/home/msomeki/00_systems/espnet3/tools/moses/scripts/generic:/home/msomeki/00_systems/espnet3/tools/tools/moses/scripts/recaser:/home/msomeki/00_systems/espnet3/tools/moses/scripts/training:/home/msomeki/00_systems/espnet3/tools/mwerSegmenter:/home/msomeki/00_systems/espnet3/tools/sctk/bin:/home/msomeki/00_systems/espnet3/tools/sph2pipe:/home/msomeki/00_systems/espnet3/tools/sentencepiece_commands:/home/msomeki/00_systems/espnet3/tools/ffmpeg-release:/home/msomeki/00_systems/espnet3/tools/festival/bin:/home/msomeki/00_systems/espnet3/tools/MBROLA/Bin:/home/msomeki/00_systems/espnet3/tools/espeak-ng/bin:/home/msomeki/00_systems/espnet3/tools/BeamformIt:/home/msomeki/00_systems/espnet3/tools/kenlm/build/bin:/home/msomeki/00_systems/espnet3/tools/PESQ/P862_annex_A_2005_CD/source:/home/msomeki/00_systems/espnet3/tools/nkf/nkf-2.1.4:/home/msomeki/00_systems/espnet3/tools/moses/scripts/tokenizer:/home/msomeki/00_systems/espnet3/tools/moses/scripts/generic:/home/msomeki/00_systems/espnet3/tools/tools/moses/scripts/recaser:/home/msomeki/00_systems/espnet3/tools/moses/scripts/training:/home/msomeki/00_systems/espnet3/tools/mwerSegmenter:/home/msomeki/00_systems/espnet3/tools/sctk/bin:/home/msomeki/00_systems/espnet3/tools/sph2pipe:/home/msomeki/00_systems/espnet3/tools/sentencepiece_commands:/home/msomeki/.pixi/bin:/home/msomeki/local/bin:/home/msomeki/utils:/home/msomeki/.local/bin:/home/msomeki/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin
71
- PYTHONPATH=/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:
72
- 2026-01-13 23:22:07 | INFO | espnet3 | Train config content:
73
  num_device: 1
74
  num_nodes: 1
75
  task: espnet3.systems.asr.task.ASRTask
@@ -231,7 +231,7 @@ model:
231
  win_length: 400
232
  hop_length: 160
233
 
234
- 2026-01-13 23:22:07 | INFO | espnet3 | Infer config content:
235
  num_device: 1
236
  num_nodes: 1
237
  recipe_dir: .
@@ -263,7 +263,7 @@ tokenizer:
263
  model_type: bpe
264
  save_path: ./data/bpe_30
265
 
266
- 2026-01-13 23:22:07 | INFO | espnet3 | Measure config content:
267
  recipe_dir: .
268
  data_dir: ./data
269
  exp_tag: train_asr_rnn_data_aug_debug
@@ -286,10 +286,10 @@ metrics:
286
  _target_: espnet3.systems.asr.metrics.cer.CER
287
  clean_types: null
288
 
289
- 2026-01-13 23:22:07 | INFO | espnet3 | === [START] stage: collect_stats ===
290
- 2026-01-13 23:22:07 | INFO | espnet3.systems.base.system | Collecting stats | exp_dir=./exp/train_asr_rnn_data_aug_debug stats_dir=./exp/stats
291
- 2026-01-13 23:22:10 | INFO | root | Vocabulary size: 30
292
- 2026-01-13 23:22:10 | INFO | espnet3.systems.base.train | Model:
293
  ESPnetASRModel(
294
  (frontend): DefaultFrontend(
295
  (stft): Stft(n_fft=512, win_length=400, hop_length=160, center=True, normalized=False, onesided=True)
@@ -339,13 +339,13 @@ ESPnetASRModel(
339
  (ctc_loss): CTCLoss()
340
  )
341
  )
342
- 2026-01-13 23:22:10 | WARNING | py.warnings | /data/user_data/msomeki/espnet3/.venv/lib/python3.11/site-packages/lightning/fabric/plugins/environments/slurm.py:204: The `srun` command is available on your system but is not used. HINT: If your intention is to run Lightning on SLURM, prepend your python command with `srun` like so: srun python3 run.py --stages create_dataset train_tokenizer coll ...
343
 
344
- 2026-01-13 23:22:10 | INFO | lightning.pytorch.utilities.rank_zero | GPU available: False, used: False
345
- 2026-01-13 23:22:10 | INFO | lightning.pytorch.utilities.rank_zero | TPU available: False, using: 0 TPU cores
346
- 2026-01-13 23:22:10 | INFO | lightning.pytorch.utilities.rank_zero | `Trainer(limit_train_batches=1)` was configured so 1 batch per epoch will be used.
347
- 2026-01-13 23:22:10 | INFO | lightning.pytorch.utilities.rank_zero | `Trainer(limit_val_batches=1)` was configured so 1 batch will be used.
348
- 2026-01-13 23:22:10 | INFO | root | Vocabulary size: 30
349
- 2026-01-13 23:22:10 | INFO | root | Vocabulary size: 30
350
- 2026-01-13 23:22:10 | INFO | espnet3.systems.base.train | Collect stats finished in 3.14s | exp_dir=./exp/train_asr_rnn_data_aug_debug stats_dir=./exp/stats
351
- 2026-01-13 23:22:10 | INFO | espnet3 | === [DONE] stage: collect_stats (3.15s) ===
 
1
+ 2026-01-13 23:28:01 | INFO | espnet3 | === ESPnet3 run started: 2026-01-13T23:28:01.399383 ===
2
+ 2026-01-13 23:28:01 | INFO | espnet3 | Command: /data/user_data/msomeki/espnet3/.venv/bin/python3 run.py --stages create_dataset train_tokenizer collect_stats train infer measure --train_config conf/train.yaml --infer_config conf/infer.yaml --measure_config conf/measure.yaml
3
+ 2026-01-13 23:28:01 | INFO | espnet3 | Python: 3.11.13 (main, Aug 18 2025, 19:19:13) [Clang 20.1.4 ]
4
+ 2026-01-13 23:28:01 | INFO | espnet3 | Working directory: /home/msomeki/00_systems/espnet3/egs3/mini_an4/asr
5
+ 2026-01-13 23:28:01 | INFO | espnet3 | train config: /home/msomeki/00_systems/espnet3/egs3/mini_an4/asr/conf/train_asr_rnn_data_aug_debug.yaml
6
+ 2026-01-13 23:28:01 | INFO | espnet3 | infer config: /home/msomeki/00_systems/espnet3/egs3/mini_an4/asr/conf/infer.yaml
7
+ 2026-01-13 23:28:01 | INFO | espnet3 | measure config: /home/msomeki/00_systems/espnet3/egs3/mini_an4/asr/conf/measure.yaml
8
+ 2026-01-13 23:28:01 | INFO | espnet3 | Git: commit=8509faad9811b58d5024f29fb9d68ffb026b5e73, short_commit=8509faad9, branch=espnet3/recipe/asr_ls100, worktree=dirty
9
+ 2026-01-13 23:28:01 | INFO | espnet3 | Cluster env:
10
  OMPI_MCA_plm_slurm_args=--external-launcher
11
  SLURM_CLUSTER_NAME=babel
12
  SLURM_CONF=/var/spool/slurmd/conf-cache/slurm.conf
 
65
  SLURM_TOPOLOGY_ADDR_PATTERN=node
66
  SLURM_TRES_PER_TASK=cpu=1
67
  SLURM_UMASK=0027
68
+ 2026-01-13 23:28:01 | INFO | espnet3 | Runtime env:
69
+ LD_LIBRARY_PATH=/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:
70
  PATH=/home/msomeki/00_systems/espnet3/tools/ffmpeg-release:/home/msomeki/00_systems/espnet3/tools/festival/bin:/home/msomeki/00_systems/espnet3/tools/MBROLA/Bin:/home/msomeki/00_systems/espnet3/tools/espeak-ng/bin:/home/msomeki/00_systems/espnet3/tools/BeamformIt:/home/msomeki/00_systems/espnet3/tools/kenlm/build/bin:/home/msomeki/00_systems/espnet3/tools/PESQ/P862_annex_A_2005_CD/source:/home/msomeki/00_systems/espnet3/tools/nkf/nkf-2.1.4:/home/msomeki/00_systems/espnet3/tools/moses/scripts/tokenizer:/home/msomeki/00_systems/espnet3/tools/moses/scripts/generic:/home/msomeki/00_systems/espnet3/tools/tools/moses/scripts/recaser:/home/msomeki/00_systems/espnet3/tools/moses/scripts/training:/home/msomeki/00_systems/espnet3/tools/mwerSegmenter:/home/msomeki/00_systems/espnet3/tools/sctk/bin:/home/msomeki/00_systems/espnet3/tools/sph2pipe:/home/msomeki/00_systems/espnet3/tools/sentencepiece_commands:/data/user_data/msomeki/espnet3/.venv/bin:/home/msomeki/.pixi/bin:/home/msomeki/local/bin:/home/msomeki/utils:/usr/share/Modules/bin:/home/msomeki/00_systems/espnet3/tools/ffmpeg-release:/home/msomeki/00_systems/espnet3/tools/festival/bin:/home/msomeki/00_systems/espnet3/tools/MBROLA/Bin:/home/msomeki/00_systems/espnet3/tools/espeak-ng/bin:/home/msomeki/00_systems/espnet3/tools/BeamformIt:/home/msomeki/00_systems/espnet3/tools/kenlm/build/bin:/home/msomeki/00_systems/espnet3/tools/PESQ/P862_annex_A_2005_CD/source:/home/msomeki/00_systems/espnet3/tools/nkf/nkf-2.1.4:/home/msomeki/00_systems/espnet3/tools/moses/scripts/tokenizer:/home/msomeki/00_systems/espnet3/tools/moses/scripts/generic:/home/msomeki/00_systems/espnet3/tools/tools/moses/scripts/recaser:/home/msomeki/00_systems/espnet3/tools/moses/scripts/training:/home/msomeki/00_systems/espnet3/tools/mwerSegmenter:/home/msomeki/00_systems/espnet3/tools/sctk/bin:/home/msomeki/00_systems/espnet3/tools/sph2pipe:/home/msomeki/00_systems/espnet3/tools/sentencepiece_commands:/home/msomeki/00_systems/espnet3/tools/ffmpeg-release:/home/msomeki/00_systems/espnet3/tools/festival/bin:/home/msomeki/00_systems/espnet3/tools/MBROLA/Bin:/home/msomeki/00_systems/espnet3/tools/espeak-ng/bin:/home/msomeki/00_systems/espnet3/tools/BeamformIt:/home/msomeki/00_systems/espnet3/tools/kenlm/build/bin:/home/msomeki/00_systems/espnet3/tools/PESQ/P862_annex_A_2005_CD/source:/home/msomeki/00_systems/espnet3/tools/nkf/nkf-2.1.4:/home/msomeki/00_systems/espnet3/tools/moses/scripts/tokenizer:/home/msomeki/00_systems/espnet3/tools/moses/scripts/generic:/home/msomeki/00_systems/espnet3/tools/tools/moses/scripts/recaser:/home/msomeki/00_systems/espnet3/tools/moses/scripts/training:/home/msomeki/00_systems/espnet3/tools/mwerSegmenter:/home/msomeki/00_systems/espnet3/tools/sctk/bin:/home/msomeki/00_systems/espnet3/tools/sph2pipe:/home/msomeki/00_systems/espnet3/tools/sentencepiece_commands:/home/msomeki/.pixi/bin:/home/msomeki/local/bin:/home/msomeki/utils:/home/msomeki/.local/bin:/home/msomeki/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin
71
+ PYTHONPATH=/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:
72
+ 2026-01-13 23:28:01 | INFO | espnet3 | Train config content:
73
  num_device: 1
74
  num_nodes: 1
75
  task: espnet3.systems.asr.task.ASRTask
 
231
  win_length: 400
232
  hop_length: 160
233
 
234
+ 2026-01-13 23:28:01 | INFO | espnet3 | Infer config content:
235
  num_device: 1
236
  num_nodes: 1
237
  recipe_dir: .
 
263
  model_type: bpe
264
  save_path: ./data/bpe_30
265
 
266
+ 2026-01-13 23:28:01 | INFO | espnet3 | Measure config content:
267
  recipe_dir: .
268
  data_dir: ./data
269
  exp_tag: train_asr_rnn_data_aug_debug
 
286
  _target_: espnet3.systems.asr.metrics.cer.CER
287
  clean_types: null
288
 
289
+ 2026-01-13 23:28:01 | INFO | espnet3 | === [START] stage: collect_stats ===
290
+ 2026-01-13 23:28:01 | INFO | espnet3.systems.base.system | Collecting stats | exp_dir=./exp/train_asr_rnn_data_aug_debug stats_dir=./exp/stats
291
+ 2026-01-13 23:28:04 | INFO | root | Vocabulary size: 30
292
+ 2026-01-13 23:28:04 | INFO | espnet3.systems.base.train | Model:
293
  ESPnetASRModel(
294
  (frontend): DefaultFrontend(
295
  (stft): Stft(n_fft=512, win_length=400, hop_length=160, center=True, normalized=False, onesided=True)
 
339
  (ctc_loss): CTCLoss()
340
  )
341
  )
342
+ 2026-01-13 23:28:05 | WARNING | py.warnings | /data/user_data/msomeki/espnet3/.venv/lib/python3.11/site-packages/lightning/fabric/plugins/environments/slurm.py:204: The `srun` command is available on your system but is not used. HINT: If your intention is to run Lightning on SLURM, prepend your python command with `srun` like so: srun python3 run.py --stages create_dataset train_tokenizer coll ...
343
 
344
+ 2026-01-13 23:28:05 | INFO | lightning.pytorch.utilities.rank_zero | GPU available: False, used: False
345
+ 2026-01-13 23:28:05 | INFO | lightning.pytorch.utilities.rank_zero | TPU available: False, using: 0 TPU cores
346
+ 2026-01-13 23:28:05 | INFO | lightning.pytorch.utilities.rank_zero | `Trainer(limit_train_batches=1)` was configured so 1 batch per epoch will be used.
347
+ 2026-01-13 23:28:05 | INFO | lightning.pytorch.utilities.rank_zero | `Trainer(limit_val_batches=1)` was configured so 1 batch will be used.
348
+ 2026-01-13 23:28:05 | INFO | root | Vocabulary size: 30
349
+ 2026-01-13 23:28:05 | INFO | root | Vocabulary size: 30
350
+ 2026-01-13 23:28:06 | INFO | espnet3.systems.base.train | Collect stats finished in 4.26s | exp_dir=./exp/train_asr_rnn_data_aug_debug stats_dir=./exp/stats
351
+ 2026-01-13 23:28:06 | INFO | espnet3 | === [DONE] stage: collect_stats (4.26s) ===
stats/train/feats_lengths_stats.npz CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:a62e05d942d39409a5da4bdad6a5b84fb2dbd3f4ec5b2420a78990f76592ef7e
3
  size 778
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cab907a2f7f90acd1cb4eccb76b566fd8f424d61127ef57411fcfa826f020ccb
3
  size 778
stats/train/feats_shape CHANGED
@@ -1,4 +1,4 @@
1
- 0 54,80
2
  1 281,80
3
- 2 91,80
4
  3 221,80
 
1
+ 0 71,80
2
  1 281,80
3
+ 2 112,80
4
  3 221,80
stats/train/feats_stats.npz CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e6d63d66215ee6d4e1188bbf5f055209fe4efe4430888ac7f68154b8f324cacd
3
  size 1402
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f2b596c53e5e807890ad1db575e71e313d59b987a87d05ddf27318688bf24361
3
  size 1402