Upload folder using huggingface_hub
Browse files- README.md +209 -0
- bpe_30/train_tokenizer.log +18 -18
- exp/epoch0_step1_valid.acc.ckpt +1 -1
- exp/last.ckpt +1 -1
- exp/pack_model.log +15 -14
- exp/pack_model1.log +21 -18
- exp/pack_model2.log +258 -0
- exp/pack_model3.log +258 -0
- exp/pack_model4.log +265 -0
- exp/pack_model5.log +258 -0
- exp/step1.ckpt +1 -1
- exp/train.log +38 -38
- meta.yaml +1 -1
- scores.json +1 -1
- stats/collect_stats.log +28 -28
- stats/train/feats_lengths_stats.npz +1 -1
- stats/train/feats_shape +3 -3
- stats/train/feats_stats.npz +1 -1
README.md
ADDED
|
@@ -0,0 +1,209 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
tags:
|
| 3 |
+
- espnet
|
| 4 |
+
- audio
|
| 5 |
+
---
|
| 6 |
+
|
| 7 |
+
|
| 8 |
+
Repository: `ms180/mini_an4_integration_test`
|
| 9 |
+
|
| 10 |
+
|
| 11 |
+
## Training
|
| 12 |
+
|
| 13 |
+
- System: `ASRSystem`
|
| 14 |
+
- Recipe: `mini_an4/asr`
|
| 15 |
+
- Creator: `ms180`
|
| 16 |
+
- Created: `2026-01-14T00:36:01.951598`
|
| 17 |
+
- Git: `8509faad9811b58d5024f29fb9d68ffb026b5e73` (dirty)
|
| 18 |
+
|
| 19 |
+
## Pack
|
| 20 |
+
|
| 21 |
+
- Archive: `model_pack`
|
| 22 |
+
- Strategy: `espnet3`
|
| 23 |
+
- Exp dir: `exp/train_asr_rnn_data_aug_debug`
|
| 24 |
+
|
| 25 |
+
|
| 26 |
+
## Train config
|
| 27 |
+
|
| 28 |
+
<details><summary>expand</summary>
|
| 29 |
+
|
| 30 |
+
```
|
| 31 |
+
num_device: 1
|
| 32 |
+
num_nodes: 1
|
| 33 |
+
task: espnet3.systems.asr.task.ASRTask
|
| 34 |
+
recipe_dir: .
|
| 35 |
+
data_dir: ./data
|
| 36 |
+
exp_tag: train_asr_rnn_data_aug_debug
|
| 37 |
+
exp_dir: ./exp/train_asr_rnn_data_aug_debug
|
| 38 |
+
stats_dir: ./exp/stats
|
| 39 |
+
decode_dir: ./exp/train_asr_rnn_data_aug_debug/decode
|
| 40 |
+
dataset_dir: ./data/mini_an4
|
| 41 |
+
create_dataset:
|
| 42 |
+
func: src.create_dataset.create_dataset
|
| 43 |
+
dataset_dir: ./data/mini_an4
|
| 44 |
+
archive_path: ./../../egs2/mini_an4/asr1/downloads.tar.gz
|
| 45 |
+
dataset:
|
| 46 |
+
_target_: espnet3.components.data.data_organizer.DataOrganizer
|
| 47 |
+
train:
|
| 48 |
+
- name: train_nodev
|
| 49 |
+
dataset:
|
| 50 |
+
_target_: src.dataset.MiniAN4Dataset
|
| 51 |
+
manifest_path: ./data/mini_an4/manifest/train_nodev.tsv
|
| 52 |
+
valid:
|
| 53 |
+
- name: train_dev
|
| 54 |
+
dataset:
|
| 55 |
+
_target_: src.dataset.MiniAN4Dataset
|
| 56 |
+
manifest_path: ./data/mini_an4/manifest/train_dev.tsv
|
| 57 |
+
preprocessor:
|
| 58 |
+
_target_: espnet2.train.preprocessor.CommonPreprocessor
|
| 59 |
+
_convert_: all
|
| 60 |
+
fs: 16000
|
| 61 |
+
train: true
|
| 62 |
+
data_aug_effects:
|
| 63 |
+
- - 0.1
|
| 64 |
+
- contrast
|
| 65 |
+
- enhancement_amount: 75.0
|
| 66 |
+
- - 0.1
|
| 67 |
+
- highpass
|
| 68 |
+
- cutoff_freq: 5000
|
| 69 |
+
Q: 0.707
|
| 70 |
+
- - 0.1
|
| 71 |
+
- equalization
|
| 72 |
+
- center_freq: 1000
|
| 73 |
+
gain: 0
|
| 74 |
+
Q: 0.707
|
| 75 |
+
- - 0.1
|
| 76 |
+
- - - 0.3
|
| 77 |
+
- speed_perturb
|
| 78 |
+
- factor: 0.9
|
| 79 |
+
- - 0.3
|
| 80 |
+
- speed_perturb
|
| 81 |
+
- factor: 1.1
|
| 82 |
+
- - 0.3
|
| 83 |
+
- speed_perturb
|
| 84 |
+
- factor: 1.3
|
| 85 |
+
data_aug_num:
|
| 86 |
+
- 1
|
| 87 |
+
- 4
|
| 88 |
+
data_aug_prob: 1.0
|
| 89 |
+
token_type: bpe
|
| 90 |
+
token_list: ./data/bpe_30/tokens.txt
|
| 91 |
+
bpemodel: ./data/bpe_30/bpe.model
|
| 92 |
+
parallel:
|
| 93 |
+
env: local
|
| 94 |
+
n_workers: 1
|
| 95 |
+
dataloader:
|
| 96 |
+
collate_fn:
|
| 97 |
+
_target_: espnet2.train.collate_fn.CommonCollateFn
|
| 98 |
+
int_pad_value: -1
|
| 99 |
+
train:
|
| 100 |
+
multiple_iterator: false
|
| 101 |
+
num_shards: 1
|
| 102 |
+
iter_factory:
|
| 103 |
+
_target_: espnet2.iterators.sequence_iter_factory.SequenceIterFactory
|
| 104 |
+
shuffle: true
|
| 105 |
+
collate_fn:
|
| 106 |
+
_target_: espnet2.train.collate_fn.CommonCollateFn
|
| 107 |
+
int_pad_value: -1
|
| 108 |
+
num_workers: 0
|
| 109 |
+
batches:
|
| 110 |
+
type: sorted
|
| 111 |
+
shape_files:
|
| 112 |
+
- ./exp/stats/train/feats_shape
|
| 113 |
+
batch_size: 2
|
| 114 |
+
batch_bins: 200000
|
| 115 |
+
valid:
|
| 116 |
+
multiple_iterator: false
|
| 117 |
+
num_shards: 1
|
| 118 |
+
iter_factory:
|
| 119 |
+
_target_: espnet2.iterators.sequence_iter_factory.SequenceIterFactory
|
| 120 |
+
shuffle: false
|
| 121 |
+
collate_fn:
|
| 122 |
+
_target_: espnet2.train.collate_fn.CommonCollateFn
|
| 123 |
+
int_pad_value: -1
|
| 124 |
+
batches:
|
| 125 |
+
type: sorted
|
| 126 |
+
shape_files:
|
| 127 |
+
- ./exp/stats/valid/feats_shape
|
| 128 |
+
batch_size: 2
|
| 129 |
+
batch_bins: 200000
|
| 130 |
+
optim:
|
| 131 |
+
_target_: torch.optim.Adam
|
| 132 |
+
lr: 0.001
|
| 133 |
+
weight_decay: 0.0
|
| 134 |
+
scheduler:
|
| 135 |
+
_target_: torch.optim.lr_scheduler.ReduceLROnPlateau
|
| 136 |
+
mode: min
|
| 137 |
+
factor: 0.5
|
| 138 |
+
patience: 1
|
| 139 |
+
val_scheduler_criterion: valid/loss
|
| 140 |
+
best_model_criterion:
|
| 141 |
+
- - valid/acc
|
| 142 |
+
- 1
|
| 143 |
+
- max
|
| 144 |
+
trainer:
|
| 145 |
+
accelerator: auto
|
| 146 |
+
devices: 1
|
| 147 |
+
num_nodes: 1
|
| 148 |
+
accumulate_grad_batches: 1
|
| 149 |
+
check_val_every_n_epoch: 1
|
| 150 |
+
gradient_clip_val: 1.0
|
| 151 |
+
log_every_n_steps: 1
|
| 152 |
+
max_epochs: 1
|
| 153 |
+
limit_train_batches: 1
|
| 154 |
+
limit_val_batches: 1
|
| 155 |
+
precision: 32
|
| 156 |
+
logger:
|
| 157 |
+
- _target_: lightning.pytorch.loggers.TensorBoardLogger
|
| 158 |
+
save_dir: ./exp/train_asr_rnn_data_aug_debug/tensorboard
|
| 159 |
+
name: tb_logger
|
| 160 |
+
strategy: auto
|
| 161 |
+
tokenizer:
|
| 162 |
+
vocab_size: 30
|
| 163 |
+
character_coverage: 1.0
|
| 164 |
+
model_type: bpe
|
| 165 |
+
save_path: ./data/bpe_30
|
| 166 |
+
text_builder:
|
| 167 |
+
func: src.tokenizer.gather_training_text
|
| 168 |
+
manifest_path: ./data/mini_an4/manifest/train_nodev.tsv
|
| 169 |
+
model:
|
| 170 |
+
vocab_size: 30
|
| 171 |
+
token_list: ./data/bpe_30/tokens.txt
|
| 172 |
+
encoder: vgg_rnn
|
| 173 |
+
encoder_conf:
|
| 174 |
+
num_layers: 1
|
| 175 |
+
hidden_size: 2
|
| 176 |
+
output_size: 2
|
| 177 |
+
decoder: rnn
|
| 178 |
+
decoder_conf:
|
| 179 |
+
hidden_size: 2
|
| 180 |
+
normalize: utterance_mvn
|
| 181 |
+
normalize_conf: {}
|
| 182 |
+
model_conf:
|
| 183 |
+
ctc_weight: 0.3
|
| 184 |
+
lsm_weight: 0.1
|
| 185 |
+
length_normalized_loss: false
|
| 186 |
+
frontend: default
|
| 187 |
+
frontend_conf:
|
| 188 |
+
n_fft: 512
|
| 189 |
+
win_length: 400
|
| 190 |
+
hop_length: 160
|
| 191 |
+
|
| 192 |
+
```
|
| 193 |
+
|
| 194 |
+
</details>
|
| 195 |
+
|
| 196 |
+
### Citing ESPnet
|
| 197 |
+
|
| 198 |
+
```
|
| 199 |
+
@inproceedings{watanabe2018espnet,
|
| 200 |
+
author={Shinji Watanabe and Takaaki Hori and Shigeki Karita and Tomoki Hayashi and
|
| 201 |
+
Jiro Nishitoba and Yuya Unno and Nelson Yalta and Jahn Heymann and Matthew Wiesner
|
| 202 |
+
and Nanxin Chen and Adithya Renduchintala and Tsubasa Ochiai},
|
| 203 |
+
title={{ESPnet}: End-to-End Speech Processing Toolkit},
|
| 204 |
+
year={2018},
|
| 205 |
+
booktitle={Proceedings of Interspeech},
|
| 206 |
+
pages={2207--2211},
|
| 207 |
+
doi={10.21437/Interspeech.2018-1456}
|
| 208 |
+
}
|
| 209 |
+
```
|
bpe_30/train_tokenizer.log
CHANGED
|
@@ -1,12 +1,12 @@
|
|
| 1 |
-
2026-01-
|
| 2 |
-
2026-01-
|
| 3 |
-
2026-01-
|
| 4 |
-
2026-01-
|
| 5 |
-
2026-01-
|
| 6 |
-
2026-01-
|
| 7 |
-
2026-01-
|
| 8 |
-
2026-01-
|
| 9 |
-
2026-01-
|
| 10 |
OMPI_MCA_plm_slurm_args=--external-launcher
|
| 11 |
SLURM_CLUSTER_NAME=babel
|
| 12 |
SLURM_CONF=/var/spool/slurmd/conf-cache/slurm.conf
|
|
@@ -65,11 +65,11 @@ SLURM_TOPOLOGY_ADDR=babel-o9-16
|
|
| 65 |
SLURM_TOPOLOGY_ADDR_PATTERN=node
|
| 66 |
SLURM_TRES_PER_TASK=cpu=1
|
| 67 |
SLURM_UMASK=0027
|
| 68 |
-
2026-01-
|
| 69 |
-
LD_LIBRARY_PATH=/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:
|
| 70 |
PATH=/home/msomeki/00_systems/espnet3/tools/ffmpeg-release:/home/msomeki/00_systems/espnet3/tools/festival/bin:/home/msomeki/00_systems/espnet3/tools/MBROLA/Bin:/home/msomeki/00_systems/espnet3/tools/espeak-ng/bin:/home/msomeki/00_systems/espnet3/tools/BeamformIt:/home/msomeki/00_systems/espnet3/tools/kenlm/build/bin:/home/msomeki/00_systems/espnet3/tools/PESQ/P862_annex_A_2005_CD/source:/home/msomeki/00_systems/espnet3/tools/nkf/nkf-2.1.4:/home/msomeki/00_systems/espnet3/tools/moses/scripts/tokenizer:/home/msomeki/00_systems/espnet3/tools/moses/scripts/generic:/home/msomeki/00_systems/espnet3/tools/tools/moses/scripts/recaser:/home/msomeki/00_systems/espnet3/tools/moses/scripts/training:/home/msomeki/00_systems/espnet3/tools/mwerSegmenter:/home/msomeki/00_systems/espnet3/tools/sctk/bin:/home/msomeki/00_systems/espnet3/tools/sph2pipe:/home/msomeki/00_systems/espnet3/tools/sentencepiece_commands:/data/user_data/msomeki/espnet3/.venv/bin:/home/msomeki/.pixi/bin:/home/msomeki/local/bin:/home/msomeki/utils:/usr/share/Modules/bin:/home/msomeki/00_systems/espnet3/tools/ffmpeg-release:/home/msomeki/00_systems/espnet3/tools/festival/bin:/home/msomeki/00_systems/espnet3/tools/MBROLA/Bin:/home/msomeki/00_systems/espnet3/tools/espeak-ng/bin:/home/msomeki/00_systems/espnet3/tools/BeamformIt:/home/msomeki/00_systems/espnet3/tools/kenlm/build/bin:/home/msomeki/00_systems/espnet3/tools/PESQ/P862_annex_A_2005_CD/source:/home/msomeki/00_systems/espnet3/tools/nkf/nkf-2.1.4:/home/msomeki/00_systems/espnet3/tools/moses/scripts/tokenizer:/home/msomeki/00_systems/espnet3/tools/moses/scripts/generic:/home/msomeki/00_systems/espnet3/tools/tools/moses/scripts/recaser:/home/msomeki/00_systems/espnet3/tools/moses/scripts/training:/home/msomeki/00_systems/espnet3/tools/mwerSegmenter:/home/msomeki/00_systems/espnet3/tools/sctk/bin:/home/msomeki/00_systems/espnet3/tools/sph2pipe:/home/msomeki/00_systems/espnet3/tools/sentencepiece_commands:/home/msomeki/00_systems/espnet3/tools/ffmpeg-release:/home/msomeki/00_systems/espnet3/tools/festival/bin:/home/msomeki/00_systems/espnet3/tools/MBROLA/Bin:/home/msomeki/00_systems/espnet3/tools/espeak-ng/bin:/home/msomeki/00_systems/espnet3/tools/BeamformIt:/home/msomeki/00_systems/espnet3/tools/kenlm/build/bin:/home/msomeki/00_systems/espnet3/tools/PESQ/P862_annex_A_2005_CD/source:/home/msomeki/00_systems/espnet3/tools/nkf/nkf-2.1.4:/home/msomeki/00_systems/espnet3/tools/moses/scripts/tokenizer:/home/msomeki/00_systems/espnet3/tools/moses/scripts/generic:/home/msomeki/00_systems/espnet3/tools/tools/moses/scripts/recaser:/home/msomeki/00_systems/espnet3/tools/moses/scripts/training:/home/msomeki/00_systems/espnet3/tools/mwerSegmenter:/home/msomeki/00_systems/espnet3/tools/sctk/bin:/home/msomeki/00_systems/espnet3/tools/sph2pipe:/home/msomeki/00_systems/espnet3/tools/sentencepiece_commands:/home/msomeki/.pixi/bin:/home/msomeki/local/bin:/home/msomeki/utils:/home/msomeki/.local/bin:/home/msomeki/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin
|
| 71 |
-
PYTHONPATH=/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:
|
| 72 |
-
2026-01-
|
| 73 |
num_device: 1
|
| 74 |
num_nodes: 1
|
| 75 |
task: espnet3.systems.asr.task.ASRTask
|
|
@@ -231,7 +231,7 @@ model:
|
|
| 231 |
win_length: 400
|
| 232 |
hop_length: 160
|
| 233 |
|
| 234 |
-
2026-01-
|
| 235 |
num_device: 1
|
| 236 |
num_nodes: 1
|
| 237 |
recipe_dir: .
|
|
@@ -263,7 +263,7 @@ tokenizer:
|
|
| 263 |
model_type: bpe
|
| 264 |
save_path: ./data/bpe_30
|
| 265 |
|
| 266 |
-
2026-01-
|
| 267 |
recipe_dir: .
|
| 268 |
data_dir: ./data
|
| 269 |
exp_tag: train_asr_rnn_data_aug_debug
|
|
@@ -286,6 +286,6 @@ metrics:
|
|
| 286 |
_target_: espnet3.systems.asr.metrics.cer.CER
|
| 287 |
clean_types: null
|
| 288 |
|
| 289 |
-
2026-01-
|
| 290 |
-
2026-01-
|
| 291 |
-
2026-01-
|
|
|
|
| 1 |
+
2026-01-14 00:19:10 | INFO | espnet3 | === ESPnet3 run started: 2026-01-14T00:19:10.756994 ===
|
| 2 |
+
2026-01-14 00:19:10 | INFO | espnet3 | Command: /data/user_data/msomeki/espnet3/.venv/bin/python3 run.py --stages create_dataset train_tokenizer collect_stats train infer measure --train_config conf/train.yaml --infer_config conf/infer.yaml --measure_config conf/measure.yaml
|
| 3 |
+
2026-01-14 00:19:10 | INFO | espnet3 | Python: 3.11.13 (main, Aug 18 2025, 19:19:13) [Clang 20.1.4 ]
|
| 4 |
+
2026-01-14 00:19:10 | INFO | espnet3 | Working directory: /home/msomeki/00_systems/espnet3/egs3/mini_an4/asr
|
| 5 |
+
2026-01-14 00:19:10 | INFO | espnet3 | train config: /home/msomeki/00_systems/espnet3/egs3/mini_an4/asr/conf/train_asr_rnn_data_aug_debug.yaml
|
| 6 |
+
2026-01-14 00:19:10 | INFO | espnet3 | infer config: /home/msomeki/00_systems/espnet3/egs3/mini_an4/asr/conf/infer.yaml
|
| 7 |
+
2026-01-14 00:19:10 | INFO | espnet3 | measure config: /home/msomeki/00_systems/espnet3/egs3/mini_an4/asr/conf/measure.yaml
|
| 8 |
+
2026-01-14 00:19:10 | INFO | espnet3 | Git: commit=8509faad9811b58d5024f29fb9d68ffb026b5e73, short_commit=8509faad9, branch=espnet3/recipe/asr_ls100, worktree=dirty
|
| 9 |
+
2026-01-14 00:19:10 | INFO | espnet3 | Cluster env:
|
| 10 |
OMPI_MCA_plm_slurm_args=--external-launcher
|
| 11 |
SLURM_CLUSTER_NAME=babel
|
| 12 |
SLURM_CONF=/var/spool/slurmd/conf-cache/slurm.conf
|
|
|
|
| 65 |
SLURM_TOPOLOGY_ADDR_PATTERN=node
|
| 66 |
SLURM_TRES_PER_TASK=cpu=1
|
| 67 |
SLURM_UMASK=0027
|
| 68 |
+
2026-01-14 00:19:10 | INFO | espnet3 | Runtime env:
|
| 69 |
+
LD_LIBRARY_PATH=/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:
|
| 70 |
PATH=/home/msomeki/00_systems/espnet3/tools/ffmpeg-release:/home/msomeki/00_systems/espnet3/tools/festival/bin:/home/msomeki/00_systems/espnet3/tools/MBROLA/Bin:/home/msomeki/00_systems/espnet3/tools/espeak-ng/bin:/home/msomeki/00_systems/espnet3/tools/BeamformIt:/home/msomeki/00_systems/espnet3/tools/kenlm/build/bin:/home/msomeki/00_systems/espnet3/tools/PESQ/P862_annex_A_2005_CD/source:/home/msomeki/00_systems/espnet3/tools/nkf/nkf-2.1.4:/home/msomeki/00_systems/espnet3/tools/moses/scripts/tokenizer:/home/msomeki/00_systems/espnet3/tools/moses/scripts/generic:/home/msomeki/00_systems/espnet3/tools/tools/moses/scripts/recaser:/home/msomeki/00_systems/espnet3/tools/moses/scripts/training:/home/msomeki/00_systems/espnet3/tools/mwerSegmenter:/home/msomeki/00_systems/espnet3/tools/sctk/bin:/home/msomeki/00_systems/espnet3/tools/sph2pipe:/home/msomeki/00_systems/espnet3/tools/sentencepiece_commands:/data/user_data/msomeki/espnet3/.venv/bin:/home/msomeki/.pixi/bin:/home/msomeki/local/bin:/home/msomeki/utils:/usr/share/Modules/bin:/home/msomeki/00_systems/espnet3/tools/ffmpeg-release:/home/msomeki/00_systems/espnet3/tools/festival/bin:/home/msomeki/00_systems/espnet3/tools/MBROLA/Bin:/home/msomeki/00_systems/espnet3/tools/espeak-ng/bin:/home/msomeki/00_systems/espnet3/tools/BeamformIt:/home/msomeki/00_systems/espnet3/tools/kenlm/build/bin:/home/msomeki/00_systems/espnet3/tools/PESQ/P862_annex_A_2005_CD/source:/home/msomeki/00_systems/espnet3/tools/nkf/nkf-2.1.4:/home/msomeki/00_systems/espnet3/tools/moses/scripts/tokenizer:/home/msomeki/00_systems/espnet3/tools/moses/scripts/generic:/home/msomeki/00_systems/espnet3/tools/tools/moses/scripts/recaser:/home/msomeki/00_systems/espnet3/tools/moses/scripts/training:/home/msomeki/00_systems/espnet3/tools/mwerSegmenter:/home/msomeki/00_systems/espnet3/tools/sctk/bin:/home/msomeki/00_systems/espnet3/tools/sph2pipe:/home/msomeki/00_systems/espnet3/tools/sentencepiece_commands:/home/msomeki/00_systems/espnet3/tools/ffmpeg-release:/home/msomeki/00_systems/espnet3/tools/festival/bin:/home/msomeki/00_systems/espnet3/tools/MBROLA/Bin:/home/msomeki/00_systems/espnet3/tools/espeak-ng/bin:/home/msomeki/00_systems/espnet3/tools/BeamformIt:/home/msomeki/00_systems/espnet3/tools/kenlm/build/bin:/home/msomeki/00_systems/espnet3/tools/PESQ/P862_annex_A_2005_CD/source:/home/msomeki/00_systems/espnet3/tools/nkf/nkf-2.1.4:/home/msomeki/00_systems/espnet3/tools/moses/scripts/tokenizer:/home/msomeki/00_systems/espnet3/tools/moses/scripts/generic:/home/msomeki/00_systems/espnet3/tools/tools/moses/scripts/recaser:/home/msomeki/00_systems/espnet3/tools/moses/scripts/training:/home/msomeki/00_systems/espnet3/tools/mwerSegmenter:/home/msomeki/00_systems/espnet3/tools/sctk/bin:/home/msomeki/00_systems/espnet3/tools/sph2pipe:/home/msomeki/00_systems/espnet3/tools/sentencepiece_commands:/home/msomeki/.pixi/bin:/home/msomeki/local/bin:/home/msomeki/utils:/home/msomeki/.local/bin:/home/msomeki/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin
|
| 71 |
+
PYTHONPATH=/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:
|
| 72 |
+
2026-01-14 00:19:11 | INFO | espnet3 | Train config content:
|
| 73 |
num_device: 1
|
| 74 |
num_nodes: 1
|
| 75 |
task: espnet3.systems.asr.task.ASRTask
|
|
|
|
| 231 |
win_length: 400
|
| 232 |
hop_length: 160
|
| 233 |
|
| 234 |
+
2026-01-14 00:19:11 | INFO | espnet3 | Infer config content:
|
| 235 |
num_device: 1
|
| 236 |
num_nodes: 1
|
| 237 |
recipe_dir: .
|
|
|
|
| 263 |
model_type: bpe
|
| 264 |
save_path: ./data/bpe_30
|
| 265 |
|
| 266 |
+
2026-01-14 00:19:11 | INFO | espnet3 | Measure config content:
|
| 267 |
recipe_dir: .
|
| 268 |
data_dir: ./data
|
| 269 |
exp_tag: train_asr_rnn_data_aug_debug
|
|
|
|
| 286 |
_target_: espnet3.systems.asr.metrics.cer.CER
|
| 287 |
clean_types: null
|
| 288 |
|
| 289 |
+
2026-01-14 00:19:11 | INFO | espnet3 | === [START] stage: train_tokenizer ===
|
| 290 |
+
2026-01-14 00:19:11 | INFO | espnet3.systems.asr.system | Tokenizer already exists. Skipping train_tokenizer().
|
| 291 |
+
2026-01-14 00:19:11 | INFO | espnet3 | === [DONE] stage: train_tokenizer (0.03s) ===
|
exp/epoch0_step1_valid.acc.ckpt
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 1325498
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:501c20a668e51bc01fc70f2ca4433ba3cf4de6c74fea68cdee62de8c104e37d0
|
| 3 |
size 1325498
|
exp/last.ckpt
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 3813993
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:3660995efc92eddb8814cb11b32d1b6f7387e30ffa5414efc175c167323052c3
|
| 3 |
size 3813993
|
exp/pack_model.log
CHANGED
|
@@ -1,11 +1,11 @@
|
|
| 1 |
-
2026-01-
|
| 2 |
-
2026-01-
|
| 3 |
-
2026-01-
|
| 4 |
-
2026-01-
|
| 5 |
-
2026-01-
|
| 6 |
-
2026-01-
|
| 7 |
-
2026-01-
|
| 8 |
-
2026-01-
|
| 9 |
OMPI_MCA_plm_slurm_args=--external-launcher
|
| 10 |
SLURM_CLUSTER_NAME=babel
|
| 11 |
SLURM_CONF=/var/spool/slurmd/conf-cache/slurm.conf
|
|
@@ -64,11 +64,11 @@ SLURM_TOPOLOGY_ADDR=babel-o9-16
|
|
| 64 |
SLURM_TOPOLOGY_ADDR_PATTERN=node
|
| 65 |
SLURM_TRES_PER_TASK=cpu=1
|
| 66 |
SLURM_UMASK=0027
|
| 67 |
-
2026-01-
|
| 68 |
-
LD_LIBRARY_PATH=/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:
|
| 69 |
PATH=/home/msomeki/00_systems/espnet3/tools/ffmpeg-release:/home/msomeki/00_systems/espnet3/tools/festival/bin:/home/msomeki/00_systems/espnet3/tools/MBROLA/Bin:/home/msomeki/00_systems/espnet3/tools/espeak-ng/bin:/home/msomeki/00_systems/espnet3/tools/BeamformIt:/home/msomeki/00_systems/espnet3/tools/kenlm/build/bin:/home/msomeki/00_systems/espnet3/tools/PESQ/P862_annex_A_2005_CD/source:/home/msomeki/00_systems/espnet3/tools/nkf/nkf-2.1.4:/home/msomeki/00_systems/espnet3/tools/moses/scripts/tokenizer:/home/msomeki/00_systems/espnet3/tools/moses/scripts/generic:/home/msomeki/00_systems/espnet3/tools/tools/moses/scripts/recaser:/home/msomeki/00_systems/espnet3/tools/moses/scripts/training:/home/msomeki/00_systems/espnet3/tools/mwerSegmenter:/home/msomeki/00_systems/espnet3/tools/sctk/bin:/home/msomeki/00_systems/espnet3/tools/sph2pipe:/home/msomeki/00_systems/espnet3/tools/sentencepiece_commands:/data/user_data/msomeki/espnet3/.venv/bin:/home/msomeki/.pixi/bin:/home/msomeki/local/bin:/home/msomeki/utils:/usr/share/Modules/bin:/home/msomeki/00_systems/espnet3/tools/ffmpeg-release:/home/msomeki/00_systems/espnet3/tools/festival/bin:/home/msomeki/00_systems/espnet3/tools/MBROLA/Bin:/home/msomeki/00_systems/espnet3/tools/espeak-ng/bin:/home/msomeki/00_systems/espnet3/tools/BeamformIt:/home/msomeki/00_systems/espnet3/tools/kenlm/build/bin:/home/msomeki/00_systems/espnet3/tools/PESQ/P862_annex_A_2005_CD/source:/home/msomeki/00_systems/espnet3/tools/nkf/nkf-2.1.4:/home/msomeki/00_systems/espnet3/tools/moses/scripts/tokenizer:/home/msomeki/00_systems/espnet3/tools/moses/scripts/generic:/home/msomeki/00_systems/espnet3/tools/tools/moses/scripts/recaser:/home/msomeki/00_systems/espnet3/tools/moses/scripts/training:/home/msomeki/00_systems/espnet3/tools/mwerSegmenter:/home/msomeki/00_systems/espnet3/tools/sctk/bin:/home/msomeki/00_systems/espnet3/tools/sph2pipe:/home/msomeki/00_systems/espnet3/tools/sentencepiece_commands:/home/msomeki/00_systems/espnet3/tools/ffmpeg-release:/home/msomeki/00_systems/espnet3/tools/festival/bin:/home/msomeki/00_systems/espnet3/tools/MBROLA/Bin:/home/msomeki/00_systems/espnet3/tools/espeak-ng/bin:/home/msomeki/00_systems/espnet3/tools/BeamformIt:/home/msomeki/00_systems/espnet3/tools/kenlm/build/bin:/home/msomeki/00_systems/espnet3/tools/PESQ/P862_annex_A_2005_CD/source:/home/msomeki/00_systems/espnet3/tools/nkf/nkf-2.1.4:/home/msomeki/00_systems/espnet3/tools/moses/scripts/tokenizer:/home/msomeki/00_systems/espnet3/tools/moses/scripts/generic:/home/msomeki/00_systems/espnet3/tools/tools/moses/scripts/recaser:/home/msomeki/00_systems/espnet3/tools/moses/scripts/training:/home/msomeki/00_systems/espnet3/tools/mwerSegmenter:/home/msomeki/00_systems/espnet3/tools/sctk/bin:/home/msomeki/00_systems/espnet3/tools/sph2pipe:/home/msomeki/00_systems/espnet3/tools/sentencepiece_commands:/home/msomeki/.pixi/bin:/home/msomeki/local/bin:/home/msomeki/utils:/home/msomeki/.local/bin:/home/msomeki/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin
|
| 70 |
-
PYTHONPATH=/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:
|
| 71 |
-
2026-01-
|
| 72 |
num_device: 1
|
| 73 |
num_nodes: 1
|
| 74 |
task: espnet3.systems.asr.task.ASRTask
|
|
@@ -230,10 +230,11 @@ model:
|
|
| 230 |
win_length: 400
|
| 231 |
hop_length: 160
|
| 232 |
|
| 233 |
-
2026-01-
|
| 234 |
pack_model:
|
| 235 |
strategy: auto
|
| 236 |
out_dir: exp/model_pack
|
|
|
|
| 237 |
include: []
|
| 238 |
extra: []
|
| 239 |
exclude:
|
|
@@ -252,4 +253,4 @@ pack_model:
|
|
| 252 |
upload_model:
|
| 253 |
hf_repo: ms180/mini_an4_integration_test
|
| 254 |
|
| 255 |
-
2026-01-
|
|
|
|
| 1 |
+
2026-01-14 00:36:01 | INFO | espnet3 | === ESPnet3 run started: 2026-01-14T00:36:01.044208 ===
|
| 2 |
+
2026-01-14 00:36:01 | INFO | espnet3 | Command: /data/user_data/msomeki/espnet3/.venv/bin/python run.py --stage pack_model --publish_config conf/publish.yaml --train_config conf/train.yaml
|
| 3 |
+
2026-01-14 00:36:01 | INFO | espnet3 | Python: 3.11.13 (main, Aug 18 2025, 19:19:13) [Clang 20.1.4 ]
|
| 4 |
+
2026-01-14 00:36:01 | INFO | espnet3 | Working directory: /home/msomeki/00_systems/espnet3/egs3/mini_an4/asr
|
| 5 |
+
2026-01-14 00:36:01 | INFO | espnet3 | train config: /home/msomeki/00_systems/espnet3/egs3/mini_an4/asr/conf/train_asr_rnn_data_aug_debug.yaml
|
| 6 |
+
2026-01-14 00:36:01 | INFO | espnet3 | publish config: /home/msomeki/00_systems/espnet3/egs3/mini_an4/asr/conf/publish.yaml
|
| 7 |
+
2026-01-14 00:36:01 | INFO | espnet3 | Git: commit=8509faad9811b58d5024f29fb9d68ffb026b5e73, short_commit=8509faad9, branch=espnet3/recipe/asr_ls100, worktree=dirty
|
| 8 |
+
2026-01-14 00:36:01 | INFO | espnet3 | Cluster env:
|
| 9 |
OMPI_MCA_plm_slurm_args=--external-launcher
|
| 10 |
SLURM_CLUSTER_NAME=babel
|
| 11 |
SLURM_CONF=/var/spool/slurmd/conf-cache/slurm.conf
|
|
|
|
| 64 |
SLURM_TOPOLOGY_ADDR_PATTERN=node
|
| 65 |
SLURM_TRES_PER_TASK=cpu=1
|
| 66 |
SLURM_UMASK=0027
|
| 67 |
+
2026-01-14 00:36:01 | INFO | espnet3 | Runtime env:
|
| 68 |
+
LD_LIBRARY_PATH=/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:
|
| 69 |
PATH=/home/msomeki/00_systems/espnet3/tools/ffmpeg-release:/home/msomeki/00_systems/espnet3/tools/festival/bin:/home/msomeki/00_systems/espnet3/tools/MBROLA/Bin:/home/msomeki/00_systems/espnet3/tools/espeak-ng/bin:/home/msomeki/00_systems/espnet3/tools/BeamformIt:/home/msomeki/00_systems/espnet3/tools/kenlm/build/bin:/home/msomeki/00_systems/espnet3/tools/PESQ/P862_annex_A_2005_CD/source:/home/msomeki/00_systems/espnet3/tools/nkf/nkf-2.1.4:/home/msomeki/00_systems/espnet3/tools/moses/scripts/tokenizer:/home/msomeki/00_systems/espnet3/tools/moses/scripts/generic:/home/msomeki/00_systems/espnet3/tools/tools/moses/scripts/recaser:/home/msomeki/00_systems/espnet3/tools/moses/scripts/training:/home/msomeki/00_systems/espnet3/tools/mwerSegmenter:/home/msomeki/00_systems/espnet3/tools/sctk/bin:/home/msomeki/00_systems/espnet3/tools/sph2pipe:/home/msomeki/00_systems/espnet3/tools/sentencepiece_commands:/data/user_data/msomeki/espnet3/.venv/bin:/home/msomeki/.pixi/bin:/home/msomeki/local/bin:/home/msomeki/utils:/usr/share/Modules/bin:/home/msomeki/00_systems/espnet3/tools/ffmpeg-release:/home/msomeki/00_systems/espnet3/tools/festival/bin:/home/msomeki/00_systems/espnet3/tools/MBROLA/Bin:/home/msomeki/00_systems/espnet3/tools/espeak-ng/bin:/home/msomeki/00_systems/espnet3/tools/BeamformIt:/home/msomeki/00_systems/espnet3/tools/kenlm/build/bin:/home/msomeki/00_systems/espnet3/tools/PESQ/P862_annex_A_2005_CD/source:/home/msomeki/00_systems/espnet3/tools/nkf/nkf-2.1.4:/home/msomeki/00_systems/espnet3/tools/moses/scripts/tokenizer:/home/msomeki/00_systems/espnet3/tools/moses/scripts/generic:/home/msomeki/00_systems/espnet3/tools/tools/moses/scripts/recaser:/home/msomeki/00_systems/espnet3/tools/moses/scripts/training:/home/msomeki/00_systems/espnet3/tools/mwerSegmenter:/home/msomeki/00_systems/espnet3/tools/sctk/bin:/home/msomeki/00_systems/espnet3/tools/sph2pipe:/home/msomeki/00_systems/espnet3/tools/sentencepiece_commands:/home/msomeki/00_systems/espnet3/tools/ffmpeg-release:/home/msomeki/00_systems/espnet3/tools/festival/bin:/home/msomeki/00_systems/espnet3/tools/MBROLA/Bin:/home/msomeki/00_systems/espnet3/tools/espeak-ng/bin:/home/msomeki/00_systems/espnet3/tools/BeamformIt:/home/msomeki/00_systems/espnet3/tools/kenlm/build/bin:/home/msomeki/00_systems/espnet3/tools/PESQ/P862_annex_A_2005_CD/source:/home/msomeki/00_systems/espnet3/tools/nkf/nkf-2.1.4:/home/msomeki/00_systems/espnet3/tools/moses/scripts/tokenizer:/home/msomeki/00_systems/espnet3/tools/moses/scripts/generic:/home/msomeki/00_systems/espnet3/tools/tools/moses/scripts/recaser:/home/msomeki/00_systems/espnet3/tools/moses/scripts/training:/home/msomeki/00_systems/espnet3/tools/mwerSegmenter:/home/msomeki/00_systems/espnet3/tools/sctk/bin:/home/msomeki/00_systems/espnet3/tools/sph2pipe:/home/msomeki/00_systems/espnet3/tools/sentencepiece_commands:/home/msomeki/.pixi/bin:/home/msomeki/local/bin:/home/msomeki/utils:/home/msomeki/.local/bin:/home/msomeki/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin
|
| 70 |
+
PYTHONPATH=/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:
|
| 71 |
+
2026-01-14 00:36:01 | INFO | espnet3 | Train config content:
|
| 72 |
num_device: 1
|
| 73 |
num_nodes: 1
|
| 74 |
task: espnet3.systems.asr.task.ASRTask
|
|
|
|
| 230 |
win_length: 400
|
| 231 |
hop_length: 160
|
| 232 |
|
| 233 |
+
2026-01-14 00:36:01 | INFO | espnet3 | Publish config content:
|
| 234 |
pack_model:
|
| 235 |
strategy: auto
|
| 236 |
out_dir: exp/model_pack
|
| 237 |
+
readme_template: egs3/TEMPLATE/asr/demo_templates/readme.md
|
| 238 |
include: []
|
| 239 |
extra: []
|
| 240 |
exclude:
|
|
|
|
| 253 |
upload_model:
|
| 254 |
hf_repo: ms180/mini_an4_integration_test
|
| 255 |
|
| 256 |
+
2026-01-14 00:36:01 | INFO | espnet3 | === [START] stage: pack_model ===
|
exp/pack_model1.log
CHANGED
|
@@ -1,11 +1,11 @@
|
|
| 1 |
-
2026-01-
|
| 2 |
-
2026-01-
|
| 3 |
-
2026-01-
|
| 4 |
-
2026-01-
|
| 5 |
-
2026-01-
|
| 6 |
-
2026-01-
|
| 7 |
-
2026-01-
|
| 8 |
-
2026-01-
|
| 9 |
OMPI_MCA_plm_slurm_args=--external-launcher
|
| 10 |
SLURM_CLUSTER_NAME=babel
|
| 11 |
SLURM_CONF=/var/spool/slurmd/conf-cache/slurm.conf
|
|
@@ -64,11 +64,11 @@ SLURM_TOPOLOGY_ADDR=babel-o9-16
|
|
| 64 |
SLURM_TOPOLOGY_ADDR_PATTERN=node
|
| 65 |
SLURM_TRES_PER_TASK=cpu=1
|
| 66 |
SLURM_UMASK=0027
|
| 67 |
-
2026-01-
|
| 68 |
-
LD_LIBRARY_PATH=/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:
|
| 69 |
PATH=/home/msomeki/00_systems/espnet3/tools/ffmpeg-release:/home/msomeki/00_systems/espnet3/tools/festival/bin:/home/msomeki/00_systems/espnet3/tools/MBROLA/Bin:/home/msomeki/00_systems/espnet3/tools/espeak-ng/bin:/home/msomeki/00_systems/espnet3/tools/BeamformIt:/home/msomeki/00_systems/espnet3/tools/kenlm/build/bin:/home/msomeki/00_systems/espnet3/tools/PESQ/P862_annex_A_2005_CD/source:/home/msomeki/00_systems/espnet3/tools/nkf/nkf-2.1.4:/home/msomeki/00_systems/espnet3/tools/moses/scripts/tokenizer:/home/msomeki/00_systems/espnet3/tools/moses/scripts/generic:/home/msomeki/00_systems/espnet3/tools/tools/moses/scripts/recaser:/home/msomeki/00_systems/espnet3/tools/moses/scripts/training:/home/msomeki/00_systems/espnet3/tools/mwerSegmenter:/home/msomeki/00_systems/espnet3/tools/sctk/bin:/home/msomeki/00_systems/espnet3/tools/sph2pipe:/home/msomeki/00_systems/espnet3/tools/sentencepiece_commands:/data/user_data/msomeki/espnet3/.venv/bin:/home/msomeki/.pixi/bin:/home/msomeki/local/bin:/home/msomeki/utils:/usr/share/Modules/bin:/home/msomeki/00_systems/espnet3/tools/ffmpeg-release:/home/msomeki/00_systems/espnet3/tools/festival/bin:/home/msomeki/00_systems/espnet3/tools/MBROLA/Bin:/home/msomeki/00_systems/espnet3/tools/espeak-ng/bin:/home/msomeki/00_systems/espnet3/tools/BeamformIt:/home/msomeki/00_systems/espnet3/tools/kenlm/build/bin:/home/msomeki/00_systems/espnet3/tools/PESQ/P862_annex_A_2005_CD/source:/home/msomeki/00_systems/espnet3/tools/nkf/nkf-2.1.4:/home/msomeki/00_systems/espnet3/tools/moses/scripts/tokenizer:/home/msomeki/00_systems/espnet3/tools/moses/scripts/generic:/home/msomeki/00_systems/espnet3/tools/tools/moses/scripts/recaser:/home/msomeki/00_systems/espnet3/tools/moses/scripts/training:/home/msomeki/00_systems/espnet3/tools/mwerSegmenter:/home/msomeki/00_systems/espnet3/tools/sctk/bin:/home/msomeki/00_systems/espnet3/tools/sph2pipe:/home/msomeki/00_systems/espnet3/tools/sentencepiece_commands:/home/msomeki/00_systems/espnet3/tools/ffmpeg-release:/home/msomeki/00_systems/espnet3/tools/festival/bin:/home/msomeki/00_systems/espnet3/tools/MBROLA/Bin:/home/msomeki/00_systems/espnet3/tools/espeak-ng/bin:/home/msomeki/00_systems/espnet3/tools/BeamformIt:/home/msomeki/00_systems/espnet3/tools/kenlm/build/bin:/home/msomeki/00_systems/espnet3/tools/PESQ/P862_annex_A_2005_CD/source:/home/msomeki/00_systems/espnet3/tools/nkf/nkf-2.1.4:/home/msomeki/00_systems/espnet3/tools/moses/scripts/tokenizer:/home/msomeki/00_systems/espnet3/tools/moses/scripts/generic:/home/msomeki/00_systems/espnet3/tools/tools/moses/scripts/recaser:/home/msomeki/00_systems/espnet3/tools/moses/scripts/training:/home/msomeki/00_systems/espnet3/tools/mwerSegmenter:/home/msomeki/00_systems/espnet3/tools/sctk/bin:/home/msomeki/00_systems/espnet3/tools/sph2pipe:/home/msomeki/00_systems/espnet3/tools/sentencepiece_commands:/home/msomeki/.pixi/bin:/home/msomeki/local/bin:/home/msomeki/utils:/home/msomeki/.local/bin:/home/msomeki/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin
|
| 70 |
-
PYTHONPATH=/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:
|
| 71 |
-
2026-01-
|
| 72 |
num_device: 1
|
| 73 |
num_nodes: 1
|
| 74 |
task: espnet3.systems.asr.task.ASRTask
|
|
@@ -230,18 +230,21 @@ model:
|
|
| 230 |
win_length: 400
|
| 231 |
hop_length: 160
|
| 232 |
|
| 233 |
-
2026-01-
|
| 234 |
pack_model:
|
| 235 |
strategy: auto
|
| 236 |
out_dir: exp/model_pack
|
|
|
|
| 237 |
include: []
|
| 238 |
extra: []
|
| 239 |
exclude:
|
| 240 |
- '**/*.log'
|
| 241 |
- '**/tensorboard/**'
|
| 242 |
- '**/wandb/**'
|
| 243 |
-
files:
|
| 244 |
-
|
|
|
|
|
|
|
| 245 |
espnet2:
|
| 246 |
task: asr
|
| 247 |
yaml_files: {}
|
|
@@ -250,6 +253,6 @@ pack_model:
|
|
| 250 |
upload_model:
|
| 251 |
hf_repo: ms180/mini_an4_integration_test
|
| 252 |
|
| 253 |
-
2026-01-
|
| 254 |
-
2026-01-
|
| 255 |
-
2026-01-
|
|
|
|
| 1 |
+
2026-01-14 00:20:44 | INFO | espnet3 | === ESPnet3 run started: 2026-01-14T00:20:44.298441 ===
|
| 2 |
+
2026-01-14 00:20:44 | INFO | espnet3 | Command: /data/user_data/msomeki/espnet3/.venv/bin/python run.py --stage pack_model --publish_config conf/publish.yaml --train_config conf/train.yaml
|
| 3 |
+
2026-01-14 00:20:44 | INFO | espnet3 | Python: 3.11.13 (main, Aug 18 2025, 19:19:13) [Clang 20.1.4 ]
|
| 4 |
+
2026-01-14 00:20:44 | INFO | espnet3 | Working directory: /home/msomeki/00_systems/espnet3/egs3/mini_an4/asr
|
| 5 |
+
2026-01-14 00:20:44 | INFO | espnet3 | train config: /home/msomeki/00_systems/espnet3/egs3/mini_an4/asr/conf/train_asr_rnn_data_aug_debug.yaml
|
| 6 |
+
2026-01-14 00:20:44 | INFO | espnet3 | publish config: /home/msomeki/00_systems/espnet3/egs3/mini_an4/asr/conf/publish.yaml
|
| 7 |
+
2026-01-14 00:20:44 | INFO | espnet3 | Git: commit=8509faad9811b58d5024f29fb9d68ffb026b5e73, short_commit=8509faad9, branch=espnet3/recipe/asr_ls100, worktree=dirty
|
| 8 |
+
2026-01-14 00:20:44 | INFO | espnet3 | Cluster env:
|
| 9 |
OMPI_MCA_plm_slurm_args=--external-launcher
|
| 10 |
SLURM_CLUSTER_NAME=babel
|
| 11 |
SLURM_CONF=/var/spool/slurmd/conf-cache/slurm.conf
|
|
|
|
| 64 |
SLURM_TOPOLOGY_ADDR_PATTERN=node
|
| 65 |
SLURM_TRES_PER_TASK=cpu=1
|
| 66 |
SLURM_UMASK=0027
|
| 67 |
+
2026-01-14 00:20:44 | INFO | espnet3 | Runtime env:
|
| 68 |
+
LD_LIBRARY_PATH=/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:
|
| 69 |
PATH=/home/msomeki/00_systems/espnet3/tools/ffmpeg-release:/home/msomeki/00_systems/espnet3/tools/festival/bin:/home/msomeki/00_systems/espnet3/tools/MBROLA/Bin:/home/msomeki/00_systems/espnet3/tools/espeak-ng/bin:/home/msomeki/00_systems/espnet3/tools/BeamformIt:/home/msomeki/00_systems/espnet3/tools/kenlm/build/bin:/home/msomeki/00_systems/espnet3/tools/PESQ/P862_annex_A_2005_CD/source:/home/msomeki/00_systems/espnet3/tools/nkf/nkf-2.1.4:/home/msomeki/00_systems/espnet3/tools/moses/scripts/tokenizer:/home/msomeki/00_systems/espnet3/tools/moses/scripts/generic:/home/msomeki/00_systems/espnet3/tools/tools/moses/scripts/recaser:/home/msomeki/00_systems/espnet3/tools/moses/scripts/training:/home/msomeki/00_systems/espnet3/tools/mwerSegmenter:/home/msomeki/00_systems/espnet3/tools/sctk/bin:/home/msomeki/00_systems/espnet3/tools/sph2pipe:/home/msomeki/00_systems/espnet3/tools/sentencepiece_commands:/data/user_data/msomeki/espnet3/.venv/bin:/home/msomeki/.pixi/bin:/home/msomeki/local/bin:/home/msomeki/utils:/usr/share/Modules/bin:/home/msomeki/00_systems/espnet3/tools/ffmpeg-release:/home/msomeki/00_systems/espnet3/tools/festival/bin:/home/msomeki/00_systems/espnet3/tools/MBROLA/Bin:/home/msomeki/00_systems/espnet3/tools/espeak-ng/bin:/home/msomeki/00_systems/espnet3/tools/BeamformIt:/home/msomeki/00_systems/espnet3/tools/kenlm/build/bin:/home/msomeki/00_systems/espnet3/tools/PESQ/P862_annex_A_2005_CD/source:/home/msomeki/00_systems/espnet3/tools/nkf/nkf-2.1.4:/home/msomeki/00_systems/espnet3/tools/moses/scripts/tokenizer:/home/msomeki/00_systems/espnet3/tools/moses/scripts/generic:/home/msomeki/00_systems/espnet3/tools/tools/moses/scripts/recaser:/home/msomeki/00_systems/espnet3/tools/moses/scripts/training:/home/msomeki/00_systems/espnet3/tools/mwerSegmenter:/home/msomeki/00_systems/espnet3/tools/sctk/bin:/home/msomeki/00_systems/espnet3/tools/sph2pipe:/home/msomeki/00_systems/espnet3/tools/sentencepiece_commands:/home/msomeki/00_systems/espnet3/tools/ffmpeg-release:/home/msomeki/00_systems/espnet3/tools/festival/bin:/home/msomeki/00_systems/espnet3/tools/MBROLA/Bin:/home/msomeki/00_systems/espnet3/tools/espeak-ng/bin:/home/msomeki/00_systems/espnet3/tools/BeamformIt:/home/msomeki/00_systems/espnet3/tools/kenlm/build/bin:/home/msomeki/00_systems/espnet3/tools/PESQ/P862_annex_A_2005_CD/source:/home/msomeki/00_systems/espnet3/tools/nkf/nkf-2.1.4:/home/msomeki/00_systems/espnet3/tools/moses/scripts/tokenizer:/home/msomeki/00_systems/espnet3/tools/moses/scripts/generic:/home/msomeki/00_systems/espnet3/tools/tools/moses/scripts/recaser:/home/msomeki/00_systems/espnet3/tools/moses/scripts/training:/home/msomeki/00_systems/espnet3/tools/mwerSegmenter:/home/msomeki/00_systems/espnet3/tools/sctk/bin:/home/msomeki/00_systems/espnet3/tools/sph2pipe:/home/msomeki/00_systems/espnet3/tools/sentencepiece_commands:/home/msomeki/.pixi/bin:/home/msomeki/local/bin:/home/msomeki/utils:/home/msomeki/.local/bin:/home/msomeki/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin
|
| 70 |
+
PYTHONPATH=/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:
|
| 71 |
+
2026-01-14 00:20:44 | INFO | espnet3 | Train config content:
|
| 72 |
num_device: 1
|
| 73 |
num_nodes: 1
|
| 74 |
task: espnet3.systems.asr.task.ASRTask
|
|
|
|
| 230 |
win_length: 400
|
| 231 |
hop_length: 160
|
| 232 |
|
| 233 |
+
2026-01-14 00:20:44 | INFO | espnet3 | Publish config content:
|
| 234 |
pack_model:
|
| 235 |
strategy: auto
|
| 236 |
out_dir: exp/model_pack
|
| 237 |
+
readme_template: egs3/TEMPLATE/asr/demo_templates/readme.md
|
| 238 |
include: []
|
| 239 |
extra: []
|
| 240 |
exclude:
|
| 241 |
- '**/*.log'
|
| 242 |
- '**/tensorboard/**'
|
| 243 |
- '**/wandb/**'
|
| 244 |
+
files:
|
| 245 |
+
asr_model_file: exp/train_asr_rnn_data_aug_debug/epoch0_step1_valid.acc.ckpt
|
| 246 |
+
yaml_files:
|
| 247 |
+
asr_train_config: exp/train_asr_rnn_data_aug_debug/config.yaml
|
| 248 |
espnet2:
|
| 249 |
task: asr
|
| 250 |
yaml_files: {}
|
|
|
|
| 253 |
upload_model:
|
| 254 |
hf_repo: ms180/mini_an4_integration_test
|
| 255 |
|
| 256 |
+
2026-01-14 00:20:44 | INFO | espnet3 | === [START] stage: pack_model ===
|
| 257 |
+
2026-01-14 00:20:44 | INFO | espnet3.utils.publish | Packed model to exp/model_pack
|
| 258 |
+
2026-01-14 00:20:44 | INFO | espnet3 | === [DONE] stage: pack_model (0.06s) ===
|
exp/pack_model2.log
ADDED
|
@@ -0,0 +1,258 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
2026-01-14 00:25:55 | INFO | espnet3 | === ESPnet3 run started: 2026-01-14T00:25:55.151411 ===
|
| 2 |
+
2026-01-14 00:25:55 | INFO | espnet3 | Command: /data/user_data/msomeki/espnet3/.venv/bin/python run.py --stage pack_model --publish_config conf/publish.yaml --train_config conf/train.yaml
|
| 3 |
+
2026-01-14 00:25:55 | INFO | espnet3 | Python: 3.11.13 (main, Aug 18 2025, 19:19:13) [Clang 20.1.4 ]
|
| 4 |
+
2026-01-14 00:25:55 | INFO | espnet3 | Working directory: /home/msomeki/00_systems/espnet3/egs3/mini_an4/asr
|
| 5 |
+
2026-01-14 00:25:55 | INFO | espnet3 | train config: /home/msomeki/00_systems/espnet3/egs3/mini_an4/asr/conf/train_asr_rnn_data_aug_debug.yaml
|
| 6 |
+
2026-01-14 00:25:55 | INFO | espnet3 | publish config: /home/msomeki/00_systems/espnet3/egs3/mini_an4/asr/conf/publish.yaml
|
| 7 |
+
2026-01-14 00:25:55 | INFO | espnet3 | Git: commit=8509faad9811b58d5024f29fb9d68ffb026b5e73, short_commit=8509faad9, branch=espnet3/recipe/asr_ls100, worktree=dirty
|
| 8 |
+
2026-01-14 00:25:55 | INFO | espnet3 | Cluster env:
|
| 9 |
+
OMPI_MCA_plm_slurm_args=--external-launcher
|
| 10 |
+
SLURM_CLUSTER_NAME=babel
|
| 11 |
+
SLURM_CONF=/var/spool/slurmd/conf-cache/slurm.conf
|
| 12 |
+
SLURM_CPUS_ON_NODE=1
|
| 13 |
+
SLURM_CPUS_PER_TASK=1
|
| 14 |
+
SLURM_CPU_BIND=quiet,mask_cpu:0x0000000000010000
|
| 15 |
+
SLURM_CPU_BIND_LIST=0x0000000000010000
|
| 16 |
+
SLURM_CPU_BIND_TYPE=mask_cpu:
|
| 17 |
+
SLURM_CPU_BIND_VERBOSE=quiet
|
| 18 |
+
SLURM_DISTRIBUTION=cyclic,pack
|
| 19 |
+
SLURM_GTIDS=0
|
| 20 |
+
SLURM_JOBID=6122041
|
| 21 |
+
SLURM_JOB_ACCOUNT=swatanab
|
| 22 |
+
SLURM_JOB_CPUS_PER_NODE=1
|
| 23 |
+
SLURM_JOB_END_TIME=1768401875
|
| 24 |
+
SLURM_JOB_GID=2709140
|
| 25 |
+
SLURM_JOB_GROUP=msomeki
|
| 26 |
+
SLURM_JOB_ID=6122041
|
| 27 |
+
SLURM_JOB_NAME=bash
|
| 28 |
+
SLURM_JOB_NODELIST=babel-o9-16
|
| 29 |
+
SLURM_JOB_NUM_NODES=1
|
| 30 |
+
SLURM_JOB_PARTITION=debug
|
| 31 |
+
SLURM_JOB_QOS=debug_qos
|
| 32 |
+
SLURM_JOB_START_TIME=1768358675
|
| 33 |
+
SLURM_JOB_UID=2709140
|
| 34 |
+
SLURM_JOB_USER=msomeki
|
| 35 |
+
SLURM_LAUNCH_NODE_IPADDR=172.16.1.2
|
| 36 |
+
SLURM_LOCALID=0
|
| 37 |
+
SLURM_MEM_PER_NODE=4096
|
| 38 |
+
SLURM_NNODES=1
|
| 39 |
+
SLURM_NODEID=0
|
| 40 |
+
SLURM_NODELIST=babel-o9-16
|
| 41 |
+
SLURM_NPROCS=1
|
| 42 |
+
SLURM_NTASKS=1
|
| 43 |
+
SLURM_NTASKS_PER_NODE=1
|
| 44 |
+
SLURM_PRIO_PROCESS=0
|
| 45 |
+
SLURM_PROCID=0
|
| 46 |
+
SLURM_PTY_PORT=40465
|
| 47 |
+
SLURM_PTY_WIN_COL=112
|
| 48 |
+
SLURM_PTY_WIN_ROW=61
|
| 49 |
+
SLURM_SCRIPT_CONTEXT=prolog_task
|
| 50 |
+
SLURM_SRUN_COMM_HOST=172.16.1.2
|
| 51 |
+
SLURM_SRUN_COMM_PORT=33789
|
| 52 |
+
SLURM_STEPID=0
|
| 53 |
+
SLURM_STEP_ID=0
|
| 54 |
+
SLURM_STEP_LAUNCHER_PORT=33789
|
| 55 |
+
SLURM_STEP_NODELIST=babel-o9-16
|
| 56 |
+
SLURM_STEP_NUM_NODES=1
|
| 57 |
+
SLURM_STEP_NUM_TASKS=1
|
| 58 |
+
SLURM_STEP_TASKS_PER_NODE=1
|
| 59 |
+
SLURM_SUBMIT_DIR=/home/msomeki/00_systems/espnet3
|
| 60 |
+
SLURM_SUBMIT_HOST=login1
|
| 61 |
+
SLURM_TASKS_PER_NODE=1
|
| 62 |
+
SLURM_TASK_PID=3334910
|
| 63 |
+
SLURM_TOPOLOGY_ADDR=babel-o9-16
|
| 64 |
+
SLURM_TOPOLOGY_ADDR_PATTERN=node
|
| 65 |
+
SLURM_TRES_PER_TASK=cpu=1
|
| 66 |
+
SLURM_UMASK=0027
|
| 67 |
+
2026-01-14 00:25:55 | INFO | espnet3 | Runtime env:
|
| 68 |
+
LD_LIBRARY_PATH=/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:
|
| 69 |
+
PATH=/home/msomeki/00_systems/espnet3/tools/ffmpeg-release:/home/msomeki/00_systems/espnet3/tools/festival/bin:/home/msomeki/00_systems/espnet3/tools/MBROLA/Bin:/home/msomeki/00_systems/espnet3/tools/espeak-ng/bin:/home/msomeki/00_systems/espnet3/tools/BeamformIt:/home/msomeki/00_systems/espnet3/tools/kenlm/build/bin:/home/msomeki/00_systems/espnet3/tools/PESQ/P862_annex_A_2005_CD/source:/home/msomeki/00_systems/espnet3/tools/nkf/nkf-2.1.4:/home/msomeki/00_systems/espnet3/tools/moses/scripts/tokenizer:/home/msomeki/00_systems/espnet3/tools/moses/scripts/generic:/home/msomeki/00_systems/espnet3/tools/tools/moses/scripts/recaser:/home/msomeki/00_systems/espnet3/tools/moses/scripts/training:/home/msomeki/00_systems/espnet3/tools/mwerSegmenter:/home/msomeki/00_systems/espnet3/tools/sctk/bin:/home/msomeki/00_systems/espnet3/tools/sph2pipe:/home/msomeki/00_systems/espnet3/tools/sentencepiece_commands:/data/user_data/msomeki/espnet3/.venv/bin:/home/msomeki/.pixi/bin:/home/msomeki/local/bin:/home/msomeki/utils:/usr/share/Modules/bin:/home/msomeki/00_systems/espnet3/tools/ffmpeg-release:/home/msomeki/00_systems/espnet3/tools/festival/bin:/home/msomeki/00_systems/espnet3/tools/MBROLA/Bin:/home/msomeki/00_systems/espnet3/tools/espeak-ng/bin:/home/msomeki/00_systems/espnet3/tools/BeamformIt:/home/msomeki/00_systems/espnet3/tools/kenlm/build/bin:/home/msomeki/00_systems/espnet3/tools/PESQ/P862_annex_A_2005_CD/source:/home/msomeki/00_systems/espnet3/tools/nkf/nkf-2.1.4:/home/msomeki/00_systems/espnet3/tools/moses/scripts/tokenizer:/home/msomeki/00_systems/espnet3/tools/moses/scripts/generic:/home/msomeki/00_systems/espnet3/tools/tools/moses/scripts/recaser:/home/msomeki/00_systems/espnet3/tools/moses/scripts/training:/home/msomeki/00_systems/espnet3/tools/mwerSegmenter:/home/msomeki/00_systems/espnet3/tools/sctk/bin:/home/msomeki/00_systems/espnet3/tools/sph2pipe:/home/msomeki/00_systems/espnet3/tools/sentencepiece_commands:/home/msomeki/00_systems/espnet3/tools/ffmpeg-release:/home/msomeki/00_systems/espnet3/tools/festival/bin:/home/msomeki/00_systems/espnet3/tools/MBROLA/Bin:/home/msomeki/00_systems/espnet3/tools/espeak-ng/bin:/home/msomeki/00_systems/espnet3/tools/BeamformIt:/home/msomeki/00_systems/espnet3/tools/kenlm/build/bin:/home/msomeki/00_systems/espnet3/tools/PESQ/P862_annex_A_2005_CD/source:/home/msomeki/00_systems/espnet3/tools/nkf/nkf-2.1.4:/home/msomeki/00_systems/espnet3/tools/moses/scripts/tokenizer:/home/msomeki/00_systems/espnet3/tools/moses/scripts/generic:/home/msomeki/00_systems/espnet3/tools/tools/moses/scripts/recaser:/home/msomeki/00_systems/espnet3/tools/moses/scripts/training:/home/msomeki/00_systems/espnet3/tools/mwerSegmenter:/home/msomeki/00_systems/espnet3/tools/sctk/bin:/home/msomeki/00_systems/espnet3/tools/sph2pipe:/home/msomeki/00_systems/espnet3/tools/sentencepiece_commands:/home/msomeki/.pixi/bin:/home/msomeki/local/bin:/home/msomeki/utils:/home/msomeki/.local/bin:/home/msomeki/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin
|
| 70 |
+
PYTHONPATH=/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:
|
| 71 |
+
2026-01-14 00:25:55 | INFO | espnet3 | Train config content:
|
| 72 |
+
num_device: 1
|
| 73 |
+
num_nodes: 1
|
| 74 |
+
task: espnet3.systems.asr.task.ASRTask
|
| 75 |
+
recipe_dir: .
|
| 76 |
+
data_dir: ./data
|
| 77 |
+
exp_tag: train_asr_rnn_data_aug_debug
|
| 78 |
+
exp_dir: ./exp/train_asr_rnn_data_aug_debug
|
| 79 |
+
stats_dir: ./exp/stats
|
| 80 |
+
decode_dir: ./exp/train_asr_rnn_data_aug_debug/decode
|
| 81 |
+
dataset_dir: ./data/mini_an4
|
| 82 |
+
create_dataset:
|
| 83 |
+
func: src.create_dataset.create_dataset
|
| 84 |
+
dataset_dir: ./data/mini_an4
|
| 85 |
+
archive_path: ./../../egs2/mini_an4/asr1/downloads.tar.gz
|
| 86 |
+
dataset:
|
| 87 |
+
_target_: espnet3.components.data.data_organizer.DataOrganizer
|
| 88 |
+
train:
|
| 89 |
+
- name: train_nodev
|
| 90 |
+
dataset:
|
| 91 |
+
_target_: src.dataset.MiniAN4Dataset
|
| 92 |
+
manifest_path: ./data/mini_an4/manifest/train_nodev.tsv
|
| 93 |
+
valid:
|
| 94 |
+
- name: train_dev
|
| 95 |
+
dataset:
|
| 96 |
+
_target_: src.dataset.MiniAN4Dataset
|
| 97 |
+
manifest_path: ./data/mini_an4/manifest/train_dev.tsv
|
| 98 |
+
preprocessor:
|
| 99 |
+
_target_: espnet2.train.preprocessor.CommonPreprocessor
|
| 100 |
+
_convert_: all
|
| 101 |
+
fs: 16000
|
| 102 |
+
train: true
|
| 103 |
+
data_aug_effects:
|
| 104 |
+
- - 0.1
|
| 105 |
+
- contrast
|
| 106 |
+
- enhancement_amount: 75.0
|
| 107 |
+
- - 0.1
|
| 108 |
+
- highpass
|
| 109 |
+
- cutoff_freq: 5000
|
| 110 |
+
Q: 0.707
|
| 111 |
+
- - 0.1
|
| 112 |
+
- equalization
|
| 113 |
+
- center_freq: 1000
|
| 114 |
+
gain: 0
|
| 115 |
+
Q: 0.707
|
| 116 |
+
- - 0.1
|
| 117 |
+
- - - 0.3
|
| 118 |
+
- speed_perturb
|
| 119 |
+
- factor: 0.9
|
| 120 |
+
- - 0.3
|
| 121 |
+
- speed_perturb
|
| 122 |
+
- factor: 1.1
|
| 123 |
+
- - 0.3
|
| 124 |
+
- speed_perturb
|
| 125 |
+
- factor: 1.3
|
| 126 |
+
data_aug_num:
|
| 127 |
+
- 1
|
| 128 |
+
- 4
|
| 129 |
+
data_aug_prob: 1.0
|
| 130 |
+
token_type: bpe
|
| 131 |
+
token_list: ./data/bpe_30/tokens.txt
|
| 132 |
+
bpemodel: ./data/bpe_30/bpe.model
|
| 133 |
+
parallel:
|
| 134 |
+
env: local
|
| 135 |
+
n_workers: 1
|
| 136 |
+
dataloader:
|
| 137 |
+
collate_fn:
|
| 138 |
+
_target_: espnet2.train.collate_fn.CommonCollateFn
|
| 139 |
+
int_pad_value: -1
|
| 140 |
+
train:
|
| 141 |
+
multiple_iterator: false
|
| 142 |
+
num_shards: 1
|
| 143 |
+
iter_factory:
|
| 144 |
+
_target_: espnet2.iterators.sequence_iter_factory.SequenceIterFactory
|
| 145 |
+
shuffle: true
|
| 146 |
+
collate_fn:
|
| 147 |
+
_target_: espnet2.train.collate_fn.CommonCollateFn
|
| 148 |
+
int_pad_value: -1
|
| 149 |
+
num_workers: 0
|
| 150 |
+
batches:
|
| 151 |
+
type: sorted
|
| 152 |
+
shape_files:
|
| 153 |
+
- ./exp/stats/train/feats_shape
|
| 154 |
+
batch_size: 2
|
| 155 |
+
batch_bins: 200000
|
| 156 |
+
valid:
|
| 157 |
+
multiple_iterator: false
|
| 158 |
+
num_shards: 1
|
| 159 |
+
iter_factory:
|
| 160 |
+
_target_: espnet2.iterators.sequence_iter_factory.SequenceIterFactory
|
| 161 |
+
shuffle: false
|
| 162 |
+
collate_fn:
|
| 163 |
+
_target_: espnet2.train.collate_fn.CommonCollateFn
|
| 164 |
+
int_pad_value: -1
|
| 165 |
+
batches:
|
| 166 |
+
type: sorted
|
| 167 |
+
shape_files:
|
| 168 |
+
- ./exp/stats/valid/feats_shape
|
| 169 |
+
batch_size: 2
|
| 170 |
+
batch_bins: 200000
|
| 171 |
+
optim:
|
| 172 |
+
_target_: torch.optim.Adam
|
| 173 |
+
lr: 0.001
|
| 174 |
+
weight_decay: 0.0
|
| 175 |
+
scheduler:
|
| 176 |
+
_target_: torch.optim.lr_scheduler.ReduceLROnPlateau
|
| 177 |
+
mode: min
|
| 178 |
+
factor: 0.5
|
| 179 |
+
patience: 1
|
| 180 |
+
val_scheduler_criterion: valid/loss
|
| 181 |
+
best_model_criterion:
|
| 182 |
+
- - valid/acc
|
| 183 |
+
- 1
|
| 184 |
+
- max
|
| 185 |
+
trainer:
|
| 186 |
+
accelerator: auto
|
| 187 |
+
devices: 1
|
| 188 |
+
num_nodes: 1
|
| 189 |
+
accumulate_grad_batches: 1
|
| 190 |
+
check_val_every_n_epoch: 1
|
| 191 |
+
gradient_clip_val: 1.0
|
| 192 |
+
log_every_n_steps: 1
|
| 193 |
+
max_epochs: 1
|
| 194 |
+
limit_train_batches: 1
|
| 195 |
+
limit_val_batches: 1
|
| 196 |
+
precision: 32
|
| 197 |
+
logger:
|
| 198 |
+
- _target_: lightning.pytorch.loggers.TensorBoardLogger
|
| 199 |
+
save_dir: ./exp/train_asr_rnn_data_aug_debug/tensorboard
|
| 200 |
+
name: tb_logger
|
| 201 |
+
strategy: auto
|
| 202 |
+
tokenizer:
|
| 203 |
+
vocab_size: 30
|
| 204 |
+
character_coverage: 1.0
|
| 205 |
+
model_type: bpe
|
| 206 |
+
save_path: ./data/bpe_30
|
| 207 |
+
text_builder:
|
| 208 |
+
func: src.tokenizer.gather_training_text
|
| 209 |
+
manifest_path: ./data/mini_an4/manifest/train_nodev.tsv
|
| 210 |
+
model:
|
| 211 |
+
vocab_size: 30
|
| 212 |
+
token_list: ./data/bpe_30/tokens.txt
|
| 213 |
+
encoder: vgg_rnn
|
| 214 |
+
encoder_conf:
|
| 215 |
+
num_layers: 1
|
| 216 |
+
hidden_size: 2
|
| 217 |
+
output_size: 2
|
| 218 |
+
decoder: rnn
|
| 219 |
+
decoder_conf:
|
| 220 |
+
hidden_size: 2
|
| 221 |
+
normalize: utterance_mvn
|
| 222 |
+
normalize_conf: {}
|
| 223 |
+
model_conf:
|
| 224 |
+
ctc_weight: 0.3
|
| 225 |
+
lsm_weight: 0.1
|
| 226 |
+
length_normalized_loss: false
|
| 227 |
+
frontend: default
|
| 228 |
+
frontend_conf:
|
| 229 |
+
n_fft: 512
|
| 230 |
+
win_length: 400
|
| 231 |
+
hop_length: 160
|
| 232 |
+
|
| 233 |
+
2026-01-14 00:25:55 | INFO | espnet3 | Publish config content:
|
| 234 |
+
pack_model:
|
| 235 |
+
strategy: auto
|
| 236 |
+
out_dir: exp/model_pack
|
| 237 |
+
readme_template: egs3/TEMPLATE/asr/demo_templates/readme.md
|
| 238 |
+
include: []
|
| 239 |
+
extra: []
|
| 240 |
+
exclude:
|
| 241 |
+
- '**/*.log'
|
| 242 |
+
- '**/tensorboard/**'
|
| 243 |
+
- '**/wandb/**'
|
| 244 |
+
files:
|
| 245 |
+
asr_model_file: exp/train_asr_rnn_data_aug_debug/epoch0_step1_valid.acc.ckpt
|
| 246 |
+
yaml_files:
|
| 247 |
+
asr_train_config: exp/train_asr_rnn_data_aug_debug/config.yaml
|
| 248 |
+
espnet2:
|
| 249 |
+
task: asr
|
| 250 |
+
yaml_files: {}
|
| 251 |
+
files: {}
|
| 252 |
+
option: []
|
| 253 |
+
upload_model:
|
| 254 |
+
hf_repo: ms180/mini_an4_integration_test
|
| 255 |
+
|
| 256 |
+
2026-01-14 00:25:55 | INFO | espnet3 | === [START] stage: pack_model ===
|
| 257 |
+
2026-01-14 00:25:55 | INFO | espnet3.utils.publish | Packed model to exp/model_pack
|
| 258 |
+
2026-01-14 00:25:55 | INFO | espnet3 | === [DONE] stage: pack_model (0.04s) ===
|
exp/pack_model3.log
ADDED
|
@@ -0,0 +1,258 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
2026-01-14 00:27:41 | INFO | espnet3 | === ESPnet3 run started: 2026-01-14T00:27:41.924366 ===
|
| 2 |
+
2026-01-14 00:27:41 | INFO | espnet3 | Command: /data/user_data/msomeki/espnet3/.venv/bin/python run.py --stage pack_model --publish_config conf/publish.yaml --train_config conf/train.yaml
|
| 3 |
+
2026-01-14 00:27:41 | INFO | espnet3 | Python: 3.11.13 (main, Aug 18 2025, 19:19:13) [Clang 20.1.4 ]
|
| 4 |
+
2026-01-14 00:27:41 | INFO | espnet3 | Working directory: /home/msomeki/00_systems/espnet3/egs3/mini_an4/asr
|
| 5 |
+
2026-01-14 00:27:41 | INFO | espnet3 | train config: /home/msomeki/00_systems/espnet3/egs3/mini_an4/asr/conf/train_asr_rnn_data_aug_debug.yaml
|
| 6 |
+
2026-01-14 00:27:41 | INFO | espnet3 | publish config: /home/msomeki/00_systems/espnet3/egs3/mini_an4/asr/conf/publish.yaml
|
| 7 |
+
2026-01-14 00:27:42 | INFO | espnet3 | Git: commit=8509faad9811b58d5024f29fb9d68ffb026b5e73, short_commit=8509faad9, branch=espnet3/recipe/asr_ls100, worktree=dirty
|
| 8 |
+
2026-01-14 00:27:42 | INFO | espnet3 | Cluster env:
|
| 9 |
+
OMPI_MCA_plm_slurm_args=--external-launcher
|
| 10 |
+
SLURM_CLUSTER_NAME=babel
|
| 11 |
+
SLURM_CONF=/var/spool/slurmd/conf-cache/slurm.conf
|
| 12 |
+
SLURM_CPUS_ON_NODE=1
|
| 13 |
+
SLURM_CPUS_PER_TASK=1
|
| 14 |
+
SLURM_CPU_BIND=quiet,mask_cpu:0x0000000000010000
|
| 15 |
+
SLURM_CPU_BIND_LIST=0x0000000000010000
|
| 16 |
+
SLURM_CPU_BIND_TYPE=mask_cpu:
|
| 17 |
+
SLURM_CPU_BIND_VERBOSE=quiet
|
| 18 |
+
SLURM_DISTRIBUTION=cyclic,pack
|
| 19 |
+
SLURM_GTIDS=0
|
| 20 |
+
SLURM_JOBID=6122041
|
| 21 |
+
SLURM_JOB_ACCOUNT=swatanab
|
| 22 |
+
SLURM_JOB_CPUS_PER_NODE=1
|
| 23 |
+
SLURM_JOB_END_TIME=1768401875
|
| 24 |
+
SLURM_JOB_GID=2709140
|
| 25 |
+
SLURM_JOB_GROUP=msomeki
|
| 26 |
+
SLURM_JOB_ID=6122041
|
| 27 |
+
SLURM_JOB_NAME=bash
|
| 28 |
+
SLURM_JOB_NODELIST=babel-o9-16
|
| 29 |
+
SLURM_JOB_NUM_NODES=1
|
| 30 |
+
SLURM_JOB_PARTITION=debug
|
| 31 |
+
SLURM_JOB_QOS=debug_qos
|
| 32 |
+
SLURM_JOB_START_TIME=1768358675
|
| 33 |
+
SLURM_JOB_UID=2709140
|
| 34 |
+
SLURM_JOB_USER=msomeki
|
| 35 |
+
SLURM_LAUNCH_NODE_IPADDR=172.16.1.2
|
| 36 |
+
SLURM_LOCALID=0
|
| 37 |
+
SLURM_MEM_PER_NODE=4096
|
| 38 |
+
SLURM_NNODES=1
|
| 39 |
+
SLURM_NODEID=0
|
| 40 |
+
SLURM_NODELIST=babel-o9-16
|
| 41 |
+
SLURM_NPROCS=1
|
| 42 |
+
SLURM_NTASKS=1
|
| 43 |
+
SLURM_NTASKS_PER_NODE=1
|
| 44 |
+
SLURM_PRIO_PROCESS=0
|
| 45 |
+
SLURM_PROCID=0
|
| 46 |
+
SLURM_PTY_PORT=40465
|
| 47 |
+
SLURM_PTY_WIN_COL=112
|
| 48 |
+
SLURM_PTY_WIN_ROW=61
|
| 49 |
+
SLURM_SCRIPT_CONTEXT=prolog_task
|
| 50 |
+
SLURM_SRUN_COMM_HOST=172.16.1.2
|
| 51 |
+
SLURM_SRUN_COMM_PORT=33789
|
| 52 |
+
SLURM_STEPID=0
|
| 53 |
+
SLURM_STEP_ID=0
|
| 54 |
+
SLURM_STEP_LAUNCHER_PORT=33789
|
| 55 |
+
SLURM_STEP_NODELIST=babel-o9-16
|
| 56 |
+
SLURM_STEP_NUM_NODES=1
|
| 57 |
+
SLURM_STEP_NUM_TASKS=1
|
| 58 |
+
SLURM_STEP_TASKS_PER_NODE=1
|
| 59 |
+
SLURM_SUBMIT_DIR=/home/msomeki/00_systems/espnet3
|
| 60 |
+
SLURM_SUBMIT_HOST=login1
|
| 61 |
+
SLURM_TASKS_PER_NODE=1
|
| 62 |
+
SLURM_TASK_PID=3334910
|
| 63 |
+
SLURM_TOPOLOGY_ADDR=babel-o9-16
|
| 64 |
+
SLURM_TOPOLOGY_ADDR_PATTERN=node
|
| 65 |
+
SLURM_TRES_PER_TASK=cpu=1
|
| 66 |
+
SLURM_UMASK=0027
|
| 67 |
+
2026-01-14 00:27:42 | INFO | espnet3 | Runtime env:
|
| 68 |
+
LD_LIBRARY_PATH=/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:
|
| 69 |
+
PATH=/home/msomeki/00_systems/espnet3/tools/ffmpeg-release:/home/msomeki/00_systems/espnet3/tools/festival/bin:/home/msomeki/00_systems/espnet3/tools/MBROLA/Bin:/home/msomeki/00_systems/espnet3/tools/espeak-ng/bin:/home/msomeki/00_systems/espnet3/tools/BeamformIt:/home/msomeki/00_systems/espnet3/tools/kenlm/build/bin:/home/msomeki/00_systems/espnet3/tools/PESQ/P862_annex_A_2005_CD/source:/home/msomeki/00_systems/espnet3/tools/nkf/nkf-2.1.4:/home/msomeki/00_systems/espnet3/tools/moses/scripts/tokenizer:/home/msomeki/00_systems/espnet3/tools/moses/scripts/generic:/home/msomeki/00_systems/espnet3/tools/tools/moses/scripts/recaser:/home/msomeki/00_systems/espnet3/tools/moses/scripts/training:/home/msomeki/00_systems/espnet3/tools/mwerSegmenter:/home/msomeki/00_systems/espnet3/tools/sctk/bin:/home/msomeki/00_systems/espnet3/tools/sph2pipe:/home/msomeki/00_systems/espnet3/tools/sentencepiece_commands:/data/user_data/msomeki/espnet3/.venv/bin:/home/msomeki/.pixi/bin:/home/msomeki/local/bin:/home/msomeki/utils:/usr/share/Modules/bin:/home/msomeki/00_systems/espnet3/tools/ffmpeg-release:/home/msomeki/00_systems/espnet3/tools/festival/bin:/home/msomeki/00_systems/espnet3/tools/MBROLA/Bin:/home/msomeki/00_systems/espnet3/tools/espeak-ng/bin:/home/msomeki/00_systems/espnet3/tools/BeamformIt:/home/msomeki/00_systems/espnet3/tools/kenlm/build/bin:/home/msomeki/00_systems/espnet3/tools/PESQ/P862_annex_A_2005_CD/source:/home/msomeki/00_systems/espnet3/tools/nkf/nkf-2.1.4:/home/msomeki/00_systems/espnet3/tools/moses/scripts/tokenizer:/home/msomeki/00_systems/espnet3/tools/moses/scripts/generic:/home/msomeki/00_systems/espnet3/tools/tools/moses/scripts/recaser:/home/msomeki/00_systems/espnet3/tools/moses/scripts/training:/home/msomeki/00_systems/espnet3/tools/mwerSegmenter:/home/msomeki/00_systems/espnet3/tools/sctk/bin:/home/msomeki/00_systems/espnet3/tools/sph2pipe:/home/msomeki/00_systems/espnet3/tools/sentencepiece_commands:/home/msomeki/00_systems/espnet3/tools/ffmpeg-release:/home/msomeki/00_systems/espnet3/tools/festival/bin:/home/msomeki/00_systems/espnet3/tools/MBROLA/Bin:/home/msomeki/00_systems/espnet3/tools/espeak-ng/bin:/home/msomeki/00_systems/espnet3/tools/BeamformIt:/home/msomeki/00_systems/espnet3/tools/kenlm/build/bin:/home/msomeki/00_systems/espnet3/tools/PESQ/P862_annex_A_2005_CD/source:/home/msomeki/00_systems/espnet3/tools/nkf/nkf-2.1.4:/home/msomeki/00_systems/espnet3/tools/moses/scripts/tokenizer:/home/msomeki/00_systems/espnet3/tools/moses/scripts/generic:/home/msomeki/00_systems/espnet3/tools/tools/moses/scripts/recaser:/home/msomeki/00_systems/espnet3/tools/moses/scripts/training:/home/msomeki/00_systems/espnet3/tools/mwerSegmenter:/home/msomeki/00_systems/espnet3/tools/sctk/bin:/home/msomeki/00_systems/espnet3/tools/sph2pipe:/home/msomeki/00_systems/espnet3/tools/sentencepiece_commands:/home/msomeki/.pixi/bin:/home/msomeki/local/bin:/home/msomeki/utils:/home/msomeki/.local/bin:/home/msomeki/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin
|
| 70 |
+
PYTHONPATH=/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:
|
| 71 |
+
2026-01-14 00:27:42 | INFO | espnet3 | Train config content:
|
| 72 |
+
num_device: 1
|
| 73 |
+
num_nodes: 1
|
| 74 |
+
task: espnet3.systems.asr.task.ASRTask
|
| 75 |
+
recipe_dir: .
|
| 76 |
+
data_dir: ./data
|
| 77 |
+
exp_tag: train_asr_rnn_data_aug_debug
|
| 78 |
+
exp_dir: ./exp/train_asr_rnn_data_aug_debug
|
| 79 |
+
stats_dir: ./exp/stats
|
| 80 |
+
decode_dir: ./exp/train_asr_rnn_data_aug_debug/decode
|
| 81 |
+
dataset_dir: ./data/mini_an4
|
| 82 |
+
create_dataset:
|
| 83 |
+
func: src.create_dataset.create_dataset
|
| 84 |
+
dataset_dir: ./data/mini_an4
|
| 85 |
+
archive_path: ./../../egs2/mini_an4/asr1/downloads.tar.gz
|
| 86 |
+
dataset:
|
| 87 |
+
_target_: espnet3.components.data.data_organizer.DataOrganizer
|
| 88 |
+
train:
|
| 89 |
+
- name: train_nodev
|
| 90 |
+
dataset:
|
| 91 |
+
_target_: src.dataset.MiniAN4Dataset
|
| 92 |
+
manifest_path: ./data/mini_an4/manifest/train_nodev.tsv
|
| 93 |
+
valid:
|
| 94 |
+
- name: train_dev
|
| 95 |
+
dataset:
|
| 96 |
+
_target_: src.dataset.MiniAN4Dataset
|
| 97 |
+
manifest_path: ./data/mini_an4/manifest/train_dev.tsv
|
| 98 |
+
preprocessor:
|
| 99 |
+
_target_: espnet2.train.preprocessor.CommonPreprocessor
|
| 100 |
+
_convert_: all
|
| 101 |
+
fs: 16000
|
| 102 |
+
train: true
|
| 103 |
+
data_aug_effects:
|
| 104 |
+
- - 0.1
|
| 105 |
+
- contrast
|
| 106 |
+
- enhancement_amount: 75.0
|
| 107 |
+
- - 0.1
|
| 108 |
+
- highpass
|
| 109 |
+
- cutoff_freq: 5000
|
| 110 |
+
Q: 0.707
|
| 111 |
+
- - 0.1
|
| 112 |
+
- equalization
|
| 113 |
+
- center_freq: 1000
|
| 114 |
+
gain: 0
|
| 115 |
+
Q: 0.707
|
| 116 |
+
- - 0.1
|
| 117 |
+
- - - 0.3
|
| 118 |
+
- speed_perturb
|
| 119 |
+
- factor: 0.9
|
| 120 |
+
- - 0.3
|
| 121 |
+
- speed_perturb
|
| 122 |
+
- factor: 1.1
|
| 123 |
+
- - 0.3
|
| 124 |
+
- speed_perturb
|
| 125 |
+
- factor: 1.3
|
| 126 |
+
data_aug_num:
|
| 127 |
+
- 1
|
| 128 |
+
- 4
|
| 129 |
+
data_aug_prob: 1.0
|
| 130 |
+
token_type: bpe
|
| 131 |
+
token_list: ./data/bpe_30/tokens.txt
|
| 132 |
+
bpemodel: ./data/bpe_30/bpe.model
|
| 133 |
+
parallel:
|
| 134 |
+
env: local
|
| 135 |
+
n_workers: 1
|
| 136 |
+
dataloader:
|
| 137 |
+
collate_fn:
|
| 138 |
+
_target_: espnet2.train.collate_fn.CommonCollateFn
|
| 139 |
+
int_pad_value: -1
|
| 140 |
+
train:
|
| 141 |
+
multiple_iterator: false
|
| 142 |
+
num_shards: 1
|
| 143 |
+
iter_factory:
|
| 144 |
+
_target_: espnet2.iterators.sequence_iter_factory.SequenceIterFactory
|
| 145 |
+
shuffle: true
|
| 146 |
+
collate_fn:
|
| 147 |
+
_target_: espnet2.train.collate_fn.CommonCollateFn
|
| 148 |
+
int_pad_value: -1
|
| 149 |
+
num_workers: 0
|
| 150 |
+
batches:
|
| 151 |
+
type: sorted
|
| 152 |
+
shape_files:
|
| 153 |
+
- ./exp/stats/train/feats_shape
|
| 154 |
+
batch_size: 2
|
| 155 |
+
batch_bins: 200000
|
| 156 |
+
valid:
|
| 157 |
+
multiple_iterator: false
|
| 158 |
+
num_shards: 1
|
| 159 |
+
iter_factory:
|
| 160 |
+
_target_: espnet2.iterators.sequence_iter_factory.SequenceIterFactory
|
| 161 |
+
shuffle: false
|
| 162 |
+
collate_fn:
|
| 163 |
+
_target_: espnet2.train.collate_fn.CommonCollateFn
|
| 164 |
+
int_pad_value: -1
|
| 165 |
+
batches:
|
| 166 |
+
type: sorted
|
| 167 |
+
shape_files:
|
| 168 |
+
- ./exp/stats/valid/feats_shape
|
| 169 |
+
batch_size: 2
|
| 170 |
+
batch_bins: 200000
|
| 171 |
+
optim:
|
| 172 |
+
_target_: torch.optim.Adam
|
| 173 |
+
lr: 0.001
|
| 174 |
+
weight_decay: 0.0
|
| 175 |
+
scheduler:
|
| 176 |
+
_target_: torch.optim.lr_scheduler.ReduceLROnPlateau
|
| 177 |
+
mode: min
|
| 178 |
+
factor: 0.5
|
| 179 |
+
patience: 1
|
| 180 |
+
val_scheduler_criterion: valid/loss
|
| 181 |
+
best_model_criterion:
|
| 182 |
+
- - valid/acc
|
| 183 |
+
- 1
|
| 184 |
+
- max
|
| 185 |
+
trainer:
|
| 186 |
+
accelerator: auto
|
| 187 |
+
devices: 1
|
| 188 |
+
num_nodes: 1
|
| 189 |
+
accumulate_grad_batches: 1
|
| 190 |
+
check_val_every_n_epoch: 1
|
| 191 |
+
gradient_clip_val: 1.0
|
| 192 |
+
log_every_n_steps: 1
|
| 193 |
+
max_epochs: 1
|
| 194 |
+
limit_train_batches: 1
|
| 195 |
+
limit_val_batches: 1
|
| 196 |
+
precision: 32
|
| 197 |
+
logger:
|
| 198 |
+
- _target_: lightning.pytorch.loggers.TensorBoardLogger
|
| 199 |
+
save_dir: ./exp/train_asr_rnn_data_aug_debug/tensorboard
|
| 200 |
+
name: tb_logger
|
| 201 |
+
strategy: auto
|
| 202 |
+
tokenizer:
|
| 203 |
+
vocab_size: 30
|
| 204 |
+
character_coverage: 1.0
|
| 205 |
+
model_type: bpe
|
| 206 |
+
save_path: ./data/bpe_30
|
| 207 |
+
text_builder:
|
| 208 |
+
func: src.tokenizer.gather_training_text
|
| 209 |
+
manifest_path: ./data/mini_an4/manifest/train_nodev.tsv
|
| 210 |
+
model:
|
| 211 |
+
vocab_size: 30
|
| 212 |
+
token_list: ./data/bpe_30/tokens.txt
|
| 213 |
+
encoder: vgg_rnn
|
| 214 |
+
encoder_conf:
|
| 215 |
+
num_layers: 1
|
| 216 |
+
hidden_size: 2
|
| 217 |
+
output_size: 2
|
| 218 |
+
decoder: rnn
|
| 219 |
+
decoder_conf:
|
| 220 |
+
hidden_size: 2
|
| 221 |
+
normalize: utterance_mvn
|
| 222 |
+
normalize_conf: {}
|
| 223 |
+
model_conf:
|
| 224 |
+
ctc_weight: 0.3
|
| 225 |
+
lsm_weight: 0.1
|
| 226 |
+
length_normalized_loss: false
|
| 227 |
+
frontend: default
|
| 228 |
+
frontend_conf:
|
| 229 |
+
n_fft: 512
|
| 230 |
+
win_length: 400
|
| 231 |
+
hop_length: 160
|
| 232 |
+
|
| 233 |
+
2026-01-14 00:27:42 | INFO | espnet3 | Publish config content:
|
| 234 |
+
pack_model:
|
| 235 |
+
strategy: auto
|
| 236 |
+
out_dir: exp/model_pack
|
| 237 |
+
readme_template: egs3/TEMPLATE/asr/demo_templates/readme.md
|
| 238 |
+
include: []
|
| 239 |
+
extra: []
|
| 240 |
+
exclude:
|
| 241 |
+
- '**/*.log'
|
| 242 |
+
- '**/tensorboard/**'
|
| 243 |
+
- '**/wandb/**'
|
| 244 |
+
files:
|
| 245 |
+
asr_model_file: exp/train_asr_rnn_data_aug_debug/epoch0_step1_valid.acc.ckpt
|
| 246 |
+
yaml_files:
|
| 247 |
+
asr_train_config: exp/train_asr_rnn_data_aug_debug/config.yaml
|
| 248 |
+
espnet2:
|
| 249 |
+
task: asr
|
| 250 |
+
yaml_files: {}
|
| 251 |
+
files: {}
|
| 252 |
+
option: []
|
| 253 |
+
upload_model:
|
| 254 |
+
hf_repo: ms180/mini_an4_integration_test
|
| 255 |
+
|
| 256 |
+
2026-01-14 00:27:42 | INFO | espnet3 | === [START] stage: pack_model ===
|
| 257 |
+
2026-01-14 00:27:42 | INFO | espnet3.utils.publish | Packed model to exp/model_pack
|
| 258 |
+
2026-01-14 00:27:42 | INFO | espnet3 | === [DONE] stage: pack_model (0.24s) ===
|
exp/pack_model4.log
ADDED
|
@@ -0,0 +1,265 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
2026-01-14 00:31:51 | INFO | espnet3 | === ESPnet3 run started: 2026-01-14T00:31:51.686842 ===
|
| 2 |
+
2026-01-14 00:31:51 | INFO | espnet3 | Command: /data/user_data/msomeki/espnet3/.venv/bin/python run.py --stage pack_model --publish_config conf/publish.yaml --train_config conf/train.yaml
|
| 3 |
+
2026-01-14 00:31:51 | INFO | espnet3 | Python: 3.11.13 (main, Aug 18 2025, 19:19:13) [Clang 20.1.4 ]
|
| 4 |
+
2026-01-14 00:31:51 | INFO | espnet3 | Working directory: /home/msomeki/00_systems/espnet3/egs3/mini_an4/asr
|
| 5 |
+
2026-01-14 00:31:51 | INFO | espnet3 | train config: /home/msomeki/00_systems/espnet3/egs3/mini_an4/asr/conf/train_asr_rnn_data_aug_debug.yaml
|
| 6 |
+
2026-01-14 00:31:51 | INFO | espnet3 | publish config: /home/msomeki/00_systems/espnet3/egs3/mini_an4/asr/conf/publish.yaml
|
| 7 |
+
2026-01-14 00:31:52 | INFO | espnet3 | Git: commit=8509faad9811b58d5024f29fb9d68ffb026b5e73, short_commit=8509faad9, branch=espnet3/recipe/asr_ls100, worktree=dirty
|
| 8 |
+
2026-01-14 00:31:52 | INFO | espnet3 | Cluster env:
|
| 9 |
+
OMPI_MCA_plm_slurm_args=--external-launcher
|
| 10 |
+
SLURM_CLUSTER_NAME=babel
|
| 11 |
+
SLURM_CONF=/var/spool/slurmd/conf-cache/slurm.conf
|
| 12 |
+
SLURM_CPUS_ON_NODE=1
|
| 13 |
+
SLURM_CPUS_PER_TASK=1
|
| 14 |
+
SLURM_CPU_BIND=quiet,mask_cpu:0x0000000000010000
|
| 15 |
+
SLURM_CPU_BIND_LIST=0x0000000000010000
|
| 16 |
+
SLURM_CPU_BIND_TYPE=mask_cpu:
|
| 17 |
+
SLURM_CPU_BIND_VERBOSE=quiet
|
| 18 |
+
SLURM_DISTRIBUTION=cyclic,pack
|
| 19 |
+
SLURM_GTIDS=0
|
| 20 |
+
SLURM_JOBID=6122041
|
| 21 |
+
SLURM_JOB_ACCOUNT=swatanab
|
| 22 |
+
SLURM_JOB_CPUS_PER_NODE=1
|
| 23 |
+
SLURM_JOB_END_TIME=1768401875
|
| 24 |
+
SLURM_JOB_GID=2709140
|
| 25 |
+
SLURM_JOB_GROUP=msomeki
|
| 26 |
+
SLURM_JOB_ID=6122041
|
| 27 |
+
SLURM_JOB_NAME=bash
|
| 28 |
+
SLURM_JOB_NODELIST=babel-o9-16
|
| 29 |
+
SLURM_JOB_NUM_NODES=1
|
| 30 |
+
SLURM_JOB_PARTITION=debug
|
| 31 |
+
SLURM_JOB_QOS=debug_qos
|
| 32 |
+
SLURM_JOB_START_TIME=1768358675
|
| 33 |
+
SLURM_JOB_UID=2709140
|
| 34 |
+
SLURM_JOB_USER=msomeki
|
| 35 |
+
SLURM_LAUNCH_NODE_IPADDR=172.16.1.2
|
| 36 |
+
SLURM_LOCALID=0
|
| 37 |
+
SLURM_MEM_PER_NODE=4096
|
| 38 |
+
SLURM_NNODES=1
|
| 39 |
+
SLURM_NODEID=0
|
| 40 |
+
SLURM_NODELIST=babel-o9-16
|
| 41 |
+
SLURM_NPROCS=1
|
| 42 |
+
SLURM_NTASKS=1
|
| 43 |
+
SLURM_NTASKS_PER_NODE=1
|
| 44 |
+
SLURM_PRIO_PROCESS=0
|
| 45 |
+
SLURM_PROCID=0
|
| 46 |
+
SLURM_PTY_PORT=40465
|
| 47 |
+
SLURM_PTY_WIN_COL=112
|
| 48 |
+
SLURM_PTY_WIN_ROW=61
|
| 49 |
+
SLURM_SCRIPT_CONTEXT=prolog_task
|
| 50 |
+
SLURM_SRUN_COMM_HOST=172.16.1.2
|
| 51 |
+
SLURM_SRUN_COMM_PORT=33789
|
| 52 |
+
SLURM_STEPID=0
|
| 53 |
+
SLURM_STEP_ID=0
|
| 54 |
+
SLURM_STEP_LAUNCHER_PORT=33789
|
| 55 |
+
SLURM_STEP_NODELIST=babel-o9-16
|
| 56 |
+
SLURM_STEP_NUM_NODES=1
|
| 57 |
+
SLURM_STEP_NUM_TASKS=1
|
| 58 |
+
SLURM_STEP_TASKS_PER_NODE=1
|
| 59 |
+
SLURM_SUBMIT_DIR=/home/msomeki/00_systems/espnet3
|
| 60 |
+
SLURM_SUBMIT_HOST=login1
|
| 61 |
+
SLURM_TASKS_PER_NODE=1
|
| 62 |
+
SLURM_TASK_PID=3334910
|
| 63 |
+
SLURM_TOPOLOGY_ADDR=babel-o9-16
|
| 64 |
+
SLURM_TOPOLOGY_ADDR_PATTERN=node
|
| 65 |
+
SLURM_TRES_PER_TASK=cpu=1
|
| 66 |
+
SLURM_UMASK=0027
|
| 67 |
+
2026-01-14 00:31:52 | INFO | espnet3 | Runtime env:
|
| 68 |
+
LD_LIBRARY_PATH=/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:
|
| 69 |
+
PATH=/home/msomeki/00_systems/espnet3/tools/ffmpeg-release:/home/msomeki/00_systems/espnet3/tools/festival/bin:/home/msomeki/00_systems/espnet3/tools/MBROLA/Bin:/home/msomeki/00_systems/espnet3/tools/espeak-ng/bin:/home/msomeki/00_systems/espnet3/tools/BeamformIt:/home/msomeki/00_systems/espnet3/tools/kenlm/build/bin:/home/msomeki/00_systems/espnet3/tools/PESQ/P862_annex_A_2005_CD/source:/home/msomeki/00_systems/espnet3/tools/nkf/nkf-2.1.4:/home/msomeki/00_systems/espnet3/tools/moses/scripts/tokenizer:/home/msomeki/00_systems/espnet3/tools/moses/scripts/generic:/home/msomeki/00_systems/espnet3/tools/tools/moses/scripts/recaser:/home/msomeki/00_systems/espnet3/tools/moses/scripts/training:/home/msomeki/00_systems/espnet3/tools/mwerSegmenter:/home/msomeki/00_systems/espnet3/tools/sctk/bin:/home/msomeki/00_systems/espnet3/tools/sph2pipe:/home/msomeki/00_systems/espnet3/tools/sentencepiece_commands:/data/user_data/msomeki/espnet3/.venv/bin:/home/msomeki/.pixi/bin:/home/msomeki/local/bin:/home/msomeki/utils:/usr/share/Modules/bin:/home/msomeki/00_systems/espnet3/tools/ffmpeg-release:/home/msomeki/00_systems/espnet3/tools/festival/bin:/home/msomeki/00_systems/espnet3/tools/MBROLA/Bin:/home/msomeki/00_systems/espnet3/tools/espeak-ng/bin:/home/msomeki/00_systems/espnet3/tools/BeamformIt:/home/msomeki/00_systems/espnet3/tools/kenlm/build/bin:/home/msomeki/00_systems/espnet3/tools/PESQ/P862_annex_A_2005_CD/source:/home/msomeki/00_systems/espnet3/tools/nkf/nkf-2.1.4:/home/msomeki/00_systems/espnet3/tools/moses/scripts/tokenizer:/home/msomeki/00_systems/espnet3/tools/moses/scripts/generic:/home/msomeki/00_systems/espnet3/tools/tools/moses/scripts/recaser:/home/msomeki/00_systems/espnet3/tools/moses/scripts/training:/home/msomeki/00_systems/espnet3/tools/mwerSegmenter:/home/msomeki/00_systems/espnet3/tools/sctk/bin:/home/msomeki/00_systems/espnet3/tools/sph2pipe:/home/msomeki/00_systems/espnet3/tools/sentencepiece_commands:/home/msomeki/00_systems/espnet3/tools/ffmpeg-release:/home/msomeki/00_systems/espnet3/tools/festival/bin:/home/msomeki/00_systems/espnet3/tools/MBROLA/Bin:/home/msomeki/00_systems/espnet3/tools/espeak-ng/bin:/home/msomeki/00_systems/espnet3/tools/BeamformIt:/home/msomeki/00_systems/espnet3/tools/kenlm/build/bin:/home/msomeki/00_systems/espnet3/tools/PESQ/P862_annex_A_2005_CD/source:/home/msomeki/00_systems/espnet3/tools/nkf/nkf-2.1.4:/home/msomeki/00_systems/espnet3/tools/moses/scripts/tokenizer:/home/msomeki/00_systems/espnet3/tools/moses/scripts/generic:/home/msomeki/00_systems/espnet3/tools/tools/moses/scripts/recaser:/home/msomeki/00_systems/espnet3/tools/moses/scripts/training:/home/msomeki/00_systems/espnet3/tools/mwerSegmenter:/home/msomeki/00_systems/espnet3/tools/sctk/bin:/home/msomeki/00_systems/espnet3/tools/sph2pipe:/home/msomeki/00_systems/espnet3/tools/sentencepiece_commands:/home/msomeki/.pixi/bin:/home/msomeki/local/bin:/home/msomeki/utils:/home/msomeki/.local/bin:/home/msomeki/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin
|
| 70 |
+
PYTHONPATH=/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:
|
| 71 |
+
2026-01-14 00:31:52 | INFO | espnet3 | Train config content:
|
| 72 |
+
num_device: 1
|
| 73 |
+
num_nodes: 1
|
| 74 |
+
task: espnet3.systems.asr.task.ASRTask
|
| 75 |
+
recipe_dir: .
|
| 76 |
+
data_dir: ./data
|
| 77 |
+
exp_tag: train_asr_rnn_data_aug_debug
|
| 78 |
+
exp_dir: ./exp/train_asr_rnn_data_aug_debug
|
| 79 |
+
stats_dir: ./exp/stats
|
| 80 |
+
decode_dir: ./exp/train_asr_rnn_data_aug_debug/decode
|
| 81 |
+
dataset_dir: ./data/mini_an4
|
| 82 |
+
create_dataset:
|
| 83 |
+
func: src.create_dataset.create_dataset
|
| 84 |
+
dataset_dir: ./data/mini_an4
|
| 85 |
+
archive_path: ./../../egs2/mini_an4/asr1/downloads.tar.gz
|
| 86 |
+
dataset:
|
| 87 |
+
_target_: espnet3.components.data.data_organizer.DataOrganizer
|
| 88 |
+
train:
|
| 89 |
+
- name: train_nodev
|
| 90 |
+
dataset:
|
| 91 |
+
_target_: src.dataset.MiniAN4Dataset
|
| 92 |
+
manifest_path: ./data/mini_an4/manifest/train_nodev.tsv
|
| 93 |
+
valid:
|
| 94 |
+
- name: train_dev
|
| 95 |
+
dataset:
|
| 96 |
+
_target_: src.dataset.MiniAN4Dataset
|
| 97 |
+
manifest_path: ./data/mini_an4/manifest/train_dev.tsv
|
| 98 |
+
preprocessor:
|
| 99 |
+
_target_: espnet2.train.preprocessor.CommonPreprocessor
|
| 100 |
+
_convert_: all
|
| 101 |
+
fs: 16000
|
| 102 |
+
train: true
|
| 103 |
+
data_aug_effects:
|
| 104 |
+
- - 0.1
|
| 105 |
+
- contrast
|
| 106 |
+
- enhancement_amount: 75.0
|
| 107 |
+
- - 0.1
|
| 108 |
+
- highpass
|
| 109 |
+
- cutoff_freq: 5000
|
| 110 |
+
Q: 0.707
|
| 111 |
+
- - 0.1
|
| 112 |
+
- equalization
|
| 113 |
+
- center_freq: 1000
|
| 114 |
+
gain: 0
|
| 115 |
+
Q: 0.707
|
| 116 |
+
- - 0.1
|
| 117 |
+
- - - 0.3
|
| 118 |
+
- speed_perturb
|
| 119 |
+
- factor: 0.9
|
| 120 |
+
- - 0.3
|
| 121 |
+
- speed_perturb
|
| 122 |
+
- factor: 1.1
|
| 123 |
+
- - 0.3
|
| 124 |
+
- speed_perturb
|
| 125 |
+
- factor: 1.3
|
| 126 |
+
data_aug_num:
|
| 127 |
+
- 1
|
| 128 |
+
- 4
|
| 129 |
+
data_aug_prob: 1.0
|
| 130 |
+
token_type: bpe
|
| 131 |
+
token_list: ./data/bpe_30/tokens.txt
|
| 132 |
+
bpemodel: ./data/bpe_30/bpe.model
|
| 133 |
+
parallel:
|
| 134 |
+
env: local
|
| 135 |
+
n_workers: 1
|
| 136 |
+
dataloader:
|
| 137 |
+
collate_fn:
|
| 138 |
+
_target_: espnet2.train.collate_fn.CommonCollateFn
|
| 139 |
+
int_pad_value: -1
|
| 140 |
+
train:
|
| 141 |
+
multiple_iterator: false
|
| 142 |
+
num_shards: 1
|
| 143 |
+
iter_factory:
|
| 144 |
+
_target_: espnet2.iterators.sequence_iter_factory.SequenceIterFactory
|
| 145 |
+
shuffle: true
|
| 146 |
+
collate_fn:
|
| 147 |
+
_target_: espnet2.train.collate_fn.CommonCollateFn
|
| 148 |
+
int_pad_value: -1
|
| 149 |
+
num_workers: 0
|
| 150 |
+
batches:
|
| 151 |
+
type: sorted
|
| 152 |
+
shape_files:
|
| 153 |
+
- ./exp/stats/train/feats_shape
|
| 154 |
+
batch_size: 2
|
| 155 |
+
batch_bins: 200000
|
| 156 |
+
valid:
|
| 157 |
+
multiple_iterator: false
|
| 158 |
+
num_shards: 1
|
| 159 |
+
iter_factory:
|
| 160 |
+
_target_: espnet2.iterators.sequence_iter_factory.SequenceIterFactory
|
| 161 |
+
shuffle: false
|
| 162 |
+
collate_fn:
|
| 163 |
+
_target_: espnet2.train.collate_fn.CommonCollateFn
|
| 164 |
+
int_pad_value: -1
|
| 165 |
+
batches:
|
| 166 |
+
type: sorted
|
| 167 |
+
shape_files:
|
| 168 |
+
- ./exp/stats/valid/feats_shape
|
| 169 |
+
batch_size: 2
|
| 170 |
+
batch_bins: 200000
|
| 171 |
+
optim:
|
| 172 |
+
_target_: torch.optim.Adam
|
| 173 |
+
lr: 0.001
|
| 174 |
+
weight_decay: 0.0
|
| 175 |
+
scheduler:
|
| 176 |
+
_target_: torch.optim.lr_scheduler.ReduceLROnPlateau
|
| 177 |
+
mode: min
|
| 178 |
+
factor: 0.5
|
| 179 |
+
patience: 1
|
| 180 |
+
val_scheduler_criterion: valid/loss
|
| 181 |
+
best_model_criterion:
|
| 182 |
+
- - valid/acc
|
| 183 |
+
- 1
|
| 184 |
+
- max
|
| 185 |
+
trainer:
|
| 186 |
+
accelerator: auto
|
| 187 |
+
devices: 1
|
| 188 |
+
num_nodes: 1
|
| 189 |
+
accumulate_grad_batches: 1
|
| 190 |
+
check_val_every_n_epoch: 1
|
| 191 |
+
gradient_clip_val: 1.0
|
| 192 |
+
log_every_n_steps: 1
|
| 193 |
+
max_epochs: 1
|
| 194 |
+
limit_train_batches: 1
|
| 195 |
+
limit_val_batches: 1
|
| 196 |
+
precision: 32
|
| 197 |
+
logger:
|
| 198 |
+
- _target_: lightning.pytorch.loggers.TensorBoardLogger
|
| 199 |
+
save_dir: ./exp/train_asr_rnn_data_aug_debug/tensorboard
|
| 200 |
+
name: tb_logger
|
| 201 |
+
strategy: auto
|
| 202 |
+
tokenizer:
|
| 203 |
+
vocab_size: 30
|
| 204 |
+
character_coverage: 1.0
|
| 205 |
+
model_type: bpe
|
| 206 |
+
save_path: ./data/bpe_30
|
| 207 |
+
text_builder:
|
| 208 |
+
func: src.tokenizer.gather_training_text
|
| 209 |
+
manifest_path: ./data/mini_an4/manifest/train_nodev.tsv
|
| 210 |
+
model:
|
| 211 |
+
vocab_size: 30
|
| 212 |
+
token_list: ./data/bpe_30/tokens.txt
|
| 213 |
+
encoder: vgg_rnn
|
| 214 |
+
encoder_conf:
|
| 215 |
+
num_layers: 1
|
| 216 |
+
hidden_size: 2
|
| 217 |
+
output_size: 2
|
| 218 |
+
decoder: rnn
|
| 219 |
+
decoder_conf:
|
| 220 |
+
hidden_size: 2
|
| 221 |
+
normalize: utterance_mvn
|
| 222 |
+
normalize_conf: {}
|
| 223 |
+
model_conf:
|
| 224 |
+
ctc_weight: 0.3
|
| 225 |
+
lsm_weight: 0.1
|
| 226 |
+
length_normalized_loss: false
|
| 227 |
+
frontend: default
|
| 228 |
+
frontend_conf:
|
| 229 |
+
n_fft: 512
|
| 230 |
+
win_length: 400
|
| 231 |
+
hop_length: 160
|
| 232 |
+
|
| 233 |
+
2026-01-14 00:31:52 | INFO | espnet3 | Publish config content:
|
| 234 |
+
pack_model:
|
| 235 |
+
strategy: auto
|
| 236 |
+
out_dir: exp/model_pack
|
| 237 |
+
readme_template: egs3/TEMPLATE/asr/demo_templates/readme.md
|
| 238 |
+
include: []
|
| 239 |
+
extra: []
|
| 240 |
+
exclude:
|
| 241 |
+
- '**/*.log'
|
| 242 |
+
- '**/tensorboard/**'
|
| 243 |
+
- '**/wandb/**'
|
| 244 |
+
files:
|
| 245 |
+
asr_model_file: exp/train_asr_rnn_data_aug_debug/epoch0_step1_valid.acc.ckpt
|
| 246 |
+
yaml_files:
|
| 247 |
+
asr_train_config: exp/train_asr_rnn_data_aug_debug/config.yaml
|
| 248 |
+
espnet2:
|
| 249 |
+
task: asr
|
| 250 |
+
yaml_files: {}
|
| 251 |
+
files: {}
|
| 252 |
+
option: []
|
| 253 |
+
upload_model:
|
| 254 |
+
hf_repo: ms180/mini_an4_integration_test
|
| 255 |
+
|
| 256 |
+
2026-01-14 00:31:52 | INFO | espnet3 | === [START] stage: pack_model ===
|
| 257 |
+
2026-01-14 00:31:52 | ERROR | espnet3 | Stage 'pack_model' failed after 0.00s
|
| 258 |
+
Traceback (most recent call last):
|
| 259 |
+
File "/home/msomeki/00_systems/espnet3/espnet3/utils/stages.py", line 85, in run_stages
|
| 260 |
+
fn()
|
| 261 |
+
File "/home/msomeki/00_systems/espnet3/espnet3/systems/asr/system.py", line 237, in pack_model
|
| 262 |
+
from espnet3.utils.publish import pack_model
|
| 263 |
+
File "/home/msomeki/00_systems/espnet3/espnet3/utils/publish.py", line 386
|
| 264 |
+
context = {
|
| 265 |
+
IndentationError: unexpected indent
|
exp/pack_model5.log
ADDED
|
@@ -0,0 +1,258 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
2026-01-14 00:33:19 | INFO | espnet3 | === ESPnet3 run started: 2026-01-14T00:33:19.688916 ===
|
| 2 |
+
2026-01-14 00:33:19 | INFO | espnet3 | Command: /data/user_data/msomeki/espnet3/.venv/bin/python run.py --stage pack_model --publish_config conf/publish.yaml --train_config conf/train.yaml
|
| 3 |
+
2026-01-14 00:33:19 | INFO | espnet3 | Python: 3.11.13 (main, Aug 18 2025, 19:19:13) [Clang 20.1.4 ]
|
| 4 |
+
2026-01-14 00:33:19 | INFO | espnet3 | Working directory: /home/msomeki/00_systems/espnet3/egs3/mini_an4/asr
|
| 5 |
+
2026-01-14 00:33:19 | INFO | espnet3 | train config: /home/msomeki/00_systems/espnet3/egs3/mini_an4/asr/conf/train_asr_rnn_data_aug_debug.yaml
|
| 6 |
+
2026-01-14 00:33:19 | INFO | espnet3 | publish config: /home/msomeki/00_systems/espnet3/egs3/mini_an4/asr/conf/publish.yaml
|
| 7 |
+
2026-01-14 00:33:20 | INFO | espnet3 | Git: commit=8509faad9811b58d5024f29fb9d68ffb026b5e73, short_commit=8509faad9, branch=espnet3/recipe/asr_ls100, worktree=dirty
|
| 8 |
+
2026-01-14 00:33:20 | INFO | espnet3 | Cluster env:
|
| 9 |
+
OMPI_MCA_plm_slurm_args=--external-launcher
|
| 10 |
+
SLURM_CLUSTER_NAME=babel
|
| 11 |
+
SLURM_CONF=/var/spool/slurmd/conf-cache/slurm.conf
|
| 12 |
+
SLURM_CPUS_ON_NODE=1
|
| 13 |
+
SLURM_CPUS_PER_TASK=1
|
| 14 |
+
SLURM_CPU_BIND=quiet,mask_cpu:0x0000000000010000
|
| 15 |
+
SLURM_CPU_BIND_LIST=0x0000000000010000
|
| 16 |
+
SLURM_CPU_BIND_TYPE=mask_cpu:
|
| 17 |
+
SLURM_CPU_BIND_VERBOSE=quiet
|
| 18 |
+
SLURM_DISTRIBUTION=cyclic,pack
|
| 19 |
+
SLURM_GTIDS=0
|
| 20 |
+
SLURM_JOBID=6122041
|
| 21 |
+
SLURM_JOB_ACCOUNT=swatanab
|
| 22 |
+
SLURM_JOB_CPUS_PER_NODE=1
|
| 23 |
+
SLURM_JOB_END_TIME=1768401875
|
| 24 |
+
SLURM_JOB_GID=2709140
|
| 25 |
+
SLURM_JOB_GROUP=msomeki
|
| 26 |
+
SLURM_JOB_ID=6122041
|
| 27 |
+
SLURM_JOB_NAME=bash
|
| 28 |
+
SLURM_JOB_NODELIST=babel-o9-16
|
| 29 |
+
SLURM_JOB_NUM_NODES=1
|
| 30 |
+
SLURM_JOB_PARTITION=debug
|
| 31 |
+
SLURM_JOB_QOS=debug_qos
|
| 32 |
+
SLURM_JOB_START_TIME=1768358675
|
| 33 |
+
SLURM_JOB_UID=2709140
|
| 34 |
+
SLURM_JOB_USER=msomeki
|
| 35 |
+
SLURM_LAUNCH_NODE_IPADDR=172.16.1.2
|
| 36 |
+
SLURM_LOCALID=0
|
| 37 |
+
SLURM_MEM_PER_NODE=4096
|
| 38 |
+
SLURM_NNODES=1
|
| 39 |
+
SLURM_NODEID=0
|
| 40 |
+
SLURM_NODELIST=babel-o9-16
|
| 41 |
+
SLURM_NPROCS=1
|
| 42 |
+
SLURM_NTASKS=1
|
| 43 |
+
SLURM_NTASKS_PER_NODE=1
|
| 44 |
+
SLURM_PRIO_PROCESS=0
|
| 45 |
+
SLURM_PROCID=0
|
| 46 |
+
SLURM_PTY_PORT=40465
|
| 47 |
+
SLURM_PTY_WIN_COL=112
|
| 48 |
+
SLURM_PTY_WIN_ROW=61
|
| 49 |
+
SLURM_SCRIPT_CONTEXT=prolog_task
|
| 50 |
+
SLURM_SRUN_COMM_HOST=172.16.1.2
|
| 51 |
+
SLURM_SRUN_COMM_PORT=33789
|
| 52 |
+
SLURM_STEPID=0
|
| 53 |
+
SLURM_STEP_ID=0
|
| 54 |
+
SLURM_STEP_LAUNCHER_PORT=33789
|
| 55 |
+
SLURM_STEP_NODELIST=babel-o9-16
|
| 56 |
+
SLURM_STEP_NUM_NODES=1
|
| 57 |
+
SLURM_STEP_NUM_TASKS=1
|
| 58 |
+
SLURM_STEP_TASKS_PER_NODE=1
|
| 59 |
+
SLURM_SUBMIT_DIR=/home/msomeki/00_systems/espnet3
|
| 60 |
+
SLURM_SUBMIT_HOST=login1
|
| 61 |
+
SLURM_TASKS_PER_NODE=1
|
| 62 |
+
SLURM_TASK_PID=3334910
|
| 63 |
+
SLURM_TOPOLOGY_ADDR=babel-o9-16
|
| 64 |
+
SLURM_TOPOLOGY_ADDR_PATTERN=node
|
| 65 |
+
SLURM_TRES_PER_TASK=cpu=1
|
| 66 |
+
SLURM_UMASK=0027
|
| 67 |
+
2026-01-14 00:33:20 | INFO | espnet3 | Runtime env:
|
| 68 |
+
LD_LIBRARY_PATH=/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:
|
| 69 |
+
PATH=/home/msomeki/00_systems/espnet3/tools/ffmpeg-release:/home/msomeki/00_systems/espnet3/tools/festival/bin:/home/msomeki/00_systems/espnet3/tools/MBROLA/Bin:/home/msomeki/00_systems/espnet3/tools/espeak-ng/bin:/home/msomeki/00_systems/espnet3/tools/BeamformIt:/home/msomeki/00_systems/espnet3/tools/kenlm/build/bin:/home/msomeki/00_systems/espnet3/tools/PESQ/P862_annex_A_2005_CD/source:/home/msomeki/00_systems/espnet3/tools/nkf/nkf-2.1.4:/home/msomeki/00_systems/espnet3/tools/moses/scripts/tokenizer:/home/msomeki/00_systems/espnet3/tools/moses/scripts/generic:/home/msomeki/00_systems/espnet3/tools/tools/moses/scripts/recaser:/home/msomeki/00_systems/espnet3/tools/moses/scripts/training:/home/msomeki/00_systems/espnet3/tools/mwerSegmenter:/home/msomeki/00_systems/espnet3/tools/sctk/bin:/home/msomeki/00_systems/espnet3/tools/sph2pipe:/home/msomeki/00_systems/espnet3/tools/sentencepiece_commands:/data/user_data/msomeki/espnet3/.venv/bin:/home/msomeki/.pixi/bin:/home/msomeki/local/bin:/home/msomeki/utils:/usr/share/Modules/bin:/home/msomeki/00_systems/espnet3/tools/ffmpeg-release:/home/msomeki/00_systems/espnet3/tools/festival/bin:/home/msomeki/00_systems/espnet3/tools/MBROLA/Bin:/home/msomeki/00_systems/espnet3/tools/espeak-ng/bin:/home/msomeki/00_systems/espnet3/tools/BeamformIt:/home/msomeki/00_systems/espnet3/tools/kenlm/build/bin:/home/msomeki/00_systems/espnet3/tools/PESQ/P862_annex_A_2005_CD/source:/home/msomeki/00_systems/espnet3/tools/nkf/nkf-2.1.4:/home/msomeki/00_systems/espnet3/tools/moses/scripts/tokenizer:/home/msomeki/00_systems/espnet3/tools/moses/scripts/generic:/home/msomeki/00_systems/espnet3/tools/tools/moses/scripts/recaser:/home/msomeki/00_systems/espnet3/tools/moses/scripts/training:/home/msomeki/00_systems/espnet3/tools/mwerSegmenter:/home/msomeki/00_systems/espnet3/tools/sctk/bin:/home/msomeki/00_systems/espnet3/tools/sph2pipe:/home/msomeki/00_systems/espnet3/tools/sentencepiece_commands:/home/msomeki/00_systems/espnet3/tools/ffmpeg-release:/home/msomeki/00_systems/espnet3/tools/festival/bin:/home/msomeki/00_systems/espnet3/tools/MBROLA/Bin:/home/msomeki/00_systems/espnet3/tools/espeak-ng/bin:/home/msomeki/00_systems/espnet3/tools/BeamformIt:/home/msomeki/00_systems/espnet3/tools/kenlm/build/bin:/home/msomeki/00_systems/espnet3/tools/PESQ/P862_annex_A_2005_CD/source:/home/msomeki/00_systems/espnet3/tools/nkf/nkf-2.1.4:/home/msomeki/00_systems/espnet3/tools/moses/scripts/tokenizer:/home/msomeki/00_systems/espnet3/tools/moses/scripts/generic:/home/msomeki/00_systems/espnet3/tools/tools/moses/scripts/recaser:/home/msomeki/00_systems/espnet3/tools/moses/scripts/training:/home/msomeki/00_systems/espnet3/tools/mwerSegmenter:/home/msomeki/00_systems/espnet3/tools/sctk/bin:/home/msomeki/00_systems/espnet3/tools/sph2pipe:/home/msomeki/00_systems/espnet3/tools/sentencepiece_commands:/home/msomeki/.pixi/bin:/home/msomeki/local/bin:/home/msomeki/utils:/home/msomeki/.local/bin:/home/msomeki/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin
|
| 70 |
+
PYTHONPATH=/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:
|
| 71 |
+
2026-01-14 00:33:20 | INFO | espnet3 | Train config content:
|
| 72 |
+
num_device: 1
|
| 73 |
+
num_nodes: 1
|
| 74 |
+
task: espnet3.systems.asr.task.ASRTask
|
| 75 |
+
recipe_dir: .
|
| 76 |
+
data_dir: ./data
|
| 77 |
+
exp_tag: train_asr_rnn_data_aug_debug
|
| 78 |
+
exp_dir: ./exp/train_asr_rnn_data_aug_debug
|
| 79 |
+
stats_dir: ./exp/stats
|
| 80 |
+
decode_dir: ./exp/train_asr_rnn_data_aug_debug/decode
|
| 81 |
+
dataset_dir: ./data/mini_an4
|
| 82 |
+
create_dataset:
|
| 83 |
+
func: src.create_dataset.create_dataset
|
| 84 |
+
dataset_dir: ./data/mini_an4
|
| 85 |
+
archive_path: ./../../egs2/mini_an4/asr1/downloads.tar.gz
|
| 86 |
+
dataset:
|
| 87 |
+
_target_: espnet3.components.data.data_organizer.DataOrganizer
|
| 88 |
+
train:
|
| 89 |
+
- name: train_nodev
|
| 90 |
+
dataset:
|
| 91 |
+
_target_: src.dataset.MiniAN4Dataset
|
| 92 |
+
manifest_path: ./data/mini_an4/manifest/train_nodev.tsv
|
| 93 |
+
valid:
|
| 94 |
+
- name: train_dev
|
| 95 |
+
dataset:
|
| 96 |
+
_target_: src.dataset.MiniAN4Dataset
|
| 97 |
+
manifest_path: ./data/mini_an4/manifest/train_dev.tsv
|
| 98 |
+
preprocessor:
|
| 99 |
+
_target_: espnet2.train.preprocessor.CommonPreprocessor
|
| 100 |
+
_convert_: all
|
| 101 |
+
fs: 16000
|
| 102 |
+
train: true
|
| 103 |
+
data_aug_effects:
|
| 104 |
+
- - 0.1
|
| 105 |
+
- contrast
|
| 106 |
+
- enhancement_amount: 75.0
|
| 107 |
+
- - 0.1
|
| 108 |
+
- highpass
|
| 109 |
+
- cutoff_freq: 5000
|
| 110 |
+
Q: 0.707
|
| 111 |
+
- - 0.1
|
| 112 |
+
- equalization
|
| 113 |
+
- center_freq: 1000
|
| 114 |
+
gain: 0
|
| 115 |
+
Q: 0.707
|
| 116 |
+
- - 0.1
|
| 117 |
+
- - - 0.3
|
| 118 |
+
- speed_perturb
|
| 119 |
+
- factor: 0.9
|
| 120 |
+
- - 0.3
|
| 121 |
+
- speed_perturb
|
| 122 |
+
- factor: 1.1
|
| 123 |
+
- - 0.3
|
| 124 |
+
- speed_perturb
|
| 125 |
+
- factor: 1.3
|
| 126 |
+
data_aug_num:
|
| 127 |
+
- 1
|
| 128 |
+
- 4
|
| 129 |
+
data_aug_prob: 1.0
|
| 130 |
+
token_type: bpe
|
| 131 |
+
token_list: ./data/bpe_30/tokens.txt
|
| 132 |
+
bpemodel: ./data/bpe_30/bpe.model
|
| 133 |
+
parallel:
|
| 134 |
+
env: local
|
| 135 |
+
n_workers: 1
|
| 136 |
+
dataloader:
|
| 137 |
+
collate_fn:
|
| 138 |
+
_target_: espnet2.train.collate_fn.CommonCollateFn
|
| 139 |
+
int_pad_value: -1
|
| 140 |
+
train:
|
| 141 |
+
multiple_iterator: false
|
| 142 |
+
num_shards: 1
|
| 143 |
+
iter_factory:
|
| 144 |
+
_target_: espnet2.iterators.sequence_iter_factory.SequenceIterFactory
|
| 145 |
+
shuffle: true
|
| 146 |
+
collate_fn:
|
| 147 |
+
_target_: espnet2.train.collate_fn.CommonCollateFn
|
| 148 |
+
int_pad_value: -1
|
| 149 |
+
num_workers: 0
|
| 150 |
+
batches:
|
| 151 |
+
type: sorted
|
| 152 |
+
shape_files:
|
| 153 |
+
- ./exp/stats/train/feats_shape
|
| 154 |
+
batch_size: 2
|
| 155 |
+
batch_bins: 200000
|
| 156 |
+
valid:
|
| 157 |
+
multiple_iterator: false
|
| 158 |
+
num_shards: 1
|
| 159 |
+
iter_factory:
|
| 160 |
+
_target_: espnet2.iterators.sequence_iter_factory.SequenceIterFactory
|
| 161 |
+
shuffle: false
|
| 162 |
+
collate_fn:
|
| 163 |
+
_target_: espnet2.train.collate_fn.CommonCollateFn
|
| 164 |
+
int_pad_value: -1
|
| 165 |
+
batches:
|
| 166 |
+
type: sorted
|
| 167 |
+
shape_files:
|
| 168 |
+
- ./exp/stats/valid/feats_shape
|
| 169 |
+
batch_size: 2
|
| 170 |
+
batch_bins: 200000
|
| 171 |
+
optim:
|
| 172 |
+
_target_: torch.optim.Adam
|
| 173 |
+
lr: 0.001
|
| 174 |
+
weight_decay: 0.0
|
| 175 |
+
scheduler:
|
| 176 |
+
_target_: torch.optim.lr_scheduler.ReduceLROnPlateau
|
| 177 |
+
mode: min
|
| 178 |
+
factor: 0.5
|
| 179 |
+
patience: 1
|
| 180 |
+
val_scheduler_criterion: valid/loss
|
| 181 |
+
best_model_criterion:
|
| 182 |
+
- - valid/acc
|
| 183 |
+
- 1
|
| 184 |
+
- max
|
| 185 |
+
trainer:
|
| 186 |
+
accelerator: auto
|
| 187 |
+
devices: 1
|
| 188 |
+
num_nodes: 1
|
| 189 |
+
accumulate_grad_batches: 1
|
| 190 |
+
check_val_every_n_epoch: 1
|
| 191 |
+
gradient_clip_val: 1.0
|
| 192 |
+
log_every_n_steps: 1
|
| 193 |
+
max_epochs: 1
|
| 194 |
+
limit_train_batches: 1
|
| 195 |
+
limit_val_batches: 1
|
| 196 |
+
precision: 32
|
| 197 |
+
logger:
|
| 198 |
+
- _target_: lightning.pytorch.loggers.TensorBoardLogger
|
| 199 |
+
save_dir: ./exp/train_asr_rnn_data_aug_debug/tensorboard
|
| 200 |
+
name: tb_logger
|
| 201 |
+
strategy: auto
|
| 202 |
+
tokenizer:
|
| 203 |
+
vocab_size: 30
|
| 204 |
+
character_coverage: 1.0
|
| 205 |
+
model_type: bpe
|
| 206 |
+
save_path: ./data/bpe_30
|
| 207 |
+
text_builder:
|
| 208 |
+
func: src.tokenizer.gather_training_text
|
| 209 |
+
manifest_path: ./data/mini_an4/manifest/train_nodev.tsv
|
| 210 |
+
model:
|
| 211 |
+
vocab_size: 30
|
| 212 |
+
token_list: ./data/bpe_30/tokens.txt
|
| 213 |
+
encoder: vgg_rnn
|
| 214 |
+
encoder_conf:
|
| 215 |
+
num_layers: 1
|
| 216 |
+
hidden_size: 2
|
| 217 |
+
output_size: 2
|
| 218 |
+
decoder: rnn
|
| 219 |
+
decoder_conf:
|
| 220 |
+
hidden_size: 2
|
| 221 |
+
normalize: utterance_mvn
|
| 222 |
+
normalize_conf: {}
|
| 223 |
+
model_conf:
|
| 224 |
+
ctc_weight: 0.3
|
| 225 |
+
lsm_weight: 0.1
|
| 226 |
+
length_normalized_loss: false
|
| 227 |
+
frontend: default
|
| 228 |
+
frontend_conf:
|
| 229 |
+
n_fft: 512
|
| 230 |
+
win_length: 400
|
| 231 |
+
hop_length: 160
|
| 232 |
+
|
| 233 |
+
2026-01-14 00:33:20 | INFO | espnet3 | Publish config content:
|
| 234 |
+
pack_model:
|
| 235 |
+
strategy: auto
|
| 236 |
+
out_dir: exp/model_pack
|
| 237 |
+
readme_template: egs3/TEMPLATE/asr/demo_templates/readme.md
|
| 238 |
+
include: []
|
| 239 |
+
extra: []
|
| 240 |
+
exclude:
|
| 241 |
+
- '**/*.log'
|
| 242 |
+
- '**/tensorboard/**'
|
| 243 |
+
- '**/wandb/**'
|
| 244 |
+
files:
|
| 245 |
+
asr_model_file: exp/train_asr_rnn_data_aug_debug/epoch0_step1_valid.acc.ckpt
|
| 246 |
+
yaml_files:
|
| 247 |
+
asr_train_config: exp/train_asr_rnn_data_aug_debug/config.yaml
|
| 248 |
+
espnet2:
|
| 249 |
+
task: asr
|
| 250 |
+
yaml_files: {}
|
| 251 |
+
files: {}
|
| 252 |
+
option: []
|
| 253 |
+
upload_model:
|
| 254 |
+
hf_repo: ms180/mini_an4_integration_test
|
| 255 |
+
|
| 256 |
+
2026-01-14 00:33:20 | INFO | espnet3 | === [START] stage: pack_model ===
|
| 257 |
+
2026-01-14 00:33:20 | INFO | espnet3.utils.publish | Packed model to exp/model_pack
|
| 258 |
+
2026-01-14 00:33:20 | INFO | espnet3 | === [DONE] stage: pack_model (0.52s) ===
|
exp/step1.ckpt
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 3813993
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:3660995efc92eddb8814cb11b32d1b6f7387e30ffa5414efc175c167323052c3
|
| 3 |
size 3813993
|
exp/train.log
CHANGED
|
@@ -1,12 +1,12 @@
|
|
| 1 |
-
2026-01-
|
| 2 |
-
2026-01-
|
| 3 |
-
2026-01-
|
| 4 |
-
2026-01-
|
| 5 |
-
2026-01-
|
| 6 |
-
2026-01-
|
| 7 |
-
2026-01-
|
| 8 |
-
2026-01-
|
| 9 |
-
2026-01-
|
| 10 |
OMPI_MCA_plm_slurm_args=--external-launcher
|
| 11 |
SLURM_CLUSTER_NAME=babel
|
| 12 |
SLURM_CONF=/var/spool/slurmd/conf-cache/slurm.conf
|
|
@@ -65,11 +65,11 @@ SLURM_TOPOLOGY_ADDR=babel-o9-16
|
|
| 65 |
SLURM_TOPOLOGY_ADDR_PATTERN=node
|
| 66 |
SLURM_TRES_PER_TASK=cpu=1
|
| 67 |
SLURM_UMASK=0027
|
| 68 |
-
2026-01-
|
| 69 |
-
LD_LIBRARY_PATH=/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:
|
| 70 |
PATH=/home/msomeki/00_systems/espnet3/tools/ffmpeg-release:/home/msomeki/00_systems/espnet3/tools/festival/bin:/home/msomeki/00_systems/espnet3/tools/MBROLA/Bin:/home/msomeki/00_systems/espnet3/tools/espeak-ng/bin:/home/msomeki/00_systems/espnet3/tools/BeamformIt:/home/msomeki/00_systems/espnet3/tools/kenlm/build/bin:/home/msomeki/00_systems/espnet3/tools/PESQ/P862_annex_A_2005_CD/source:/home/msomeki/00_systems/espnet3/tools/nkf/nkf-2.1.4:/home/msomeki/00_systems/espnet3/tools/moses/scripts/tokenizer:/home/msomeki/00_systems/espnet3/tools/moses/scripts/generic:/home/msomeki/00_systems/espnet3/tools/tools/moses/scripts/recaser:/home/msomeki/00_systems/espnet3/tools/moses/scripts/training:/home/msomeki/00_systems/espnet3/tools/mwerSegmenter:/home/msomeki/00_systems/espnet3/tools/sctk/bin:/home/msomeki/00_systems/espnet3/tools/sph2pipe:/home/msomeki/00_systems/espnet3/tools/sentencepiece_commands:/data/user_data/msomeki/espnet3/.venv/bin:/home/msomeki/.pixi/bin:/home/msomeki/local/bin:/home/msomeki/utils:/usr/share/Modules/bin:/home/msomeki/00_systems/espnet3/tools/ffmpeg-release:/home/msomeki/00_systems/espnet3/tools/festival/bin:/home/msomeki/00_systems/espnet3/tools/MBROLA/Bin:/home/msomeki/00_systems/espnet3/tools/espeak-ng/bin:/home/msomeki/00_systems/espnet3/tools/BeamformIt:/home/msomeki/00_systems/espnet3/tools/kenlm/build/bin:/home/msomeki/00_systems/espnet3/tools/PESQ/P862_annex_A_2005_CD/source:/home/msomeki/00_systems/espnet3/tools/nkf/nkf-2.1.4:/home/msomeki/00_systems/espnet3/tools/moses/scripts/tokenizer:/home/msomeki/00_systems/espnet3/tools/moses/scripts/generic:/home/msomeki/00_systems/espnet3/tools/tools/moses/scripts/recaser:/home/msomeki/00_systems/espnet3/tools/moses/scripts/training:/home/msomeki/00_systems/espnet3/tools/mwerSegmenter:/home/msomeki/00_systems/espnet3/tools/sctk/bin:/home/msomeki/00_systems/espnet3/tools/sph2pipe:/home/msomeki/00_systems/espnet3/tools/sentencepiece_commands:/home/msomeki/00_systems/espnet3/tools/ffmpeg-release:/home/msomeki/00_systems/espnet3/tools/festival/bin:/home/msomeki/00_systems/espnet3/tools/MBROLA/Bin:/home/msomeki/00_systems/espnet3/tools/espeak-ng/bin:/home/msomeki/00_systems/espnet3/tools/BeamformIt:/home/msomeki/00_systems/espnet3/tools/kenlm/build/bin:/home/msomeki/00_systems/espnet3/tools/PESQ/P862_annex_A_2005_CD/source:/home/msomeki/00_systems/espnet3/tools/nkf/nkf-2.1.4:/home/msomeki/00_systems/espnet3/tools/moses/scripts/tokenizer:/home/msomeki/00_systems/espnet3/tools/moses/scripts/generic:/home/msomeki/00_systems/espnet3/tools/tools/moses/scripts/recaser:/home/msomeki/00_systems/espnet3/tools/moses/scripts/training:/home/msomeki/00_systems/espnet3/tools/mwerSegmenter:/home/msomeki/00_systems/espnet3/tools/sctk/bin:/home/msomeki/00_systems/espnet3/tools/sph2pipe:/home/msomeki/00_systems/espnet3/tools/sentencepiece_commands:/home/msomeki/.pixi/bin:/home/msomeki/local/bin:/home/msomeki/utils:/home/msomeki/.local/bin:/home/msomeki/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin
|
| 71 |
-
PYTHONPATH=/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:
|
| 72 |
-
2026-01-
|
| 73 |
num_device: 1
|
| 74 |
num_nodes: 1
|
| 75 |
task: espnet3.systems.asr.task.ASRTask
|
|
@@ -226,7 +226,7 @@ model:
|
|
| 226 |
win_length: 400
|
| 227 |
hop_length: 160
|
| 228 |
|
| 229 |
-
2026-01-
|
| 230 |
num_device: 1
|
| 231 |
num_nodes: 1
|
| 232 |
recipe_dir: .
|
|
@@ -258,7 +258,7 @@ tokenizer:
|
|
| 258 |
model_type: bpe
|
| 259 |
save_path: ./data/bpe_30
|
| 260 |
|
| 261 |
-
2026-01-
|
| 262 |
recipe_dir: .
|
| 263 |
data_dir: ./data
|
| 264 |
exp_tag: train_asr_rnn_data_aug_debug
|
|
@@ -281,11 +281,11 @@ metrics:
|
|
| 281 |
_target_: espnet3.systems.asr.metrics.cer.CER
|
| 282 |
clean_types: null
|
| 283 |
|
| 284 |
-
2026-01-
|
| 285 |
-
2026-01-
|
| 286 |
-
2026-01-
|
| 287 |
-
2026-01-
|
| 288 |
-
2026-01-
|
| 289 |
ESPnetASRModel(
|
| 290 |
(frontend): DefaultFrontend(
|
| 291 |
(stft): Stft(n_fft=512, win_length=400, hop_length=160, center=True, normalized=False, onesided=True)
|
|
@@ -335,15 +335,15 @@ ESPnetASRModel(
|
|
| 335 |
(ctc_loss): CTCLoss()
|
| 336 |
)
|
| 337 |
)
|
| 338 |
-
2026-01-
|
| 339 |
|
| 340 |
-
2026-01-
|
| 341 |
-
2026-01-
|
| 342 |
-
2026-01-
|
| 343 |
-
2026-01-
|
| 344 |
-
2026-01-
|
| 345 |
|
| 346 |
-
2026-01-
|
| 347 |
| Name | Type | Params | Mode | FLOPs
|
| 348 |
---------------------------------------------------------
|
| 349 |
0 | model | ESPnetASRModel | 307 K | train | 0
|
|
@@ -355,17 +355,17 @@ ESPnetASRModel(
|
|
| 355 |
35 Modules in train mode
|
| 356 |
1 Modules in eval mode
|
| 357 |
0 Total Flops
|
| 358 |
-
2026-01-
|
| 359 |
with autocast(self.autocast_frontend, dtype=autocast_type):
|
| 360 |
|
| 361 |
-
2026-01-
|
| 362 |
-
2026-01-
|
| 363 |
-
2026-01-
|
| 364 |
|
| 365 |
-
2026-01-
|
| 366 |
-
2026-01-
|
| 367 |
-
2026-01-
|
| 368 |
-
2026-01-
|
| 369 |
-
2026-01-
|
| 370 |
-
2026-01-
|
| 371 |
-
2026-01-
|
|
|
|
| 1 |
+
2026-01-14 00:19:21 | INFO | espnet3 | === ESPnet3 run started: 2026-01-14T00:19:21.364830 ===
|
| 2 |
+
2026-01-14 00:19:21 | INFO | espnet3 | Command: /data/user_data/msomeki/espnet3/.venv/bin/python3 run.py --stages create_dataset train_tokenizer collect_stats train infer measure --train_config conf/train.yaml --infer_config conf/infer.yaml --measure_config conf/measure.yaml
|
| 3 |
+
2026-01-14 00:19:21 | INFO | espnet3 | Python: 3.11.13 (main, Aug 18 2025, 19:19:13) [Clang 20.1.4 ]
|
| 4 |
+
2026-01-14 00:19:21 | INFO | espnet3 | Working directory: /home/msomeki/00_systems/espnet3/egs3/mini_an4/asr
|
| 5 |
+
2026-01-14 00:19:21 | INFO | espnet3 | train config: /home/msomeki/00_systems/espnet3/egs3/mini_an4/asr/conf/train_asr_rnn_data_aug_debug.yaml
|
| 6 |
+
2026-01-14 00:19:21 | INFO | espnet3 | infer config: /home/msomeki/00_systems/espnet3/egs3/mini_an4/asr/conf/infer.yaml
|
| 7 |
+
2026-01-14 00:19:21 | INFO | espnet3 | measure config: /home/msomeki/00_systems/espnet3/egs3/mini_an4/asr/conf/measure.yaml
|
| 8 |
+
2026-01-14 00:19:21 | INFO | espnet3 | Git: commit=8509faad9811b58d5024f29fb9d68ffb026b5e73, short_commit=8509faad9, branch=espnet3/recipe/asr_ls100, worktree=dirty
|
| 9 |
+
2026-01-14 00:19:21 | INFO | espnet3 | Cluster env:
|
| 10 |
OMPI_MCA_plm_slurm_args=--external-launcher
|
| 11 |
SLURM_CLUSTER_NAME=babel
|
| 12 |
SLURM_CONF=/var/spool/slurmd/conf-cache/slurm.conf
|
|
|
|
| 65 |
SLURM_TOPOLOGY_ADDR_PATTERN=node
|
| 66 |
SLURM_TRES_PER_TASK=cpu=1
|
| 67 |
SLURM_UMASK=0027
|
| 68 |
+
2026-01-14 00:19:21 | INFO | espnet3 | Runtime env:
|
| 69 |
+
LD_LIBRARY_PATH=/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:
|
| 70 |
PATH=/home/msomeki/00_systems/espnet3/tools/ffmpeg-release:/home/msomeki/00_systems/espnet3/tools/festival/bin:/home/msomeki/00_systems/espnet3/tools/MBROLA/Bin:/home/msomeki/00_systems/espnet3/tools/espeak-ng/bin:/home/msomeki/00_systems/espnet3/tools/BeamformIt:/home/msomeki/00_systems/espnet3/tools/kenlm/build/bin:/home/msomeki/00_systems/espnet3/tools/PESQ/P862_annex_A_2005_CD/source:/home/msomeki/00_systems/espnet3/tools/nkf/nkf-2.1.4:/home/msomeki/00_systems/espnet3/tools/moses/scripts/tokenizer:/home/msomeki/00_systems/espnet3/tools/moses/scripts/generic:/home/msomeki/00_systems/espnet3/tools/tools/moses/scripts/recaser:/home/msomeki/00_systems/espnet3/tools/moses/scripts/training:/home/msomeki/00_systems/espnet3/tools/mwerSegmenter:/home/msomeki/00_systems/espnet3/tools/sctk/bin:/home/msomeki/00_systems/espnet3/tools/sph2pipe:/home/msomeki/00_systems/espnet3/tools/sentencepiece_commands:/data/user_data/msomeki/espnet3/.venv/bin:/home/msomeki/.pixi/bin:/home/msomeki/local/bin:/home/msomeki/utils:/usr/share/Modules/bin:/home/msomeki/00_systems/espnet3/tools/ffmpeg-release:/home/msomeki/00_systems/espnet3/tools/festival/bin:/home/msomeki/00_systems/espnet3/tools/MBROLA/Bin:/home/msomeki/00_systems/espnet3/tools/espeak-ng/bin:/home/msomeki/00_systems/espnet3/tools/BeamformIt:/home/msomeki/00_systems/espnet3/tools/kenlm/build/bin:/home/msomeki/00_systems/espnet3/tools/PESQ/P862_annex_A_2005_CD/source:/home/msomeki/00_systems/espnet3/tools/nkf/nkf-2.1.4:/home/msomeki/00_systems/espnet3/tools/moses/scripts/tokenizer:/home/msomeki/00_systems/espnet3/tools/moses/scripts/generic:/home/msomeki/00_systems/espnet3/tools/tools/moses/scripts/recaser:/home/msomeki/00_systems/espnet3/tools/moses/scripts/training:/home/msomeki/00_systems/espnet3/tools/mwerSegmenter:/home/msomeki/00_systems/espnet3/tools/sctk/bin:/home/msomeki/00_systems/espnet3/tools/sph2pipe:/home/msomeki/00_systems/espnet3/tools/sentencepiece_commands:/home/msomeki/00_systems/espnet3/tools/ffmpeg-release:/home/msomeki/00_systems/espnet3/tools/festival/bin:/home/msomeki/00_systems/espnet3/tools/MBROLA/Bin:/home/msomeki/00_systems/espnet3/tools/espeak-ng/bin:/home/msomeki/00_systems/espnet3/tools/BeamformIt:/home/msomeki/00_systems/espnet3/tools/kenlm/build/bin:/home/msomeki/00_systems/espnet3/tools/PESQ/P862_annex_A_2005_CD/source:/home/msomeki/00_systems/espnet3/tools/nkf/nkf-2.1.4:/home/msomeki/00_systems/espnet3/tools/moses/scripts/tokenizer:/home/msomeki/00_systems/espnet3/tools/moses/scripts/generic:/home/msomeki/00_systems/espnet3/tools/tools/moses/scripts/recaser:/home/msomeki/00_systems/espnet3/tools/moses/scripts/training:/home/msomeki/00_systems/espnet3/tools/mwerSegmenter:/home/msomeki/00_systems/espnet3/tools/sctk/bin:/home/msomeki/00_systems/espnet3/tools/sph2pipe:/home/msomeki/00_systems/espnet3/tools/sentencepiece_commands:/home/msomeki/.pixi/bin:/home/msomeki/local/bin:/home/msomeki/utils:/home/msomeki/.local/bin:/home/msomeki/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin
|
| 71 |
+
PYTHONPATH=/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:
|
| 72 |
+
2026-01-14 00:19:21 | INFO | espnet3 | Train config content:
|
| 73 |
num_device: 1
|
| 74 |
num_nodes: 1
|
| 75 |
task: espnet3.systems.asr.task.ASRTask
|
|
|
|
| 226 |
win_length: 400
|
| 227 |
hop_length: 160
|
| 228 |
|
| 229 |
+
2026-01-14 00:19:21 | INFO | espnet3 | Infer config content:
|
| 230 |
num_device: 1
|
| 231 |
num_nodes: 1
|
| 232 |
recipe_dir: .
|
|
|
|
| 258 |
model_type: bpe
|
| 259 |
save_path: ./data/bpe_30
|
| 260 |
|
| 261 |
+
2026-01-14 00:19:21 | INFO | espnet3 | Measure config content:
|
| 262 |
recipe_dir: .
|
| 263 |
data_dir: ./data
|
| 264 |
exp_tag: train_asr_rnn_data_aug_debug
|
|
|
|
| 281 |
_target_: espnet3.systems.asr.metrics.cer.CER
|
| 282 |
clean_types: null
|
| 283 |
|
| 284 |
+
2026-01-14 00:19:21 | INFO | espnet3 | === [START] stage: train ===
|
| 285 |
+
2026-01-14 00:19:21 | INFO | espnet3.systems.asr.system | ASRSystem.train(): starting training process
|
| 286 |
+
2026-01-14 00:19:21 | INFO | espnet3.systems.base.system | Training start | exp_dir=./exp/train_asr_rnn_data_aug_debug model=<unknown>
|
| 287 |
+
2026-01-14 00:19:22 | INFO | root | Vocabulary size: 30
|
| 288 |
+
2026-01-14 00:19:22 | INFO | espnet3.systems.base.train | Model:
|
| 289 |
ESPnetASRModel(
|
| 290 |
(frontend): DefaultFrontend(
|
| 291 |
(stft): Stft(n_fft=512, win_length=400, hop_length=160, center=True, normalized=False, onesided=True)
|
|
|
|
| 335 |
(ctc_loss): CTCLoss()
|
| 336 |
)
|
| 337 |
)
|
| 338 |
+
2026-01-14 00:19:22 | WARNING | py.warnings | /data/user_data/msomeki/espnet3/.venv/lib/python3.11/site-packages/lightning/fabric/plugins/environments/slurm.py:204: The `srun` command is available on your system but is not used. HINT: If your intention is to run Lightning on SLURM, prepend your python command with `srun` like so: srun python3 run.py --stages create_dataset train_tokenizer coll ...
|
| 339 |
|
| 340 |
+
2026-01-14 00:19:22 | INFO | lightning.pytorch.utilities.rank_zero | GPU available: False, used: False
|
| 341 |
+
2026-01-14 00:19:22 | INFO | lightning.pytorch.utilities.rank_zero | TPU available: False, using: 0 TPU cores
|
| 342 |
+
2026-01-14 00:19:22 | INFO | lightning.pytorch.utilities.rank_zero | `Trainer(limit_train_batches=1)` was configured so 1 batch per epoch will be used.
|
| 343 |
+
2026-01-14 00:19:22 | INFO | lightning.pytorch.utilities.rank_zero | `Trainer(limit_val_batches=1)` was configured so 1 batch will be used.
|
| 344 |
+
2026-01-14 00:19:22 | WARNING | py.warnings | /data/user_data/msomeki/espnet3/.venv/lib/python3.11/site-packages/lightning/pytorch/callbacks/model_checkpoint.py:881: Checkpoint directory /home/msomeki/00_systems/espnet3/egs3/mini_an4/asr/exp/train_asr_rnn_data_aug_debug exists and is not empty.
|
| 345 |
|
| 346 |
+
2026-01-14 00:19:22 | INFO | lightning.pytorch.callbacks.model_summary |
|
| 347 |
| Name | Type | Params | Mode | FLOPs
|
| 348 |
---------------------------------------------------------
|
| 349 |
0 | model | ESPnetASRModel | 307 K | train | 0
|
|
|
|
| 355 |
35 Modules in train mode
|
| 356 |
1 Modules in eval mode
|
| 357 |
0 Total Flops
|
| 358 |
+
2026-01-14 00:19:22 | WARNING | py.warnings | /home/msomeki/00_systems/espnet3/espnet2/asr/espnet_model.py:402: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
|
| 359 |
with autocast(self.autocast_frontend, dtype=autocast_type):
|
| 360 |
|
| 361 |
+
2026-01-14 00:19:22 | WARNING | root | Using make_pad_mask with a list of lengths is not tracable. If you try to trace this function with type(lengths) == list, please change the type of lengths to torch.LongTensor.
|
| 362 |
+
2026-01-14 00:19:22 | WARNING | root | Using make_pad_mask with a list of lengths is not tracable. If you try to trace this function with type(lengths) == list, please change the type of lengths to torch.LongTensor.
|
| 363 |
+
2026-01-14 00:19:22 | WARNING | py.warnings | /data/user_data/msomeki/espnet3/.venv/lib/python3.11/site-packages/lightning/pytorch/loops/fit_loop.py:534: Found 1 module(s) in eval mode at the start of training. This may lead to unexpected behavior during training. If this is intentional, you can ignore this warning.
|
| 364 |
|
| 365 |
+
2026-01-14 00:19:22 | WARNING | root | Using make_pad_mask with a list of lengths is not tracable. If you try to trace this function with type(lengths) == list, please change the type of lengths to torch.LongTensor.
|
| 366 |
+
2026-01-14 00:19:23 | WARNING | root | Using make_pad_mask with a list of lengths is not tracable. If you try to trace this function with type(lengths) == list, please change the type of lengths to torch.LongTensor.
|
| 367 |
+
2026-01-14 00:19:23 | WARNING | root | Using make_pad_mask with a list of lengths is not tracable. If you try to trace this function with type(lengths) == list, please change the type of lengths to torch.LongTensor.
|
| 368 |
+
2026-01-14 00:19:23 | WARNING | root | Using make_pad_mask with a list of lengths is not tracable. If you try to trace this function with type(lengths) == list, please change the type of lengths to torch.LongTensor.
|
| 369 |
+
2026-01-14 00:19:23 | INFO | lightning.pytorch.utilities.rank_zero | `Trainer.fit` stopped: `max_epochs=1` reached.
|
| 370 |
+
2026-01-14 00:19:23 | INFO | espnet3.systems.base.train | Training finished in 1.46s | exp_dir=./exp/train_asr_rnn_data_aug_debug model=None
|
| 371 |
+
2026-01-14 00:19:23 | INFO | espnet3 | === [DONE] stage: train (1.47s) ===
|
meta.yaml
CHANGED
|
@@ -2,7 +2,7 @@ files:
|
|
| 2 |
asr_model_file: exp/train_asr_rnn_data_aug_debug/epoch0_step1_valid.acc.ckpt
|
| 3 |
yaml_files:
|
| 4 |
asr_train_config: exp/train_asr_rnn_data_aug_debug/config.yaml
|
| 5 |
-
timestamp:
|
| 6 |
python: 3.11.13 (main, Aug 18 2025, 19:19:13) [Clang 20.1.4 ]
|
| 7 |
torch: 2.9.1+cu128
|
| 8 |
espnet: '202511'
|
|
|
|
| 2 |
asr_model_file: exp/train_asr_rnn_data_aug_debug/epoch0_step1_valid.acc.ckpt
|
| 3 |
yaml_files:
|
| 4 |
asr_train_config: exp/train_asr_rnn_data_aug_debug/config.yaml
|
| 5 |
+
timestamp: 1768368961.964214
|
| 6 |
python: 3.11.13 (main, Aug 18 2025, 19:19:13) [Clang 20.1.4 ]
|
| 7 |
torch: 2.9.1+cu128
|
| 8 |
espnet: '202511'
|
scores.json
CHANGED
|
@@ -6,7 +6,7 @@
|
|
| 6 |
},
|
| 7 |
"espnet3.systems.asr.metrics.cer.CER": {
|
| 8 |
"test": {
|
| 9 |
-
"CER":
|
| 10 |
}
|
| 11 |
}
|
| 12 |
}
|
|
|
|
| 6 |
},
|
| 7 |
"espnet3.systems.asr.metrics.cer.CER": {
|
| 8 |
"test": {
|
| 9 |
+
"CER": 100.0
|
| 10 |
}
|
| 11 |
}
|
| 12 |
}
|
stats/collect_stats.log
CHANGED
|
@@ -1,12 +1,12 @@
|
|
| 1 |
-
2026-01-
|
| 2 |
-
2026-01-
|
| 3 |
-
2026-01-
|
| 4 |
-
2026-01-
|
| 5 |
-
2026-01-
|
| 6 |
-
2026-01-
|
| 7 |
-
2026-01-
|
| 8 |
-
2026-01-
|
| 9 |
-
2026-01-
|
| 10 |
OMPI_MCA_plm_slurm_args=--external-launcher
|
| 11 |
SLURM_CLUSTER_NAME=babel
|
| 12 |
SLURM_CONF=/var/spool/slurmd/conf-cache/slurm.conf
|
|
@@ -65,11 +65,11 @@ SLURM_TOPOLOGY_ADDR=babel-o9-16
|
|
| 65 |
SLURM_TOPOLOGY_ADDR_PATTERN=node
|
| 66 |
SLURM_TRES_PER_TASK=cpu=1
|
| 67 |
SLURM_UMASK=0027
|
| 68 |
-
2026-01-
|
| 69 |
-
LD_LIBRARY_PATH=/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:
|
| 70 |
PATH=/home/msomeki/00_systems/espnet3/tools/ffmpeg-release:/home/msomeki/00_systems/espnet3/tools/festival/bin:/home/msomeki/00_systems/espnet3/tools/MBROLA/Bin:/home/msomeki/00_systems/espnet3/tools/espeak-ng/bin:/home/msomeki/00_systems/espnet3/tools/BeamformIt:/home/msomeki/00_systems/espnet3/tools/kenlm/build/bin:/home/msomeki/00_systems/espnet3/tools/PESQ/P862_annex_A_2005_CD/source:/home/msomeki/00_systems/espnet3/tools/nkf/nkf-2.1.4:/home/msomeki/00_systems/espnet3/tools/moses/scripts/tokenizer:/home/msomeki/00_systems/espnet3/tools/moses/scripts/generic:/home/msomeki/00_systems/espnet3/tools/tools/moses/scripts/recaser:/home/msomeki/00_systems/espnet3/tools/moses/scripts/training:/home/msomeki/00_systems/espnet3/tools/mwerSegmenter:/home/msomeki/00_systems/espnet3/tools/sctk/bin:/home/msomeki/00_systems/espnet3/tools/sph2pipe:/home/msomeki/00_systems/espnet3/tools/sentencepiece_commands:/data/user_data/msomeki/espnet3/.venv/bin:/home/msomeki/.pixi/bin:/home/msomeki/local/bin:/home/msomeki/utils:/usr/share/Modules/bin:/home/msomeki/00_systems/espnet3/tools/ffmpeg-release:/home/msomeki/00_systems/espnet3/tools/festival/bin:/home/msomeki/00_systems/espnet3/tools/MBROLA/Bin:/home/msomeki/00_systems/espnet3/tools/espeak-ng/bin:/home/msomeki/00_systems/espnet3/tools/BeamformIt:/home/msomeki/00_systems/espnet3/tools/kenlm/build/bin:/home/msomeki/00_systems/espnet3/tools/PESQ/P862_annex_A_2005_CD/source:/home/msomeki/00_systems/espnet3/tools/nkf/nkf-2.1.4:/home/msomeki/00_systems/espnet3/tools/moses/scripts/tokenizer:/home/msomeki/00_systems/espnet3/tools/moses/scripts/generic:/home/msomeki/00_systems/espnet3/tools/tools/moses/scripts/recaser:/home/msomeki/00_systems/espnet3/tools/moses/scripts/training:/home/msomeki/00_systems/espnet3/tools/mwerSegmenter:/home/msomeki/00_systems/espnet3/tools/sctk/bin:/home/msomeki/00_systems/espnet3/tools/sph2pipe:/home/msomeki/00_systems/espnet3/tools/sentencepiece_commands:/home/msomeki/00_systems/espnet3/tools/ffmpeg-release:/home/msomeki/00_systems/espnet3/tools/festival/bin:/home/msomeki/00_systems/espnet3/tools/MBROLA/Bin:/home/msomeki/00_systems/espnet3/tools/espeak-ng/bin:/home/msomeki/00_systems/espnet3/tools/BeamformIt:/home/msomeki/00_systems/espnet3/tools/kenlm/build/bin:/home/msomeki/00_systems/espnet3/tools/PESQ/P862_annex_A_2005_CD/source:/home/msomeki/00_systems/espnet3/tools/nkf/nkf-2.1.4:/home/msomeki/00_systems/espnet3/tools/moses/scripts/tokenizer:/home/msomeki/00_systems/espnet3/tools/moses/scripts/generic:/home/msomeki/00_systems/espnet3/tools/tools/moses/scripts/recaser:/home/msomeki/00_systems/espnet3/tools/moses/scripts/training:/home/msomeki/00_systems/espnet3/tools/mwerSegmenter:/home/msomeki/00_systems/espnet3/tools/sctk/bin:/home/msomeki/00_systems/espnet3/tools/sph2pipe:/home/msomeki/00_systems/espnet3/tools/sentencepiece_commands:/home/msomeki/.pixi/bin:/home/msomeki/local/bin:/home/msomeki/utils:/home/msomeki/.local/bin:/home/msomeki/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin
|
| 71 |
-
PYTHONPATH=/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:
|
| 72 |
-
2026-01-
|
| 73 |
num_device: 1
|
| 74 |
num_nodes: 1
|
| 75 |
task: espnet3.systems.asr.task.ASRTask
|
|
@@ -231,7 +231,7 @@ model:
|
|
| 231 |
win_length: 400
|
| 232 |
hop_length: 160
|
| 233 |
|
| 234 |
-
2026-01-
|
| 235 |
num_device: 1
|
| 236 |
num_nodes: 1
|
| 237 |
recipe_dir: .
|
|
@@ -263,7 +263,7 @@ tokenizer:
|
|
| 263 |
model_type: bpe
|
| 264 |
save_path: ./data/bpe_30
|
| 265 |
|
| 266 |
-
2026-01-
|
| 267 |
recipe_dir: .
|
| 268 |
data_dir: ./data
|
| 269 |
exp_tag: train_asr_rnn_data_aug_debug
|
|
@@ -286,10 +286,10 @@ metrics:
|
|
| 286 |
_target_: espnet3.systems.asr.metrics.cer.CER
|
| 287 |
clean_types: null
|
| 288 |
|
| 289 |
-
2026-01-
|
| 290 |
-
2026-01-
|
| 291 |
-
2026-01-
|
| 292 |
-
2026-01-
|
| 293 |
ESPnetASRModel(
|
| 294 |
(frontend): DefaultFrontend(
|
| 295 |
(stft): Stft(n_fft=512, win_length=400, hop_length=160, center=True, normalized=False, onesided=True)
|
|
@@ -339,13 +339,13 @@ ESPnetASRModel(
|
|
| 339 |
(ctc_loss): CTCLoss()
|
| 340 |
)
|
| 341 |
)
|
| 342 |
-
2026-01-
|
| 343 |
|
| 344 |
-
2026-01-
|
| 345 |
-
2026-01-
|
| 346 |
-
2026-01-
|
| 347 |
-
2026-01-
|
| 348 |
-
2026-01-
|
| 349 |
-
2026-01-
|
| 350 |
-
2026-01-
|
| 351 |
-
2026-01-
|
|
|
|
| 1 |
+
2026-01-14 00:19:11 | INFO | espnet3 | === ESPnet3 run started: 2026-01-14T00:19:11.368396 ===
|
| 2 |
+
2026-01-14 00:19:11 | INFO | espnet3 | Command: /data/user_data/msomeki/espnet3/.venv/bin/python3 run.py --stages create_dataset train_tokenizer collect_stats train infer measure --train_config conf/train.yaml --infer_config conf/infer.yaml --measure_config conf/measure.yaml
|
| 3 |
+
2026-01-14 00:19:11 | INFO | espnet3 | Python: 3.11.13 (main, Aug 18 2025, 19:19:13) [Clang 20.1.4 ]
|
| 4 |
+
2026-01-14 00:19:11 | INFO | espnet3 | Working directory: /home/msomeki/00_systems/espnet3/egs3/mini_an4/asr
|
| 5 |
+
2026-01-14 00:19:11 | INFO | espnet3 | train config: /home/msomeki/00_systems/espnet3/egs3/mini_an4/asr/conf/train_asr_rnn_data_aug_debug.yaml
|
| 6 |
+
2026-01-14 00:19:11 | INFO | espnet3 | infer config: /home/msomeki/00_systems/espnet3/egs3/mini_an4/asr/conf/infer.yaml
|
| 7 |
+
2026-01-14 00:19:11 | INFO | espnet3 | measure config: /home/msomeki/00_systems/espnet3/egs3/mini_an4/asr/conf/measure.yaml
|
| 8 |
+
2026-01-14 00:19:11 | INFO | espnet3 | Git: commit=8509faad9811b58d5024f29fb9d68ffb026b5e73, short_commit=8509faad9, branch=espnet3/recipe/asr_ls100, worktree=dirty
|
| 9 |
+
2026-01-14 00:19:11 | INFO | espnet3 | Cluster env:
|
| 10 |
OMPI_MCA_plm_slurm_args=--external-launcher
|
| 11 |
SLURM_CLUSTER_NAME=babel
|
| 12 |
SLURM_CONF=/var/spool/slurmd/conf-cache/slurm.conf
|
|
|
|
| 65 |
SLURM_TOPOLOGY_ADDR_PATTERN=node
|
| 66 |
SLURM_TRES_PER_TASK=cpu=1
|
| 67 |
SLURM_UMASK=0027
|
| 68 |
+
2026-01-14 00:19:11 | INFO | espnet3 | Runtime env:
|
| 69 |
+
LD_LIBRARY_PATH=/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:/home/msomeki/00_systems/espnet3/tools/espeak-ng/lib:/home/msomeki/00_systems/espnet3/tools/lib:/home/msomeki/00_systems/espnet3/tools/lib64:
|
| 70 |
PATH=/home/msomeki/00_systems/espnet3/tools/ffmpeg-release:/home/msomeki/00_systems/espnet3/tools/festival/bin:/home/msomeki/00_systems/espnet3/tools/MBROLA/Bin:/home/msomeki/00_systems/espnet3/tools/espeak-ng/bin:/home/msomeki/00_systems/espnet3/tools/BeamformIt:/home/msomeki/00_systems/espnet3/tools/kenlm/build/bin:/home/msomeki/00_systems/espnet3/tools/PESQ/P862_annex_A_2005_CD/source:/home/msomeki/00_systems/espnet3/tools/nkf/nkf-2.1.4:/home/msomeki/00_systems/espnet3/tools/moses/scripts/tokenizer:/home/msomeki/00_systems/espnet3/tools/moses/scripts/generic:/home/msomeki/00_systems/espnet3/tools/tools/moses/scripts/recaser:/home/msomeki/00_systems/espnet3/tools/moses/scripts/training:/home/msomeki/00_systems/espnet3/tools/mwerSegmenter:/home/msomeki/00_systems/espnet3/tools/sctk/bin:/home/msomeki/00_systems/espnet3/tools/sph2pipe:/home/msomeki/00_systems/espnet3/tools/sentencepiece_commands:/data/user_data/msomeki/espnet3/.venv/bin:/home/msomeki/.pixi/bin:/home/msomeki/local/bin:/home/msomeki/utils:/usr/share/Modules/bin:/home/msomeki/00_systems/espnet3/tools/ffmpeg-release:/home/msomeki/00_systems/espnet3/tools/festival/bin:/home/msomeki/00_systems/espnet3/tools/MBROLA/Bin:/home/msomeki/00_systems/espnet3/tools/espeak-ng/bin:/home/msomeki/00_systems/espnet3/tools/BeamformIt:/home/msomeki/00_systems/espnet3/tools/kenlm/build/bin:/home/msomeki/00_systems/espnet3/tools/PESQ/P862_annex_A_2005_CD/source:/home/msomeki/00_systems/espnet3/tools/nkf/nkf-2.1.4:/home/msomeki/00_systems/espnet3/tools/moses/scripts/tokenizer:/home/msomeki/00_systems/espnet3/tools/moses/scripts/generic:/home/msomeki/00_systems/espnet3/tools/tools/moses/scripts/recaser:/home/msomeki/00_systems/espnet3/tools/moses/scripts/training:/home/msomeki/00_systems/espnet3/tools/mwerSegmenter:/home/msomeki/00_systems/espnet3/tools/sctk/bin:/home/msomeki/00_systems/espnet3/tools/sph2pipe:/home/msomeki/00_systems/espnet3/tools/sentencepiece_commands:/home/msomeki/00_systems/espnet3/tools/ffmpeg-release:/home/msomeki/00_systems/espnet3/tools/festival/bin:/home/msomeki/00_systems/espnet3/tools/MBROLA/Bin:/home/msomeki/00_systems/espnet3/tools/espeak-ng/bin:/home/msomeki/00_systems/espnet3/tools/BeamformIt:/home/msomeki/00_systems/espnet3/tools/kenlm/build/bin:/home/msomeki/00_systems/espnet3/tools/PESQ/P862_annex_A_2005_CD/source:/home/msomeki/00_systems/espnet3/tools/nkf/nkf-2.1.4:/home/msomeki/00_systems/espnet3/tools/moses/scripts/tokenizer:/home/msomeki/00_systems/espnet3/tools/moses/scripts/generic:/home/msomeki/00_systems/espnet3/tools/tools/moses/scripts/recaser:/home/msomeki/00_systems/espnet3/tools/moses/scripts/training:/home/msomeki/00_systems/espnet3/tools/mwerSegmenter:/home/msomeki/00_systems/espnet3/tools/sctk/bin:/home/msomeki/00_systems/espnet3/tools/sph2pipe:/home/msomeki/00_systems/espnet3/tools/sentencepiece_commands:/home/msomeki/.pixi/bin:/home/msomeki/local/bin:/home/msomeki/utils:/home/msomeki/.local/bin:/home/msomeki/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin
|
| 71 |
+
PYTHONPATH=/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:../../../:../../TEMPLATE/asr:/home/msomeki/00_systems/espnet3/egs3/mini_an4/asr:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3:/home/msomeki/00_systems/espnet3/tools/RawNet/python/RawNet3/models:
|
| 72 |
+
2026-01-14 00:19:11 | INFO | espnet3 | Train config content:
|
| 73 |
num_device: 1
|
| 74 |
num_nodes: 1
|
| 75 |
task: espnet3.systems.asr.task.ASRTask
|
|
|
|
| 231 |
win_length: 400
|
| 232 |
hop_length: 160
|
| 233 |
|
| 234 |
+
2026-01-14 00:19:11 | INFO | espnet3 | Infer config content:
|
| 235 |
num_device: 1
|
| 236 |
num_nodes: 1
|
| 237 |
recipe_dir: .
|
|
|
|
| 263 |
model_type: bpe
|
| 264 |
save_path: ./data/bpe_30
|
| 265 |
|
| 266 |
+
2026-01-14 00:19:11 | INFO | espnet3 | Measure config content:
|
| 267 |
recipe_dir: .
|
| 268 |
data_dir: ./data
|
| 269 |
exp_tag: train_asr_rnn_data_aug_debug
|
|
|
|
| 286 |
_target_: espnet3.systems.asr.metrics.cer.CER
|
| 287 |
clean_types: null
|
| 288 |
|
| 289 |
+
2026-01-14 00:19:11 | INFO | espnet3 | === [START] stage: collect_stats ===
|
| 290 |
+
2026-01-14 00:19:11 | INFO | espnet3.systems.base.system | Collecting stats | exp_dir=./exp/train_asr_rnn_data_aug_debug stats_dir=./exp/stats
|
| 291 |
+
2026-01-14 00:19:18 | INFO | root | Vocabulary size: 30
|
| 292 |
+
2026-01-14 00:19:19 | INFO | espnet3.systems.base.train | Model:
|
| 293 |
ESPnetASRModel(
|
| 294 |
(frontend): DefaultFrontend(
|
| 295 |
(stft): Stft(n_fft=512, win_length=400, hop_length=160, center=True, normalized=False, onesided=True)
|
|
|
|
| 339 |
(ctc_loss): CTCLoss()
|
| 340 |
)
|
| 341 |
)
|
| 342 |
+
2026-01-14 00:19:19 | WARNING | py.warnings | /data/user_data/msomeki/espnet3/.venv/lib/python3.11/site-packages/lightning/fabric/plugins/environments/slurm.py:204: The `srun` command is available on your system but is not used. HINT: If your intention is to run Lightning on SLURM, prepend your python command with `srun` like so: srun python3 run.py --stages create_dataset train_tokenizer coll ...
|
| 343 |
|
| 344 |
+
2026-01-14 00:19:19 | INFO | lightning.pytorch.utilities.rank_zero | GPU available: False, used: False
|
| 345 |
+
2026-01-14 00:19:19 | INFO | lightning.pytorch.utilities.rank_zero | TPU available: False, using: 0 TPU cores
|
| 346 |
+
2026-01-14 00:19:19 | INFO | lightning.pytorch.utilities.rank_zero | `Trainer(limit_train_batches=1)` was configured so 1 batch per epoch will be used.
|
| 347 |
+
2026-01-14 00:19:19 | INFO | lightning.pytorch.utilities.rank_zero | `Trainer(limit_val_batches=1)` was configured so 1 batch will be used.
|
| 348 |
+
2026-01-14 00:19:19 | INFO | root | Vocabulary size: 30
|
| 349 |
+
2026-01-14 00:19:20 | INFO | root | Vocabulary size: 30
|
| 350 |
+
2026-01-14 00:19:21 | INFO | espnet3.systems.base.train | Collect stats finished in 9.43s | exp_dir=./exp/train_asr_rnn_data_aug_debug stats_dir=./exp/stats
|
| 351 |
+
2026-01-14 00:19:21 | INFO | espnet3 | === [DONE] stage: collect_stats (9.43s) ===
|
stats/train/feats_lengths_stats.npz
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 778
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:0fdd77f5da80e13de525bf18de85a217ea2c1aface62137228e513c03a6501dd
|
| 3 |
size 778
|
stats/train/feats_shape
CHANGED
|
@@ -1,4 +1,4 @@
|
|
| 1 |
-
0
|
| 2 |
1 281,80
|
| 3 |
-
2
|
| 4 |
-
3
|
|
|
|
| 1 |
+
0 64,80
|
| 2 |
1 281,80
|
| 3 |
+
2 101,80
|
| 4 |
+
3 170,80
|
stats/train/feats_stats.npz
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 1402
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:b355446f53c5d8bc55839ddb36f2f7a904acfa41bb35c1093f7007818b616f79
|
| 3 |
size 1402
|