/workspace/bina02-ppocr/.venv/lib/python3.12/site-packages/paddle/utils/cpp_extension/extension_utils.py:712: UserWarning: No ccache found. Please be aware that recompiling all source files may be required. You can download and install ccache from: https://github.com/ccache/ccache/blob/master/doc/INSTALL.md
  warnings.warn(warning_message)
LAUNCH INFO 2026-07-25 18:06:18,619 -----------  Configuration  ----------------------
LAUNCH INFO 2026-07-25 18:06:18,619 auto_cluster_config: 0
LAUNCH INFO 2026-07-25 18:06:18,619 auto_parallel_config: None
LAUNCH INFO 2026-07-25 18:06:18,619 auto_tuner_json: None
LAUNCH INFO 2026-07-25 18:06:18,619 devices: 0,1,2,3,4,5,6,7
LAUNCH INFO 2026-07-25 18:06:18,619 elastic_level: -1
LAUNCH INFO 2026-07-25 18:06:18,619 elastic_timeout: 30
LAUNCH INFO 2026-07-25 18:06:18,619 enable_gpu_log: True
LAUNCH INFO 2026-07-25 18:06:18,619 gloo_port: 6767
LAUNCH INFO 2026-07-25 18:06:18,619 host: None
LAUNCH INFO 2026-07-25 18:06:18,619 ips: None
LAUNCH INFO 2026-07-25 18:06:18,619 job_id: default
LAUNCH INFO 2026-07-25 18:06:18,619 legacy: False
LAUNCH INFO 2026-07-25 18:06:18,619 log_dir: /workspace/bina02-ppocr/training/stage-003/distributed-logs
LAUNCH INFO 2026-07-25 18:06:18,619 log_level: INFO
LAUNCH INFO 2026-07-25 18:06:18,619 log_overwrite: False
LAUNCH INFO 2026-07-25 18:06:18,619 master: None
LAUNCH INFO 2026-07-25 18:06:18,619 max_restart: 3
LAUNCH INFO 2026-07-25 18:06:18,619 nnodes: 1
LAUNCH INFO 2026-07-25 18:06:18,619 nproc_per_node: None
LAUNCH INFO 2026-07-25 18:06:18,619 rank: -1
LAUNCH INFO 2026-07-25 18:06:18,619 run_mode: collective
LAUNCH INFO 2026-07-25 18:06:18,619 server_num: None
LAUNCH INFO 2026-07-25 18:06:18,619 servers: 
LAUNCH INFO 2026-07-25 18:06:18,619 sort_ip: False
LAUNCH INFO 2026-07-25 18:06:18,619 start_port: 6070
LAUNCH INFO 2026-07-25 18:06:18,619 trainer_num: None
LAUNCH INFO 2026-07-25 18:06:18,619 trainers: 
LAUNCH INFO 2026-07-25 18:06:18,619 training_script: /workspace/bina02-ppocr/PaddleOCR/tools/train.py
LAUNCH INFO 2026-07-25 18:06:18,620 training_script_args: ['-c', '/workspace/bina02-ppocr/training/stage-003/input_config.yml']
LAUNCH INFO 2026-07-25 18:06:18,620 with_gloo: 1
LAUNCH INFO 2026-07-25 18:06:18,620 --------------------------------------------------
LAUNCH INFO 2026-07-25 18:06:18,621 Job: default, mode collective, replicas 1[1:1], elastic False
LAUNCH INFO 2026-07-25 18:06:18,622 Run Pod: ftmqhy, replicas 8, status ready
LAUNCH INFO 2026-07-25 18:06:18,884 Watching Pod: ftmqhy, replicas 8, status running
/workspace/bina02-ppocr/.venv/lib/python3.12/site-packages/paddle/utils/cpp_extension/extension_utils.py:712: UserWarning: No ccache found. Please be aware that recompiling all source files may be required. You can download and install ccache from: https://github.com/ccache/ccache/blob/master/doc/INSTALL.md
  warnings.warn(warning_message)
Skipping import of the encryption module.
[2026/07/25 18:06:26] ppocr INFO: Architecture : 
[2026/07/25 18:06:26] ppocr INFO:     Backbone : 
[2026/07/25 18:06:26] ppocr INFO:         force_pool_width : True
[2026/07/25 18:06:26] ppocr INFO:         model_size : medium
[2026/07/25 18:06:26] ppocr INFO:         name : PPLCNetV4
[2026/07/25 18:06:26] ppocr INFO:         train_pool_width : 96
[2026/07/25 18:06:26] ppocr INFO:     Head : 
[2026/07/25 18:06:26] ppocr INFO:         head_list : 
[2026/07/25 18:06:26] ppocr INFO:             CTCHead : 
[2026/07/25 18:06:26] ppocr INFO:                 Head : 
[2026/07/25 18:06:26] ppocr INFO:                     fc_decay : 1e-05
[2026/07/25 18:06:26] ppocr INFO:                 Neck : 
[2026/07/25 18:06:26] ppocr INFO:                     depth : 2
[2026/07/25 18:06:26] ppocr INFO:                     dims : 192
[2026/07/25 18:06:26] ppocr INFO:                     local_kernel : 7
[2026/07/25 18:06:26] ppocr INFO:                     mlp_ratio : 4.0
[2026/07/25 18:06:26] ppocr INFO:                     name : lightsvtr
[2026/07/25 18:06:26] ppocr INFO:                     use_guide : False
[2026/07/25 18:06:26] ppocr INFO:             NRTRHead : 
[2026/07/25 18:06:26] ppocr INFO:                 max_text_length : 128
[2026/07/25 18:06:26] ppocr INFO:                 nrtr_dim : 512
[2026/07/25 18:06:26] ppocr INFO:         name : MultiHead
[2026/07/25 18:06:26] ppocr INFO:     Transform : None
[2026/07/25 18:06:26] ppocr INFO:     algorithm : SVTR_LCNet
[2026/07/25 18:06:26] ppocr INFO:     model_type : rec
[2026/07/25 18:06:26] ppocr INFO: Eval : 
[2026/07/25 18:06:26] ppocr INFO:     dataset : 
[2026/07/25 18:06:26] ppocr INFO:         data_dir : /
[2026/07/25 18:06:26] ppocr INFO:         label_file_list : ['/workspace/bina02-ppocr/stream/datasets/chunk-003/eval_ctc.txt']
[2026/07/25 18:06:26] ppocr INFO:         name : SimpleDataSet
[2026/07/25 18:06:26] ppocr INFO:         transforms : 
[2026/07/25 18:06:26] ppocr INFO:             DecodeImage : 
[2026/07/25 18:06:26] ppocr INFO:                 channel_first : False
[2026/07/25 18:06:26] ppocr INFO:                 img_mode : BGR
[2026/07/25 18:06:26] ppocr INFO:             MultiLabelEncode : 
[2026/07/25 18:06:26] ppocr INFO:                 gtc_encode : NRTRLabelEncode
[2026/07/25 18:06:26] ppocr INFO:             RecResizeImg : 
[2026/07/25 18:06:26] ppocr INFO:                 image_shape : [3, 48, 768]
[2026/07/25 18:06:26] ppocr INFO:                 padding : False
[2026/07/25 18:06:26] ppocr INFO:             KeepKeys : 
[2026/07/25 18:06:26] ppocr INFO:                 keep_keys : ['image', 'label_ctc', 'label_gtc', 'length', 'valid_ratio']
[2026/07/25 18:06:26] ppocr INFO:     loader : 
[2026/07/25 18:06:26] ppocr INFO:         batch_size_per_card : 32
[2026/07/25 18:06:26] ppocr INFO:         drop_last : False
[2026/07/25 18:06:26] ppocr INFO:         num_workers : 4
[2026/07/25 18:06:26] ppocr INFO:         shuffle : False
[2026/07/25 18:06:26] ppocr INFO: Global : 
[2026/07/25 18:06:26] ppocr INFO:     cal_metric_during_train : False
[2026/07/25 18:06:26] ppocr INFO:     character_dict_path : /workspace/bina02-ppocr/stream/datasets/chunk-003/persian_arabic_bina02_dict.txt
[2026/07/25 18:06:26] ppocr INFO:     checkpoints : None
[2026/07/25 18:06:26] ppocr INFO:     d2s_train_image_shape : [3, 48, 768]
[2026/07/25 18:06:26] ppocr INFO:     debug : False
[2026/07/25 18:06:26] ppocr INFO:     distributed : True
[2026/07/25 18:06:26] ppocr INFO:     epoch_num : 1
[2026/07/25 18:06:26] ppocr INFO:     eval_batch_step : [0, 100]
[2026/07/25 18:06:26] ppocr INFO:     freeze_batch_norm : True
[2026/07/25 18:06:26] ppocr INFO:     infer_img : doc/imgs_words/ch/word_1.jpg
[2026/07/25 18:06:26] ppocr INFO:     infer_mode : False
[2026/07/25 18:06:26] ppocr INFO:     log_smooth_window : 20
[2026/07/25 18:06:26] ppocr INFO:     max_text_length : 128
[2026/07/25 18:06:26] ppocr INFO:     model_name : PP-OCRv6_medium_rec
[2026/07/25 18:06:26] ppocr INFO:     pretrained_model : /workspace/bina02-ppocr/training/stage-002/best_accuracy
[2026/07/25 18:06:26] ppocr INFO:     print_batch_step : 20
[2026/07/25 18:06:26] ppocr INFO:     save_epoch_step : 1
[2026/07/25 18:06:26] ppocr INFO:     save_inference_dir : None
[2026/07/25 18:06:26] ppocr INFO:     save_model_dir : /workspace/bina02-ppocr/training/stage-003
[2026/07/25 18:06:26] ppocr INFO:     save_res_path : /workspace/bina02-ppocr/training/stage-003/predicts.txt
[2026/07/25 18:06:26] ppocr INFO:     trainable_parameter_prefixes : ['head.ctc_head.fc.']
[2026/07/25 18:06:26] ppocr INFO:     use_gpu : True
[2026/07/25 18:06:26] ppocr INFO:     use_space_char : True
[2026/07/25 18:06:26] ppocr INFO:     use_visualdl : False
[2026/07/25 18:06:26] ppocr INFO: Loss : 
[2026/07/25 18:06:26] ppocr INFO:     loss_config_list : 
[2026/07/25 18:06:26] ppocr INFO:         CTCLoss : None
[2026/07/25 18:06:26] ppocr INFO:         NRTRLoss : None
[2026/07/25 18:06:26] ppocr INFO:     name : MultiLoss
[2026/07/25 18:06:26] ppocr INFO:     weight_1 : 1.0
[2026/07/25 18:06:26] ppocr INFO:     weight_2 : 0.0
[2026/07/25 18:06:26] ppocr INFO: Metric : 
[2026/07/25 18:06:26] ppocr INFO:     ignore_space : False
[2026/07/25 18:06:26] ppocr INFO:     main_indicator : norm_edit_dis
[2026/07/25 18:06:26] ppocr INFO:     name : RecMetric
[2026/07/25 18:06:26] ppocr INFO: Optimizer : 
[2026/07/25 18:06:26] ppocr INFO:     beta1 : 0.9
[2026/07/25 18:06:26] ppocr INFO:     beta2 : 0.999
[2026/07/25 18:06:26] ppocr INFO:     lr : 
[2026/07/25 18:06:26] ppocr INFO:         learning_rate : 1e-05
[2026/07/25 18:06:26] ppocr INFO:         name : Cosine
[2026/07/25 18:06:26] ppocr INFO:         warmup_epoch : 0
[2026/07/25 18:06:26] ppocr INFO:     name : Adam
[2026/07/25 18:06:26] ppocr INFO:     regularizer : 
[2026/07/25 18:06:26] ppocr INFO:         factor : 0.0
[2026/07/25 18:06:26] ppocr INFO:         name : L2
[2026/07/25 18:06:26] ppocr INFO: PostProcess : 
[2026/07/25 18:06:26] ppocr INFO:     name : CTCLabelDecode
[2026/07/25 18:06:26] ppocr INFO: Train : 
[2026/07/25 18:06:26] ppocr INFO:     dataset : 
[2026/07/25 18:06:26] ppocr INFO:         data_dir : /
[2026/07/25 18:06:26] ppocr INFO:         ds_width : False
[2026/07/25 18:06:26] ppocr INFO:         ext_op_transform_idx : 1
[2026/07/25 18:06:26] ppocr INFO:         label_file_list : ['/workspace/bina02-ppocr/stream/datasets/chunk-003/train_ctc.txt']
[2026/07/25 18:06:26] ppocr INFO:         name : MultiScaleDataSet
[2026/07/25 18:06:26] ppocr INFO:         padding : False
[2026/07/25 18:06:26] ppocr INFO:         ratio_list : [1.0]
[2026/07/25 18:06:26] ppocr INFO:         transforms : 
[2026/07/25 18:06:26] ppocr INFO:             DecodeImage : 
[2026/07/25 18:06:26] ppocr INFO:                 channel_first : False
[2026/07/25 18:06:26] ppocr INFO:                 img_mode : BGR
[2026/07/25 18:06:26] ppocr INFO:             RecConAug : 
[2026/07/25 18:06:26] ppocr INFO:                 ext_data_num : 0
[2026/07/25 18:06:26] ppocr INFO:                 image_shape : [48, 768, 3]
[2026/07/25 18:06:26] ppocr INFO:                 max_text_length : 128
[2026/07/25 18:06:26] ppocr INFO:                 prob : 0.0
[2026/07/25 18:06:26] ppocr INFO:             RecAug : None
[2026/07/25 18:06:26] ppocr INFO:             MultiLabelEncode : 
[2026/07/25 18:06:26] ppocr INFO:                 gtc_encode : NRTRLabelEncode
[2026/07/25 18:06:26] ppocr INFO:             KeepKeys : 
[2026/07/25 18:06:26] ppocr INFO:                 keep_keys : ['image', 'label_ctc', 'label_gtc', 'length', 'valid_ratio']
[2026/07/25 18:06:26] ppocr INFO:     loader : 
[2026/07/25 18:06:26] ppocr INFO:         batch_size_per_card : 32
[2026/07/25 18:06:26] ppocr INFO:         drop_last : False
[2026/07/25 18:06:26] ppocr INFO:         num_workers : 4
[2026/07/25 18:06:26] ppocr INFO:         shuffle : True
[2026/07/25 18:06:26] ppocr INFO:     sampler : 
[2026/07/25 18:06:26] ppocr INFO:         divided_factor : [8, 16]
[2026/07/25 18:06:26] ppocr INFO:         first_bs : 32
[2026/07/25 18:06:26] ppocr INFO:         fix_bs : True
[2026/07/25 18:06:26] ppocr INFO:         is_training : True
[2026/07/25 18:06:26] ppocr INFO:         name : MultiScaleSampler
[2026/07/25 18:06:26] ppocr INFO:         scales : [[768, 48]]
[2026/07/25 18:06:26] ppocr INFO: profiler_options : None
[2026/07/25 18:06:26] ppocr INFO: train with paddle 3.3.0 and device Place(gpu:0)
======================= Modified FLAGS detected =======================
FLAGS(name='FLAGS_cudnn_dir', current_value='/workspace/bina02-ppocr/.venv/lib/python3.12/site-packages/paddle/../nvidia/cudnn/lib', default_value='')
FLAGS(name='FLAGS_cublas_dir', current_value='/workspace/bina02-ppocr/.venv/lib/python3.12/site-packages/paddle/../nvidia/cublas/lib', default_value='')
FLAGS(name='FLAGS_cudnn_deterministic', current_value=True, default_value=False)
FLAGS(name='FLAGS_nccl_dir', current_value='/workspace/bina02-ppocr/.venv/lib/python3.12/site-packages/paddle/../nvidia/nccl/lib', default_value='')
FLAGS(name='FLAGS_selected_gpus', current_value='0', default_value='')
FLAGS(name='FLAGS_cusolver_dir', current_value='/workspace/bina02-ppocr/.venv/lib/python3.12/site-packages/paddle/../nvidia/cusolver/lib', default_value='')
FLAGS(name='FLAGS_enable_pir_in_executor', current_value=True, default_value=False)
FLAGS(name='FLAGS_cusparse_dir', current_value='/workspace/bina02-ppocr/.venv/lib/python3.12/site-packages/paddle/../nvidia/cusparse/lib', default_value='')
FLAGS(name='FLAGS_cupti_dir', current_value='/workspace/bina02-ppocr/.venv/lib/python3.12/site-packages/paddle/../nvidia/cuda_cupti/lib', default_value='')
FLAGS(name='FLAGS_nvidia_package_dir', current_value='/workspace/bina02-ppocr/.venv/lib/python3.12/site-packages/paddle/../nvidia', default_value='')
FLAGS(name='FLAGS_cuda_cccl_dir', current_value='/workspace/bina02-ppocr/.venv/lib/python3.12/site-packages/paddle/../nvidia/cuda_cccl/include/', default_value='')
FLAGS(name='FLAGS_curand_dir', current_value='/workspace/bina02-ppocr/.venv/lib/python3.12/site-packages/paddle/../nvidia/curand/lib', default_value='')
=======================================================================
I0725 18:06:26.360853 102982 tcp_store.cc:336] create libuv server at port: 38818
I0725 18:06:26.361429 102982 tcp_utils.cc:132] Successfully connected to 172.17.0.2:38818
I0725 18:06:27.944666 102982 process_group_nccl.cc:155] ProcessGroupNCCL pg_timeout_ 1800000
I0725 18:06:27.944741 102982 process_group_nccl.cc:156] ProcessGroupNCCL nccl_comm_init_option_ 0
[2026/07/25 18:06:27] ppocr INFO: Initialize indexs of datasets:['/workspace/bina02-ppocr/stream/datasets/chunk-003/train_ctc.txt']
[2026/07/25 18:06:28] ppocr INFO: Initialize indexs of datasets:['/workspace/bina02-ppocr/stream/datasets/chunk-003/eval_ctc.txt']
W0725 18:06:28.159416 102982 gpu_resources.cc:116] Please NOTE: device: 0, GPU Compute Capability: 12.0, Driver API Version: 13.0, Runtime API Version: 13.0
[2026/07/25 18:06:28] ppocr INFO: froze 61 BatchNorm layers with pretrained global statistics
[2026/07/25 18:06:28] ppocr INFO: selective training enabled: 2 trainable tensors, 438 frozen tensors; head.ctc_head.fc.weight, head.ctc_head.fc.bias
[2026-07-25 18:06:28,564] [    INFO] optimizer.py:254 - If regularizer of a Parameter has been set by 'paddle.ParamAttr' or 'static.WeightNormParamAttr' already. The weight_decay[0.0] in Optimizer will not take effect, and it will only be applied to other Parameters!
[2026/07/25 18:06:28] ppocr INFO: train dataloader has 391 iters
[2026/07/25 18:06:28] ppocr INFO: valid dataloader has 128 iters
[2026/07/25 18:06:28] ppocr INFO: load pretrain successful from /workspace/bina02-ppocr/training/stage-002/best_accuracy
[2026/07/25 18:06:29] ppocr INFO: During the training process, after the 0th iteration, an evaluation is run every 100 iterations
[2026/07/25 18:06:34] ppocr INFO: epoch: [1/1], global_step: 20, lr: 0.000010, CTCLoss: 57.527943, NRTRLoss: 0.000000, loss: 57.527943, avg_reader_cost: 0.07284 s, avg_batch_cost: 0.21301 s, avg_samples: 32.0, ips: 150.22568 samples/s, eta: 0:01:19, max_mem_reserved: 1045 MB, max_mem_allocated: 656 MB
[2026/07/25 18:06:37] ppocr INFO: epoch: [1/1], global_step: 40, lr: 0.000010, CTCLoss: 56.666744, NRTRLoss: 0.000000, loss: 56.666744, avg_reader_cost: 0.00167 s, avg_batch_cost: 0.07953 s, avg_samples: 32.0, ips: 402.38047 samples/s, eta: 0:00:51, max_mem_reserved: 1045 MB, max_mem_allocated: 656 MB
[2026/07/25 18:06:40] ppocr INFO: epoch: [1/1], global_step: 60, lr: 0.000010, CTCLoss: 63.956440, NRTRLoss: 0.000000, loss: 63.956440, avg_reader_cost: 0.00178 s, avg_batch_cost: 0.08426 s, avg_samples: 32.0, ips: 379.79795 samples/s, eta: 0:00:41, max_mem_reserved: 1045 MB, max_mem_allocated: 656 MB
[2026/07/25 18:06:42] ppocr INFO: epoch: [1/1], global_step: 80, lr: 0.000009, CTCLoss: 60.095783, NRTRLoss: 0.000000, loss: 60.095783, avg_reader_cost: 0.00161 s, avg_batch_cost: 0.07711 s, avg_samples: 32.0, ips: 414.99161 samples/s, eta: 0:00:35, max_mem_reserved: 1045 MB, max_mem_allocated: 656 MB
[2026/07/25 18:06:45] ppocr INFO: epoch: [1/1], global_step: 100, lr: 0.000009, CTCLoss: 63.916607, NRTRLoss: 0.000000, loss: 63.916607, avg_reader_cost: 0.00171 s, avg_batch_cost: 0.08432 s, avg_samples: 32.0, ips: 379.50075 samples/s, eta: 0:00:31, max_mem_reserved: 1045 MB, max_mem_allocated: 656 MB

eval model::   0%|          | 0/128 [00:00<?, ?it/s]
eval model::   1%|          | 1/128 [00:00<00:48,  2.63it/s]
eval model::   2%|▏         | 3/128 [00:00<00:19,  6.48it/s]
eval model::   4%|▍         | 5/128 [00:00<00:14,  8.63it/s]
eval model::   5%|▌         | 7/128 [00:00<00:11, 10.33it/s]
eval model::   7%|▋         | 9/128 [00:00<00:10, 11.44it/s]
eval model::   9%|▊         | 11/128 [00:01<00:09, 12.26it/s]
eval model::  10%|█         | 13/128 [00:01<00:08, 12.80it/s]
eval model::  12%|█▏        | 15/128 [00:01<00:08, 13.16it/s]
eval model::  13%|█▎        | 17/128 [00:01<00:08, 13.46it/s]
eval model::  15%|█▍        | 19/128 [00:01<00:07, 13.68it/s]
eval model::  16%|█▋        | 21/128 [00:01<00:07, 13.80it/s]
eval model::  18%|█▊        | 23/128 [00:01<00:07, 13.88it/s]
eval model::  20%|█▉        | 25/128 [00:02<00:07, 13.98it/s]
eval model::  21%|██        | 27/128 [00:02<00:07, 14.04it/s]
eval model::  23%|██▎       | 29/128 [00:02<00:07, 14.04it/s]
eval model::  24%|██▍       | 31/128 [00:02<00:07, 13.38it/s]
eval model::  26%|██▌       | 33/128 [00:02<00:06, 13.62it/s]
eval model::  27%|██▋       | 35/128 [00:02<00:07, 12.79it/s]
eval model::  29%|██▉       | 37/128 [00:03<00:07, 12.40it/s]
eval model::  30%|███       | 39/128 [00:03<00:07, 12.28it/s]
eval model::  32%|███▏      | 41/128 [00:03<00:07, 12.23it/s]
eval model::  34%|███▎      | 43/128 [00:03<00:06, 12.17it/s]
eval model::  35%|███▌      | 45/128 [00:03<00:06, 12.12it/s]
eval model::  37%|███▋      | 47/128 [00:03<00:06, 12.67it/s]
eval model::  38%|███▊      | 49/128 [00:04<00:06, 12.81it/s]
eval model::  40%|███▉      | 51/128 [00:04<00:05, 13.00it/s]
eval model::  41%|████▏     | 53/128 [00:04<00:05, 13.06it/s]
eval model::  43%|████▎     | 55/128 [00:04<00:05, 13.37it/s]
eval model::  45%|████▍     | 57/128 [00:04<00:05, 13.02it/s]
eval model::  46%|████▌     | 59/128 [00:04<00:05, 13.13it/s]
eval model::  48%|████▊     | 61/128 [00:04<00:05, 13.22it/s]
eval model::  49%|████▉     | 63/128 [00:05<00:04, 13.45it/s]
eval model::  51%|█████     | 65/128 [00:05<00:04, 13.39it/s]
eval model::  52%|█████▏    | 67/128 [00:05<00:04, 13.33it/s]
eval model::  54%|█████▍    | 69/128 [00:05<00:04, 13.36it/s]
eval model::  55%|█████▌    | 71/128 [00:05<00:04, 13.60it/s]
eval model::  57%|█████▋    | 73/128 [00:05<00:04, 13.68it/s]
eval model::  59%|█████▊    | 75/128 [00:05<00:03, 13.80it/s]
eval model::  60%|██████    | 77/128 [00:06<00:03, 13.88it/s]
eval model::  62%|██████▏   | 79/128 [00:06<00:03, 14.00it/s]
eval model::  63%|██████▎   | 81/128 [00:06<00:03, 14.01it/s]
eval model::  65%|██████▍   | 83/128 [00:06<00:03, 14.04it/s]
eval model::  66%|██████▋   | 85/128 [00:06<00:03, 14.07it/s]
eval model::  68%|██████▊   | 87/128 [00:06<00:02, 14.12it/s]
eval model::  70%|██████▉   | 89/128 [00:06<00:02, 14.09it/s]
eval model::  71%|███████   | 91/128 [00:07<00:02, 14.01it/s]
eval model::  73%|███████▎  | 93/128 [00:07<00:02, 14.07it/s]
eval model::  74%|███████▍  | 95/128 [00:07<00:02, 13.93it/s]
eval model::  76%|███████▌  | 97/128 [00:07<00:02, 13.94it/s]
eval model::  77%|███████▋  | 99/128 [00:07<00:02, 13.97it/s]
eval model::  79%|███████▉  | 101/128 [00:07<00:01, 14.02it/s]
eval model::  80%|████████  | 103/128 [00:07<00:01, 14.06it/s]
eval model::  82%|████████▏ | 105/128 [00:08<00:01, 13.03it/s]
eval model::  84%|████████▎ | 107/128 [00:08<00:01, 12.83it/s]
eval model::  85%|████████▌ | 109/128 [00:08<00:01, 12.85it/s]
eval model::  87%|████████▋ | 111/128 [00:08<00:01, 13.22it/s]
eval model::  88%|████████▊ | 113/128 [00:08<00:01, 12.85it/s]
eval model::  90%|████████▉ | 115/128 [00:08<00:01, 12.41it/s]
eval model::  91%|█████████▏| 117/128 [00:09<00:00, 12.37it/s]
eval model::  93%|█████████▎| 119/128 [00:09<00:00, 12.36it/s]
eval model::  95%|█████████▍| 121/128 [00:09<00:00, 12.84it/s]
eval model::  96%|█████████▌| 123/128 [00:09<00:00, 13.01it/s]
eval model::  98%|█████████▊| 125/128 [00:09<00:00, 13.13it/s]
eval model::  99%|█████████▉| 127/128 [00:09<00:00, 13.22it/s]
eval model:: 100%|██████████| 128/128 [00:10<00:00, 12.79it/s]
[2026/07/25 18:06:55] ppocr INFO: cur metric, acc: 0.8488769510525466, norm_edit_dis: 0.9880389971009507, fps: 450.70768687026043
[2026/07/25 18:06:55] ppocr INFO: save best model is to /workspace/bina02-ppocr/training/stage-003/best_accuracy
[2026/07/25 18:06:55] ppocr INFO: best metric, norm_edit_dis: 0.9880389971009507, is_float16: False, acc: 0.8488769510525466, fps: 450.70768687026043, best_epoch: 1
[2026/07/25 18:06:58] ppocr INFO: epoch: [1/1], global_step: 120, lr: 0.000008, CTCLoss: 69.606964, NRTRLoss: 0.000000, loss: 69.606964, avg_reader_cost: 0.01374 s, avg_batch_cost: 0.09381 s, avg_samples: 32.0, ips: 341.11793 samples/s, eta: 0:00:28, max_mem_reserved: 1045 MB, max_mem_allocated: 672 MB
[2026/07/25 18:07:01] ppocr INFO: epoch: [1/1], global_step: 140, lr: 0.000008, CTCLoss: 64.612885, NRTRLoss: 0.000000, loss: 64.612885, avg_reader_cost: 0.06806 s, avg_batch_cost: 0.14836 s, avg_samples: 32.0, ips: 215.69625 samples/s, eta: 0:00:27, max_mem_reserved: 1045 MB, max_mem_allocated: 672 MB
[2026/07/25 18:07:03] ppocr INFO: epoch: [1/1], global_step: 160, lr: 0.000007, CTCLoss: 65.790634, NRTRLoss: 0.000000, loss: 65.790634, avg_reader_cost: 0.00556 s, avg_batch_cost: 0.08275 s, avg_samples: 32.0, ips: 386.68451 samples/s, eta: 0:00:24, max_mem_reserved: 1045 MB, max_mem_allocated: 672 MB
[2026/07/25 18:07:06] ppocr INFO: epoch: [1/1], global_step: 180, lr: 0.000006, CTCLoss: 62.374594, NRTRLoss: 0.000000, loss: 62.374594, avg_reader_cost: 0.00167 s, avg_batch_cost: 0.09270 s, avg_samples: 32.0, ips: 345.19249 samples/s, eta: 0:00:22, max_mem_reserved: 1045 MB, max_mem_allocated: 672 MB
[2026/07/25 18:07:08] ppocr INFO: epoch: [1/1], global_step: 200, lr: 0.000005, CTCLoss: 68.954147, NRTRLoss: 0.000000, loss: 68.954147, avg_reader_cost: 0.00179 s, avg_batch_cost: 0.08019 s, avg_samples: 32.0, ips: 399.03527 samples/s, eta: 0:00:19, max_mem_reserved: 1045 MB, max_mem_allocated: 672 MB

eval model::   0%|          | 0/128 [00:00<?, ?it/s]
eval model::   1%|          | 1/128 [00:00<00:55,  2.30it/s]
eval model::   2%|▏         | 3/128 [00:00<00:20,  5.98it/s]
eval model::   3%|▎         | 4/128 [00:00<00:17,  6.91it/s]
eval model::   5%|▍         | 6/128 [00:00<00:13,  8.79it/s]
eval model::   6%|▋         | 8/128 [00:00<00:11, 10.41it/s]
eval model::   8%|▊         | 10/128 [00:01<00:10, 10.91it/s]
eval model::   9%|▉         | 12/128 [00:01<00:10, 11.23it/s]
eval model::  11%|█         | 14/128 [00:01<00:09, 11.51it/s]
eval model::  12%|█▎        | 16/128 [00:01<00:09, 11.54it/s]
eval model::  14%|█▍        | 18/128 [00:01<00:09, 11.74it/s]
eval model::  16%|█▌        | 20/128 [00:01<00:08, 12.39it/s]
eval model::  17%|█▋        | 22/128 [00:02<00:08, 12.71it/s]
eval model::  19%|█▉        | 24/128 [00:02<00:08, 12.60it/s]
eval model::  20%|██        | 26/128 [00:02<00:07, 12.83it/s]
eval model::  22%|██▏       | 28/128 [00:02<00:07, 13.22it/s]
eval model::  23%|██▎       | 30/128 [00:02<00:07, 13.25it/s]
eval model::  25%|██▌       | 32/128 [00:02<00:07, 13.24it/s]
eval model::  27%|██▋       | 34/128 [00:03<00:07, 13.21it/s]
eval model::  28%|██▊       | 36/128 [00:03<00:06, 13.50it/s]
eval model::  30%|██▉       | 38/128 [00:03<00:06, 13.37it/s]
eval model::  31%|███▏      | 40/128 [00:03<00:06, 13.40it/s]
eval model::  33%|███▎      | 42/128 [00:03<00:06, 13.40it/s]
eval model::  34%|███▍      | 44/128 [00:03<00:06, 13.65it/s]
eval model::  36%|███▌      | 46/128 [00:03<00:06, 13.61it/s]
eval model::  38%|███▊      | 48/128 [00:04<00:05, 13.75it/s]
eval model::  39%|███▉      | 50/128 [00:04<00:05, 13.85it/s]
eval model::  41%|████      | 52/128 [00:04<00:05, 13.93it/s]
eval model::  42%|████▏     | 54/128 [00:04<00:05, 13.98it/s]
eval model::  44%|████▍     | 56/128 [00:04<00:05, 13.99it/s]
eval model::  45%|████▌     | 58/128 [00:04<00:04, 14.03it/s]
eval model::  47%|████▋     | 60/128 [00:04<00:04, 14.10it/s]
eval model::  48%|████▊     | 62/128 [00:05<00:04, 14.04it/s]
eval model::  50%|█████     | 64/128 [00:05<00:04, 14.06it/s]
eval model::  52%|█████▏    | 66/128 [00:05<00:04, 14.12it/s]
eval model::  53%|█████▎    | 68/128 [00:05<00:04, 14.09it/s]
eval model::  55%|█████▍    | 70/128 [00:05<00:04, 14.11it/s]
eval model::  56%|█████▋    | 72/128 [00:05<00:03, 14.15it/s]
eval model::  58%|█████▊    | 74/128 [00:05<00:03, 14.11it/s]
eval model::  59%|█████▉    | 76/128 [00:06<00:03, 14.10it/s]
eval model::  61%|██████    | 78/128 [00:06<00:03, 14.10it/s]
eval model::  62%|██████▎   | 80/128 [00:06<00:03, 14.12it/s]
eval model::  64%|██████▍   | 82/128 [00:06<00:03, 13.19it/s]
eval model::  66%|██████▌   | 84/128 [00:06<00:03, 12.47it/s]
eval model::  67%|██████▋   | 86/128 [00:06<00:03, 12.11it/s]
eval model::  69%|██████▉   | 88/128 [00:07<00:03, 11.69it/s]
eval model::  70%|███████   | 90/128 [00:07<00:03, 11.83it/s]
eval model::  72%|███████▏  | 92/128 [00:07<00:03, 11.94it/s]
eval model::  73%|███████▎  | 94/128 [00:07<00:02, 11.81it/s]
eval model::  75%|███████▌  | 96/128 [00:07<00:02, 12.41it/s]
eval model::  77%|███████▋  | 98/128 [00:07<00:02, 12.61it/s]
eval model::  78%|███████▊  | 100/128 [00:07<00:02, 12.77it/s]
eval model::  80%|███████▉  | 102/128 [00:08<00:02, 12.99it/s]
eval model::  81%|████████▏ | 104/128 [00:08<00:01, 13.31it/s]
eval model::  83%|████████▎ | 106/128 [00:08<00:01, 13.31it/s]
eval model::  84%|████████▍ | 108/128 [00:08<00:01, 13.28it/s]
eval model::  86%|████████▌ | 110/128 [00:08<00:01, 13.07it/s]
eval model::  88%|████████▊ | 112/128 [00:08<00:01, 13.15it/s]
eval model::  89%|████████▉ | 114/128 [00:09<00:01, 13.42it/s]
eval model::  91%|█████████ | 116/128 [00:09<00:00, 13.42it/s]
eval model::  92%|█████████▏| 118/128 [00:09<00:00, 13.38it/s]
eval model::  94%|█████████▍| 120/128 [00:09<00:00, 13.37it/s]
eval model::  95%|█████████▌| 122/128 [00:09<00:00, 13.64it/s]
eval model::  97%|█████████▋| 124/128 [00:09<00:00, 13.79it/s]
eval model::  98%|█████████▊| 126/128 [00:09<00:00, 13.89it/s]
eval model:: 100%|██████████| 128/128 [00:10<00:00, 14.02it/s]
eval model:: 100%|██████████| 128/128 [00:10<00:00, 12.58it/s]
[2026/07/25 18:07:18] ppocr INFO: cur metric, acc: 0.8488769510525466, norm_edit_dis: 0.9880409407145663, fps: 446.7809069352185
[2026/07/25 18:07:19] ppocr INFO: save best model is to /workspace/bina02-ppocr/training/stage-003/best_accuracy
[2026/07/25 18:07:19] ppocr INFO: best metric, norm_edit_dis: 0.9880409407145663, is_float16: False, acc: 0.8488769510525466, fps: 446.7809069352185, best_epoch: 1
[2026/07/25 18:07:21] ppocr INFO: epoch: [1/1], global_step: 220, lr: 0.000004, CTCLoss: 61.628899, NRTRLoss: 0.000000, loss: 61.628899, avg_reader_cost: 0.00158 s, avg_batch_cost: 0.08224 s, avg_samples: 32.0, ips: 389.11144 samples/s, eta: 0:00:17, max_mem_reserved: 1045 MB, max_mem_allocated: 672 MB
[2026/07/25 18:07:24] ppocr INFO: epoch: [1/1], global_step: 240, lr: 0.000004, CTCLoss: 57.565746, NRTRLoss: 0.000000, loss: 57.565746, avg_reader_cost: 0.00159 s, avg_batch_cost: 0.08079 s, avg_samples: 32.0, ips: 396.06545 samples/s, eta: 0:00:15, max_mem_reserved: 1045 MB, max_mem_allocated: 672 MB
[2026/07/25 18:07:27] ppocr INFO: epoch: [1/1], global_step: 260, lr: 0.000003, CTCLoss: 63.497097, NRTRLoss: 0.000000, loss: 63.497097, avg_reader_cost: 0.00146 s, avg_batch_cost: 0.08165 s, avg_samples: 32.0, ips: 391.92115 samples/s, eta: 0:00:12, max_mem_reserved: 1045 MB, max_mem_allocated: 672 MB
[2026/07/25 18:07:29] ppocr INFO: epoch: [1/1], global_step: 280, lr: 0.000002, CTCLoss: 61.643040, NRTRLoss: 0.000000, loss: 61.643040, avg_reader_cost: 0.00159 s, avg_batch_cost: 0.07862 s, avg_samples: 32.0, ips: 407.04491 samples/s, eta: 0:00:10, max_mem_reserved: 1045 MB, max_mem_allocated: 672 MB
[2026/07/25 18:07:31] ppocr INFO: epoch: [1/1], global_step: 300, lr: 0.000002, CTCLoss: 58.420853, NRTRLoss: 0.000000, loss: 58.420853, avg_reader_cost: 0.00163 s, avg_batch_cost: 0.08035 s, avg_samples: 32.0, ips: 398.24714 samples/s, eta: 0:00:08, max_mem_reserved: 1045 MB, max_mem_allocated: 672 MB

eval model::   0%|          | 0/128 [00:00<?, ?it/s]
eval model::   1%|          | 1/128 [00:00<00:58,  2.15it/s]
eval model::   2%|▏         | 2/128 [00:00<00:32,  3.93it/s]
eval model::   3%|▎         | 4/128 [00:00<00:17,  6.98it/s]
eval model::   5%|▍         | 6/128 [00:00<00:13,  9.08it/s]
eval model::   6%|▋         | 8/128 [00:01<00:11, 10.31it/s]
eval model::   8%|▊         | 10/128 [00:01<00:10, 11.12it/s]
eval model::   9%|▉         | 12/128 [00:01<00:09, 11.67it/s]
eval model::  11%|█         | 14/128 [00:01<00:09, 12.07it/s]
eval model::  12%|█▎        | 16/128 [00:01<00:08, 12.56it/s]
eval model::  14%|█▍        | 18/128 [00:01<00:08, 12.64it/s]
eval model::  16%|█▌        | 20/128 [00:01<00:08, 12.65it/s]
eval model::  17%|█▋        | 22/128 [00:02<00:08, 12.72it/s]
eval model::  19%|█▉        | 24/128 [00:02<00:08, 12.99it/s]
eval model::  20%|██        | 26/128 [00:02<00:07, 12.92it/s]
eval model::  22%|██▏       | 28/128 [00:02<00:07, 13.15it/s]
eval model::  23%|██▎       | 30/128 [00:02<00:07, 13.22it/s]
eval model::  25%|██▌       | 32/128 [00:02<00:07, 13.35it/s]
eval model::  27%|██▋       | 34/128 [00:02<00:06, 13.43it/s]
eval model::  28%|██▊       | 36/128 [00:03<00:06, 13.46it/s]
eval model::  30%|██▉       | 38/128 [00:03<00:06, 13.45it/s]
eval model::  31%|███▏      | 40/128 [00:03<00:06, 13.50it/s]
eval model::  33%|███▎      | 42/128 [00:03<00:06, 13.51it/s]
eval model::  34%|███▍      | 44/128 [00:03<00:06, 13.55it/s]
eval model::  36%|███▌      | 46/128 [00:03<00:06, 13.51it/s]
eval model::  38%|███▊      | 48/128 [00:04<00:05, 13.56it/s]
eval model::  39%|███▉      | 50/128 [00:04<00:05, 13.53it/s]
eval model::  41%|████      | 52/128 [00:04<00:05, 13.65it/s]
eval model::  42%|████▏     | 54/128 [00:04<00:05, 13.60it/s]
eval model::  44%|████▍     | 56/128 [00:04<00:05, 13.63it/s]
eval model::  45%|████▌     | 58/128 [00:04<00:05, 13.60it/s]
eval model::  47%|████▋     | 60/128 [00:04<00:05, 12.28it/s]
eval model::  48%|████▊     | 62/128 [00:05<00:05, 11.42it/s]
eval model::  50%|█████     | 64/128 [00:05<00:06,  9.21it/s]
eval model::  52%|█████▏    | 66/128 [00:05<00:06,  9.03it/s]
eval model::  53%|█████▎    | 68/128 [00:05<00:06,  9.14it/s]
eval model::  54%|█████▍    | 69/128 [00:06<00:06,  8.59it/s]
eval model::  55%|█████▌    | 71/128 [00:06<00:05,  9.59it/s]
eval model::  57%|█████▋    | 73/128 [00:06<00:05, 10.72it/s]
eval model::  59%|█████▊    | 75/128 [00:06<00:04, 11.37it/s]
eval model::  60%|██████    | 77/128 [00:06<00:04, 11.95it/s]
eval model::  62%|██████▏   | 79/128 [00:06<00:03, 12.37it/s]
eval model::  63%|██████▎   | 81/128 [00:06<00:03, 12.90it/s]
eval model::  65%|██████▍   | 83/128 [00:07<00:03, 13.04it/s]
eval model::  66%|██████▋   | 85/128 [00:07<00:03, 13.18it/s]
eval model::  68%|██████▊   | 87/128 [00:07<00:03, 13.17it/s]
eval model::  70%|██████▉   | 89/128 [00:07<00:02, 13.18it/s]
eval model::  71%|███████   | 91/128 [00:07<00:02, 13.47it/s]
eval model::  73%|███████▎  | 93/128 [00:07<00:02, 13.47it/s]
eval model::  74%|███████▍  | 95/128 [00:08<00:02, 13.63it/s]
eval model::  76%|███████▌  | 97/128 [00:08<00:02, 13.80it/s]
eval model::  77%|███████▋  | 99/128 [00:08<00:02, 13.70it/s]
eval model::  79%|███████▉  | 101/128 [00:08<00:01, 13.74it/s]
eval model::  80%|████████  | 103/128 [00:08<00:01, 13.79it/s]
eval model::  82%|████████▏ | 105/128 [00:08<00:01, 13.90it/s]
eval model::  84%|████████▎ | 107/128 [00:08<00:01, 13.91it/s]
eval model::  85%|████████▌ | 109/128 [00:09<00:01, 13.97it/s]
eval model::  87%|████████▋ | 111/128 [00:09<00:01, 14.00it/s]
eval model::  88%|████████▊ | 113/128 [00:09<00:01, 14.08it/s]
eval model::  90%|████████▉ | 115/128 [00:09<00:00, 14.03it/s]
eval model::  91%|█████████▏| 117/128 [00:09<00:00, 14.04it/s]
eval model::  93%|█████████▎| 119/128 [00:09<00:00, 14.10it/s]
eval model::  95%|█████████▍| 121/128 [00:09<00:00, 14.10it/s]
eval model::  96%|█████████▌| 123/128 [00:10<00:00, 13.72it/s]
eval model::  98%|█████████▊| 125/128 [00:10<00:00, 13.46it/s]
eval model::  99%|█████████▉| 127/128 [00:10<00:00, 13.70it/s]
eval model:: 100%|██████████| 128/128 [00:10<00:00, 12.11it/s]
[2026/07/25 18:07:42] ppocr INFO: cur metric, acc: 0.8488769510525466, norm_edit_dis: 0.9880323404270831, fps: 432.85781643740944
[2026/07/25 18:07:42] ppocr INFO: best metric, norm_edit_dis: 0.9880409407145663, is_float16: False, acc: 0.8488769510525466, fps: 446.7809069352185, best_epoch: 1
LAUNCH INFO 2026-07-25 18:07:42,942 Terminating with signal 2
LAUNCH INFO 2026-07-25 18:07:43,051 Force quit in 10 seconds...