😊 testing /home/ace14459tv/t5maru/error_3_0630_test.jsonl on cuda
Downloading and preparing dataset generator/default to /home/ace14459tv/t5maru/cache/generator/default-79ce6c4c3cbc6042/0.0.0...

Generating train split: 0 examples [00:00, ? examples/s]
                                                        
Dataset generator downloaded and prepared to /home/ace14459tv/t5maru/cache/generator/default-79ce6c4c3cbc6042/0.0.0. Subsequent calls will reuse this data.

Map (num_proc=4):   0%|          | 0/617 [00:00<?, ? examples/s]
Map (num_proc=4):  15%|█▌        | 95/617 [00:00<00:03, 146.49 examples/s]
Map (num_proc=4):  42%|████▏     | 257/617 [00:01<00:01, 239.59 examples/s]
Map (num_proc=4):  67%|██████▋   | 414/617 [00:01<00:00, 284.38 examples/s]
Map (num_proc=4):  92%|█████████▏| 567/617 [00:02<00:00, 306.92 examples/s]
                                                                           
😊 Tested 617 items. See error_codet5_base_324/error_3_0630_tested.jsonl