| nohup: ignoring input |
| ================================================================ |
| Starting generation of multihop reasoning traces using Llama 3.1 |
| Environment: irl_torch2 |
| Dataset: /home/debarpanb1/TREA_2.0/pipeline/dataset_v5 |
| ================================================================ |
| Loading meta-llama/Llama-3.1-8B-Instruct... |
|
Loading checkpoint shards: 0%| | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards: 25%|██▌ | 1/4 [01:02<03:07, 62.47s/it]
Loading checkpoint shards: 50%|█████ | 2/4 [02:05<02:05, 62.64s/it]
Loading checkpoint shards: 75%|███████▌ | 3/4 [03:08<01:02, 62.72s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [03:37<00:00, 49.62s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [03:37<00:00, 54.40s/it] |
| The attention mask is not set and cannot be inferred from input because pad token is same as eos token. As a consequence, you may observe unexpected behavior. Please pass your input's `attention_mask` to obtain reliable results. |
| Model loaded on cuda:0 |
|
|
| ============================================================ |
| Task: conditional_count |
| ============================================================ |
| Processing conditional_count: 93 samples |
| 10/93 done |
| 20/93 done |
| 30/93 done |
| [RETRY] sample 31 attempt 1 |
| [RETRY] sample 38 attempt 1 |
| [RETRY] sample 38 attempt 2 |
| 40/93 done |
| [RETRY] sample 45 attempt 1 |
| 50/93 done |
| 60/93 done |
| 70/93 done |
| [RETRY] sample 70 attempt 1 |
| [RETRY] sample 72 attempt 1 |
| [RETRY] sample 72 attempt 2 |
| [RETRY] sample 79 attempt 1 |
| 80/93 done |
| 90/93 done |
| Saved /home/debarpanb1/TREA_2.0/pipeline/dataset_v5/conditional_count/conditional_count_open_text.csv |
| Saved /home/debarpanb1/TREA_2.0/pipeline/dataset_v5/conditional_count/conditional_count_mcq.csv |
| Saved /home/debarpanb1/TREA_2.0/pipeline/dataset_v5/conditional_count/conditional_count_metadata.csv |
| |
| ============================================================ |
| Task: conditional_duration |
| ============================================================ |
| Processing conditional_duration: 70 samples |
| [RETRY] sample 3 attempt 1 |
| [RETRY] sample 3 attempt 2 |
| 10/70 done |
| 20/70 done |
| [RETRY] sample 31 attempt 1 |
| [RETRY] sample 35 attempt 1 |
| 30/70 done |
| [RETRY] sample 39 attempt 1 |
| [RETRY] sample 39 attempt 2 |
| 40/70 done |
| 50/70 done |
| 60/70 done |
| 70/70 done |
| Saved /home/debarpanb1/TREA_2.0/pipeline/dataset_v5/conditional_duration/conditional_duration_open_text.csv |
| Saved /home/debarpanb1/TREA_2.0/pipeline/dataset_v5/conditional_duration/conditional_duration_mcq.csv |
| Saved /home/debarpanb1/TREA_2.0/pipeline/dataset_v5/conditional_duration/conditional_duration_metadata.csv |
| |
| ============================================================ |
| Task: between_events |
| ============================================================ |
| Processing between_events: 96 samples |
| 10/96 done |
| [RETRY] sample 17 attempt 1 |
| 20/96 done |
| 30/96 done |
| [RETRY] sample 37 attempt 1 |
| 40/96 done |
| 50/96 done |
| [RETRY] sample 52 attempt 1 |
| 60/96 done |
| [RETRY] sample 61 attempt 1 |
| 70/96 done |
| [RETRY] sample 71 attempt 1 |
| 80/96 done |
| 90/96 done |
| Saved /home/debarpanb1/TREA_2.0/pipeline/dataset_v5/between_events/between_events_open_text.csv |
| Saved /home/debarpanb1/TREA_2.0/pipeline/dataset_v5/between_events/between_events_mcq.csv |
| Saved /home/debarpanb1/TREA_2.0/pipeline/dataset_v5/between_events/between_events_metadata.csv |
| |
| ============================================================ |
| Task: event_density |
| ============================================================ |
| Processing event_density: 92 samples |
| 10/92 done |
| 20/92 done |
| [RETRY] sample 20 attempt 1 |
| 30/92 done |
| 40/92 done |
| [RETRY] sample 46 attempt 1 |
| [RETRY] sample 49 attempt 1 |
| [RETRY] sample 49 attempt 2 |
| 50/92 done |
| 60/92 done |
| 70/92 done |
| [RETRY] sample 71 attempt 1 |
| 80/92 done |
| [RETRY] sample 81 attempt 1 |
| 90/92 done |
| Saved /home/debarpanb1/TREA_2.0/pipeline/dataset_v5/event_density/event_density_open_text.csv |
| Saved /home/debarpanb1/TREA_2.0/pipeline/dataset_v5/event_density/event_density_mcq.csv |
| Saved /home/debarpanb1/TREA_2.0/pipeline/dataset_v5/event_density/event_density_metadata.csv |
| |
| ============================================================ |
| Task: duration_gap |
| ============================================================ |
| Processing duration_gap: 92 samples |
| Traceback (most recent call last): |
| File "/home/debarpanb1/TREA_2.0/pipeline/generate_reasoning_traces.py", line 442, in <module> |
| main() |
| File "/home/debarpanb1/TREA_2.0/pipeline/generate_reasoning_traces.py", line 431, in main |
| process_task( |
| File "/home/debarpanb1/TREA_2.0/pipeline/generate_reasoning_traces.py", line 326, in process_task |
| sym_trace = compute_symbolic_trace( |
| ^^^^^^^^^^^^^^^^^^^^^^^ |
| File "/home/debarpanb1/TREA_2.0/pipeline/generate_reasoning_traces.py", line 152, in compute_symbolic_trace |
| placeholders = try_extract_placeholders(question, open_templates, question_type) |
| ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ |
| File "/home/debarpanb1/TREA_2.0/pipeline/generate_reasoning_traces.py", line 118, in try_extract_placeholders |
| result = extract_placeholder(question, tmpl) |
| ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ |
| File "/home/debarpanb1/TREA_2.0/pipeline/generate_reasoning_traces.py", line 100, in extract_placeholder |
| m = re.match(regex, question) |
| ^^^^^^^^^^^^^^^^^^^^^^^^^ |
| File "/home/debarpanb1/anaconda3/envs/irl_torch2/lib/python3.11/re/__init__.py", line 166, in match |
| return _compile(pattern, flags).match(string) |
| ^^^^^^^^^^^^^^^^^^^^^^^^ |
| File "/home/debarpanb1/anaconda3/envs/irl_torch2/lib/python3.11/re/__init__.py", line 294, in _compile |
| p = _compiler.compile(pattern, flags) |
| ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ |
| File "/home/debarpanb1/anaconda3/envs/irl_torch2/lib/python3.11/re/_compiler.py", line 745, in compile |
| p = _parser.parse(p, flags) |
| ^^^^^^^^^^^^^^^^^^^^^^^ |
| File "/home/debarpanb1/anaconda3/envs/irl_torch2/lib/python3.11/re/_parser.py", line 989, in parse |
| p = _parse_sub(source, state, flags & SRE_FLAG_VERBOSE, 0) |
| ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ |
| File "/home/debarpanb1/anaconda3/envs/irl_torch2/lib/python3.11/re/_parser.py", line 464, in _parse_sub |
| itemsappend(_parse(source, state, verbose, nested + 1, |
| ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ |
| File "/home/debarpanb1/anaconda3/envs/irl_torch2/lib/python3.11/re/_parser.py", line 867, in _parse |
| raise source.error(err.msg, len(name) + 1) from None |
| re.error: redefinition of group name 'sound1' as group 2; was group 1 at position 68 |
| |
