File size: 6,893 Bytes
7e6c03a | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 | nohup: ignoring input
================================================================
Starting generation of multihop reasoning traces using Llama 3.1
Environment: irl_torch2
Dataset: /home/debarpanb1/TREA_2.0/pipeline/dataset_v5
================================================================
Loading meta-llama/Llama-3.1-8B-Instruct...
Loading checkpoint shards: 0%| | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards: 25%|██▌ | 1/4 [01:02<03:07, 62.47s/it]
Loading checkpoint shards: 50%|█████ | 2/4 [02:05<02:05, 62.64s/it]
Loading checkpoint shards: 75%|███████▌ | 3/4 [03:08<01:02, 62.72s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [03:37<00:00, 49.62s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [03:37<00:00, 54.40s/it]
The attention mask is not set and cannot be inferred from input because pad token is same as eos token. As a consequence, you may observe unexpected behavior. Please pass your input's `attention_mask` to obtain reliable results.
Model loaded on cuda:0
============================================================
Task: conditional_count
============================================================
Processing conditional_count: 93 samples
10/93 done
20/93 done
30/93 done
[RETRY] sample 31 attempt 1
[RETRY] sample 38 attempt 1
[RETRY] sample 38 attempt 2
40/93 done
[RETRY] sample 45 attempt 1
50/93 done
60/93 done
70/93 done
[RETRY] sample 70 attempt 1
[RETRY] sample 72 attempt 1
[RETRY] sample 72 attempt 2
[RETRY] sample 79 attempt 1
80/93 done
90/93 done
Saved /home/debarpanb1/TREA_2.0/pipeline/dataset_v5/conditional_count/conditional_count_open_text.csv
Saved /home/debarpanb1/TREA_2.0/pipeline/dataset_v5/conditional_count/conditional_count_mcq.csv
Saved /home/debarpanb1/TREA_2.0/pipeline/dataset_v5/conditional_count/conditional_count_metadata.csv
============================================================
Task: conditional_duration
============================================================
Processing conditional_duration: 70 samples
[RETRY] sample 3 attempt 1
[RETRY] sample 3 attempt 2
10/70 done
20/70 done
[RETRY] sample 31 attempt 1
[RETRY] sample 35 attempt 1
30/70 done
[RETRY] sample 39 attempt 1
[RETRY] sample 39 attempt 2
40/70 done
50/70 done
60/70 done
70/70 done
Saved /home/debarpanb1/TREA_2.0/pipeline/dataset_v5/conditional_duration/conditional_duration_open_text.csv
Saved /home/debarpanb1/TREA_2.0/pipeline/dataset_v5/conditional_duration/conditional_duration_mcq.csv
Saved /home/debarpanb1/TREA_2.0/pipeline/dataset_v5/conditional_duration/conditional_duration_metadata.csv
============================================================
Task: between_events
============================================================
Processing between_events: 96 samples
10/96 done
[RETRY] sample 17 attempt 1
20/96 done
30/96 done
[RETRY] sample 37 attempt 1
40/96 done
50/96 done
[RETRY] sample 52 attempt 1
60/96 done
[RETRY] sample 61 attempt 1
70/96 done
[RETRY] sample 71 attempt 1
80/96 done
90/96 done
Saved /home/debarpanb1/TREA_2.0/pipeline/dataset_v5/between_events/between_events_open_text.csv
Saved /home/debarpanb1/TREA_2.0/pipeline/dataset_v5/between_events/between_events_mcq.csv
Saved /home/debarpanb1/TREA_2.0/pipeline/dataset_v5/between_events/between_events_metadata.csv
============================================================
Task: event_density
============================================================
Processing event_density: 92 samples
10/92 done
20/92 done
[RETRY] sample 20 attempt 1
30/92 done
40/92 done
[RETRY] sample 46 attempt 1
[RETRY] sample 49 attempt 1
[RETRY] sample 49 attempt 2
50/92 done
60/92 done
70/92 done
[RETRY] sample 71 attempt 1
80/92 done
[RETRY] sample 81 attempt 1
90/92 done
Saved /home/debarpanb1/TREA_2.0/pipeline/dataset_v5/event_density/event_density_open_text.csv
Saved /home/debarpanb1/TREA_2.0/pipeline/dataset_v5/event_density/event_density_mcq.csv
Saved /home/debarpanb1/TREA_2.0/pipeline/dataset_v5/event_density/event_density_metadata.csv
============================================================
Task: duration_gap
============================================================
Processing duration_gap: 92 samples
Traceback (most recent call last):
File "/home/debarpanb1/TREA_2.0/pipeline/generate_reasoning_traces.py", line 442, in <module>
main()
File "/home/debarpanb1/TREA_2.0/pipeline/generate_reasoning_traces.py", line 431, in main
process_task(
File "/home/debarpanb1/TREA_2.0/pipeline/generate_reasoning_traces.py", line 326, in process_task
sym_trace = compute_symbolic_trace(
^^^^^^^^^^^^^^^^^^^^^^^
File "/home/debarpanb1/TREA_2.0/pipeline/generate_reasoning_traces.py", line 152, in compute_symbolic_trace
placeholders = try_extract_placeholders(question, open_templates, question_type)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/debarpanb1/TREA_2.0/pipeline/generate_reasoning_traces.py", line 118, in try_extract_placeholders
result = extract_placeholder(question, tmpl)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/debarpanb1/TREA_2.0/pipeline/generate_reasoning_traces.py", line 100, in extract_placeholder
m = re.match(regex, question)
^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/debarpanb1/anaconda3/envs/irl_torch2/lib/python3.11/re/__init__.py", line 166, in match
return _compile(pattern, flags).match(string)
^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/debarpanb1/anaconda3/envs/irl_torch2/lib/python3.11/re/__init__.py", line 294, in _compile
p = _compiler.compile(pattern, flags)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/debarpanb1/anaconda3/envs/irl_torch2/lib/python3.11/re/_compiler.py", line 745, in compile
p = _parser.parse(p, flags)
^^^^^^^^^^^^^^^^^^^^^^^
File "/home/debarpanb1/anaconda3/envs/irl_torch2/lib/python3.11/re/_parser.py", line 989, in parse
p = _parse_sub(source, state, flags & SRE_FLAG_VERBOSE, 0)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/debarpanb1/anaconda3/envs/irl_torch2/lib/python3.11/re/_parser.py", line 464, in _parse_sub
itemsappend(_parse(source, state, verbose, nested + 1,
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/debarpanb1/anaconda3/envs/irl_torch2/lib/python3.11/re/_parser.py", line 867, in _parse
raise source.error(err.msg, len(name) + 1) from None
re.error: redefinition of group name 'sound1' as group 2; was group 1 at position 68
|