kertob commited on
Commit
8746b08
·
verified ·
1 Parent(s): 6dc069b

Training in progress, step 20

Browse files
adapter_model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:d722d623b8c138caae565230178dac691486e99dc0524fa545a535ae6dd6d691
3
  size 261131840
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2cdf075222b2659ea6a422ed17bc20843a9ec2f86b7b7259531df8e479838a16
3
  size 261131840
runs/Mar08_12-04-48_4997a2709b0f/events.out.tfevents.1709899498.4997a2709b0f.941.0 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:8e466645e168772b7ebdb99e9eaaf7266ffdacb2049b0eb2a73916f5c4e5bd0f
3
- size 5939
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dcf5a2da29f5ecfb4c8861c7cb1a54a364dbf0fafe2e1f0021d16c0ac7a1559f
3
+ size 6146
wandb/debug-internal.log CHANGED
@@ -111,3 +111,54 @@
111
  2024-03-08 12:13:55,195 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
112
  2024-03-08 12:13:55,235 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
113
  2024-03-08 12:13:55,464 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
111
  2024-03-08 12:13:55,195 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
112
  2024-03-08 12:13:55,235 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
113
  2024-03-08 12:13:55,464 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
114
+ 2024-03-08 12:14:00,465 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
115
+ 2024-03-08 12:14:05,467 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
116
+ 2024-03-08 12:14:09,772 DEBUG SenderThread:10843 [sender.py:send():378] send: stats
117
+ 2024-03-08 12:14:10,195 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
118
+ 2024-03-08 12:14:10,195 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
119
+ 2024-03-08 12:14:10,235 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
120
+ 2024-03-08 12:14:11,413 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
121
+ 2024-03-08 12:14:16,414 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
122
+ 2024-03-08 12:14:21,415 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
123
+ 2024-03-08 12:14:25,195 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
124
+ 2024-03-08 12:14:25,195 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
125
+ 2024-03-08 12:14:25,236 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
126
+ 2024-03-08 12:14:26,465 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
127
+ 2024-03-08 12:14:31,466 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
128
+ 2024-03-08 12:14:36,467 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
129
+ 2024-03-08 12:14:39,773 DEBUG SenderThread:10843 [sender.py:send():378] send: stats
130
+ 2024-03-08 12:14:40,195 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
131
+ 2024-03-08 12:14:40,196 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
132
+ 2024-03-08 12:14:40,236 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
133
+ 2024-03-08 12:14:42,466 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
134
+ 2024-03-08 12:14:47,467 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
135
+ 2024-03-08 12:14:52,468 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
136
+ 2024-03-08 12:14:55,195 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
137
+ 2024-03-08 12:14:55,196 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
138
+ 2024-03-08 12:14:55,236 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
139
+ 2024-03-08 12:14:58,403 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
140
+ 2024-03-08 12:15:03,404 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
141
+ 2024-03-08 12:15:08,405 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
142
+ 2024-03-08 12:15:09,774 DEBUG SenderThread:10843 [sender.py:send():378] send: stats
143
+ 2024-03-08 12:15:10,195 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
144
+ 2024-03-08 12:15:10,196 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
145
+ 2024-03-08 12:15:10,236 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
146
+ 2024-03-08 12:15:12,401 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: partial_history
147
+ 2024-03-08 12:15:12,402 DEBUG SenderThread:10843 [sender.py:send():378] send: history
148
+ 2024-03-08 12:15:12,403 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: summary_record
149
+ 2024-03-08 12:15:12,403 INFO SenderThread:10843 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end
150
+ 2024-03-08 12:15:12,677 INFO Thread-12 :10843 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/wandb/run-20240308_121134-5y42ufcl/files/wandb-summary.json
151
+ 2024-03-08 12:15:14,404 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
152
+ 2024-03-08 12:15:19,405 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
153
+ 2024-03-08 12:15:24,406 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
154
+ 2024-03-08 12:15:25,195 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
155
+ 2024-03-08 12:15:25,196 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
156
+ 2024-03-08 12:15:25,197 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
157
+ 2024-03-08 12:15:29,414 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
158
+ 2024-03-08 12:15:34,415 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
159
+ 2024-03-08 12:15:39,416 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
160
+ 2024-03-08 12:15:39,775 DEBUG SenderThread:10843 [sender.py:send():378] send: stats
161
+ 2024-03-08 12:15:40,196 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
162
+ 2024-03-08 12:15:40,196 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
163
+ 2024-03-08 12:15:40,236 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
164
+ 2024-03-08 12:15:44,467 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
wandb/run-20240308_121134-5y42ufcl/files/wandb-summary.json CHANGED
@@ -1 +1 @@
1
- {"train/loss": 2.3501, "train/grad_norm": 1.3986674547195435, "train/learning_rate": 0.00019996629653035126, "train/epoch": 0.8, "train/global_step": 10, "_timestamp": 1709900000.889258, "_runtime": 106.82863092422485, "_step": 0}
 
1
+ {"train/loss": 0.0945, "train/grad_norm": 0.021162761375308037, "train/learning_rate": 0.00019878905881817252, "train/epoch": 1.6, "train/global_step": 20, "_timestamp": 1709900112.4008648, "_runtime": 218.34023785591125, "_step": 1}
wandb/run-20240308_121134-5y42ufcl/logs/debug-internal.log CHANGED
@@ -111,3 +111,54 @@
111
  2024-03-08 12:13:55,195 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
112
  2024-03-08 12:13:55,235 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
113
  2024-03-08 12:13:55,464 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
111
  2024-03-08 12:13:55,195 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
112
  2024-03-08 12:13:55,235 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
113
  2024-03-08 12:13:55,464 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
114
+ 2024-03-08 12:14:00,465 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
115
+ 2024-03-08 12:14:05,467 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
116
+ 2024-03-08 12:14:09,772 DEBUG SenderThread:10843 [sender.py:send():378] send: stats
117
+ 2024-03-08 12:14:10,195 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
118
+ 2024-03-08 12:14:10,195 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
119
+ 2024-03-08 12:14:10,235 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
120
+ 2024-03-08 12:14:11,413 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
121
+ 2024-03-08 12:14:16,414 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
122
+ 2024-03-08 12:14:21,415 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
123
+ 2024-03-08 12:14:25,195 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
124
+ 2024-03-08 12:14:25,195 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
125
+ 2024-03-08 12:14:25,236 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
126
+ 2024-03-08 12:14:26,465 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
127
+ 2024-03-08 12:14:31,466 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
128
+ 2024-03-08 12:14:36,467 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
129
+ 2024-03-08 12:14:39,773 DEBUG SenderThread:10843 [sender.py:send():378] send: stats
130
+ 2024-03-08 12:14:40,195 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
131
+ 2024-03-08 12:14:40,196 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
132
+ 2024-03-08 12:14:40,236 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
133
+ 2024-03-08 12:14:42,466 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
134
+ 2024-03-08 12:14:47,467 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
135
+ 2024-03-08 12:14:52,468 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
136
+ 2024-03-08 12:14:55,195 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
137
+ 2024-03-08 12:14:55,196 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
138
+ 2024-03-08 12:14:55,236 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
139
+ 2024-03-08 12:14:58,403 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
140
+ 2024-03-08 12:15:03,404 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
141
+ 2024-03-08 12:15:08,405 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
142
+ 2024-03-08 12:15:09,774 DEBUG SenderThread:10843 [sender.py:send():378] send: stats
143
+ 2024-03-08 12:15:10,195 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
144
+ 2024-03-08 12:15:10,196 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
145
+ 2024-03-08 12:15:10,236 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
146
+ 2024-03-08 12:15:12,401 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: partial_history
147
+ 2024-03-08 12:15:12,402 DEBUG SenderThread:10843 [sender.py:send():378] send: history
148
+ 2024-03-08 12:15:12,403 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: summary_record
149
+ 2024-03-08 12:15:12,403 INFO SenderThread:10843 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end
150
+ 2024-03-08 12:15:12,677 INFO Thread-12 :10843 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/wandb/run-20240308_121134-5y42ufcl/files/wandb-summary.json
151
+ 2024-03-08 12:15:14,404 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
152
+ 2024-03-08 12:15:19,405 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
153
+ 2024-03-08 12:15:24,406 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
154
+ 2024-03-08 12:15:25,195 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
155
+ 2024-03-08 12:15:25,196 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
156
+ 2024-03-08 12:15:25,197 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
157
+ 2024-03-08 12:15:29,414 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
158
+ 2024-03-08 12:15:34,415 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
159
+ 2024-03-08 12:15:39,416 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
160
+ 2024-03-08 12:15:39,775 DEBUG SenderThread:10843 [sender.py:send():378] send: stats
161
+ 2024-03-08 12:15:40,196 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
162
+ 2024-03-08 12:15:40,196 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
163
+ 2024-03-08 12:15:40,236 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
164
+ 2024-03-08 12:15:44,467 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
wandb/run-20240308_121134-5y42ufcl/run-5y42ufcl.wandb CHANGED
Binary files a/wandb/run-20240308_121134-5y42ufcl/run-5y42ufcl.wandb and b/wandb/run-20240308_121134-5y42ufcl/run-5y42ufcl.wandb differ