sharukat commited on
Commit
38be170
·
verified ·
1 Parent(s): b76b883

Training in progress, epoch 3

Browse files
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:16f00f7a7dd0bed4aac41e611368787efa6ec88bbeae8b0e7f67642288fda52c
3
  size 502675828
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f6b7c3719030cce74403231ded709358a3933bc13770fd664c2aeac8ed1f4132
3
  size 502675828
runs/Mar06_16-01-10_30b2b3b8a538/events.out.tfevents.1709740872.30b2b3b8a538.186.0 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:9c3fede794a6e0996edd8024a216c3bbe70866da292be068320069527e7657c9
3
- size 6533
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:03a675684920e29a959d2371366e4c21ee8fe144fed17e24e7eb941cc2449f7b
3
+ size 7216
wandb/debug-internal.log CHANGED
@@ -160,3 +160,45 @@
160
  2024-03-06 16:04:16,345 DEBUG SenderThread:249 [sender.py:send():382] send: stats
161
  2024-03-06 16:04:17,432 DEBUG HandlerThread:249 [handler.py:handle_request():146] handle_request: keepalive
162
  2024-03-06 16:04:20,346 DEBUG HandlerThread:249 [handler.py:handle_request():146] handle_request: status_report
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
160
  2024-03-06 16:04:16,345 DEBUG SenderThread:249 [sender.py:send():382] send: stats
161
  2024-03-06 16:04:17,432 DEBUG HandlerThread:249 [handler.py:handle_request():146] handle_request: keepalive
162
  2024-03-06 16:04:20,346 DEBUG HandlerThread:249 [handler.py:handle_request():146] handle_request: status_report
163
+ 2024-03-06 16:04:22,438 DEBUG HandlerThread:249 [handler.py:handle_request():146] handle_request: keepalive
164
+ 2024-03-06 16:04:25,347 DEBUG HandlerThread:249 [handler.py:handle_request():146] handle_request: status_report
165
+ 2024-03-06 16:04:27,443 DEBUG HandlerThread:249 [handler.py:handle_request():146] handle_request: keepalive
166
+ 2024-03-06 16:04:30,348 DEBUG HandlerThread:249 [handler.py:handle_request():146] handle_request: status_report
167
+ 2024-03-06 16:04:32,444 DEBUG HandlerThread:249 [handler.py:handle_request():146] handle_request: keepalive
168
+ 2024-03-06 16:04:35,348 DEBUG HandlerThread:249 [handler.py:handle_request():146] handle_request: status_report
169
+ 2024-03-06 16:04:37,445 DEBUG HandlerThread:249 [handler.py:handle_request():146] handle_request: keepalive
170
+ 2024-03-06 16:04:40,349 DEBUG HandlerThread:249 [handler.py:handle_request():146] handle_request: status_report
171
+ 2024-03-06 16:04:42,452 DEBUG HandlerThread:249 [handler.py:handle_request():146] handle_request: keepalive
172
+ 2024-03-06 16:04:45,350 DEBUG HandlerThread:249 [handler.py:handle_request():146] handle_request: status_report
173
+ 2024-03-06 16:04:46,345 DEBUG SenderThread:249 [sender.py:send():382] send: stats
174
+ 2024-03-06 16:04:47,454 DEBUG HandlerThread:249 [handler.py:handle_request():146] handle_request: keepalive
175
+ 2024-03-06 16:04:51,347 DEBUG HandlerThread:249 [handler.py:handle_request():146] handle_request: status_report
176
+ 2024-03-06 16:04:52,455 DEBUG HandlerThread:249 [handler.py:handle_request():146] handle_request: keepalive
177
+ 2024-03-06 16:04:56,347 DEBUG HandlerThread:249 [handler.py:handle_request():146] handle_request: status_report
178
+ 2024-03-06 16:04:57,462 DEBUG HandlerThread:249 [handler.py:handle_request():146] handle_request: keepalive
179
+ 2024-03-06 16:05:01,348 DEBUG HandlerThread:249 [handler.py:handle_request():146] handle_request: status_report
180
+ 2024-03-06 16:05:02,467 DEBUG HandlerThread:249 [handler.py:handle_request():146] handle_request: keepalive
181
+ 2024-03-06 16:05:06,349 DEBUG HandlerThread:249 [handler.py:handle_request():146] handle_request: status_report
182
+ 2024-03-06 16:05:07,468 DEBUG HandlerThread:249 [handler.py:handle_request():146] handle_request: keepalive
183
+ 2024-03-06 16:05:09,545 DEBUG HandlerThread:249 [handler.py:handle_request():146] handle_request: partial_history
184
+ 2024-03-06 16:05:09,546 DEBUG SenderThread:249 [sender.py:send():382] send: history
185
+ 2024-03-06 16:05:09,547 DEBUG SenderThread:249 [sender.py:send_request():409] send_request: summary_record
186
+ 2024-03-06 16:05:09,549 INFO SenderThread:249 [sender.py:_save_file():1403] saving file wandb-summary.json with policy end
187
+ 2024-03-06 16:05:10,319 INFO Thread-12 :249 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240306_160115-aj5k3nji/files/wandb-summary.json
188
+ 2024-03-06 16:05:11,549 DEBUG HandlerThread:249 [handler.py:handle_request():146] handle_request: status_report
189
+ 2024-03-06 16:05:12,025 DEBUG HandlerThread:249 [handler.py:handle_request():146] handle_request: partial_history
190
+ 2024-03-06 16:05:12,026 DEBUG SenderThread:249 [sender.py:send():382] send: history
191
+ 2024-03-06 16:05:12,026 DEBUG SenderThread:249 [sender.py:send_request():409] send_request: summary_record
192
+ 2024-03-06 16:05:12,027 INFO SenderThread:249 [sender.py:_save_file():1403] saving file wandb-summary.json with policy end
193
+ 2024-03-06 16:05:12,320 INFO Thread-12 :249 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240306_160115-aj5k3nji/files/wandb-summary.json
194
+ 2024-03-06 16:05:12,474 DEBUG HandlerThread:249 [handler.py:handle_request():146] handle_request: keepalive
195
+ 2024-03-06 16:05:13,320 INFO Thread-12 :249 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240306_160115-aj5k3nji/files/output.log
196
+ 2024-03-06 16:05:16,346 DEBUG SenderThread:249 [sender.py:send():382] send: stats
197
+ 2024-03-06 16:05:17,347 DEBUG HandlerThread:249 [handler.py:handle_request():146] handle_request: status_report
198
+ 2024-03-06 16:05:17,512 DEBUG HandlerThread:249 [handler.py:handle_request():146] handle_request: keepalive
199
+ 2024-03-06 16:05:22,348 DEBUG HandlerThread:249 [handler.py:handle_request():146] handle_request: status_report
200
+ 2024-03-06 16:05:22,513 DEBUG HandlerThread:249 [handler.py:handle_request():146] handle_request: keepalive
201
+ 2024-03-06 16:05:27,349 DEBUG HandlerThread:249 [handler.py:handle_request():146] handle_request: status_report
202
+ 2024-03-06 16:05:27,515 DEBUG HandlerThread:249 [handler.py:handle_request():146] handle_request: keepalive
203
+ 2024-03-06 16:05:32,349 DEBUG HandlerThread:249 [handler.py:handle_request():146] handle_request: status_report
204
+ 2024-03-06 16:05:32,516 DEBUG HandlerThread:249 [handler.py:handle_request():146] handle_request: keepalive
wandb/run-20240306_160115-aj5k3nji/files/output.log CHANGED
@@ -1,3 +1,5 @@
 
 
1
  /opt/conda/lib/python3.10/site-packages/sklearn/metrics/_classification.py:1344: UndefinedMetricWarning: Precision is ill-defined and being set to 0.0 in labels with no predicted samples. Use `zero_division` parameter to control this behavior.
2
  _warn_prf(average, modifier, msg_start, len(result))
3
  /opt/conda/lib/python3.10/site-packages/sklearn/metrics/_classification.py:1344: UndefinedMetricWarning: Precision is ill-defined and being set to 0.0 in labels with no predicted samples. Use `zero_division` parameter to control this behavior.
 
1
+ /opt/conda/lib/python3.10/site-packages/sklearn/metrics/_classification.py:1344: UndefinedMetricWarning: Precision is ill-defined and being set to 0.0 in labels with no predicted samples. Use `zero_division` parameter to control this behavior.
2
+ _warn_prf(average, modifier, msg_start, len(result))
3
  /opt/conda/lib/python3.10/site-packages/sklearn/metrics/_classification.py:1344: UndefinedMetricWarning: Precision is ill-defined and being set to 0.0 in labels with no predicted samples. Use `zero_division` parameter to control this behavior.
4
  _warn_prf(average, modifier, msg_start, len(result))
5
  /opt/conda/lib/python3.10/site-packages/sklearn/metrics/_classification.py:1344: UndefinedMetricWarning: Precision is ill-defined and being set to 0.0 in labels with no predicted samples. Use `zero_division` parameter to control this behavior.
wandb/run-20240306_160115-aj5k3nji/files/wandb-summary.json CHANGED
@@ -1 +1 @@
1
- {"train/loss": 1.5534, "train/grad_norm": 12.50491714477539, "train/learning_rate": 1.2057971014492755e-05, "train/epoch": 2.0, "train/global_step": 276, "_timestamp": 1709741041.0833251, "_runtime": 166.0166380405426, "_step": 3, "eval/loss": 1.6335408687591553, "eval/accuracy": 0.43089430894308944, "eval/precision": 0.32032959393500327, "eval/recall": 0.43089430894308944, "eval/f1": 0.3321940158177092, "eval/runtime": 2.4761, "eval/samples_per_second": 49.676, "eval/steps_per_second": 6.462}
 
1
+ {"train/loss": 1.5097, "train/grad_norm": 15.719866752624512, "train/learning_rate": 8.057971014492754e-06, "train/epoch": 3.0, "train/global_step": 414, "_timestamp": 1709741112.0251439, "_runtime": 236.95845675468445, "_step": 5, "eval/loss": 1.6067084074020386, "eval/accuracy": 0.43089430894308944, "eval/precision": 0.30033476805356285, "eval/recall": 0.43089430894308944, "eval/f1": 0.34618010302240426, "eval/runtime": 2.4762, "eval/samples_per_second": 49.673, "eval/steps_per_second": 6.462}
wandb/run-20240306_160115-aj5k3nji/logs/debug-internal.log CHANGED
@@ -160,3 +160,45 @@
160
  2024-03-06 16:04:16,345 DEBUG SenderThread:249 [sender.py:send():382] send: stats
161
  2024-03-06 16:04:17,432 DEBUG HandlerThread:249 [handler.py:handle_request():146] handle_request: keepalive
162
  2024-03-06 16:04:20,346 DEBUG HandlerThread:249 [handler.py:handle_request():146] handle_request: status_report
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
160
  2024-03-06 16:04:16,345 DEBUG SenderThread:249 [sender.py:send():382] send: stats
161
  2024-03-06 16:04:17,432 DEBUG HandlerThread:249 [handler.py:handle_request():146] handle_request: keepalive
162
  2024-03-06 16:04:20,346 DEBUG HandlerThread:249 [handler.py:handle_request():146] handle_request: status_report
163
+ 2024-03-06 16:04:22,438 DEBUG HandlerThread:249 [handler.py:handle_request():146] handle_request: keepalive
164
+ 2024-03-06 16:04:25,347 DEBUG HandlerThread:249 [handler.py:handle_request():146] handle_request: status_report
165
+ 2024-03-06 16:04:27,443 DEBUG HandlerThread:249 [handler.py:handle_request():146] handle_request: keepalive
166
+ 2024-03-06 16:04:30,348 DEBUG HandlerThread:249 [handler.py:handle_request():146] handle_request: status_report
167
+ 2024-03-06 16:04:32,444 DEBUG HandlerThread:249 [handler.py:handle_request():146] handle_request: keepalive
168
+ 2024-03-06 16:04:35,348 DEBUG HandlerThread:249 [handler.py:handle_request():146] handle_request: status_report
169
+ 2024-03-06 16:04:37,445 DEBUG HandlerThread:249 [handler.py:handle_request():146] handle_request: keepalive
170
+ 2024-03-06 16:04:40,349 DEBUG HandlerThread:249 [handler.py:handle_request():146] handle_request: status_report
171
+ 2024-03-06 16:04:42,452 DEBUG HandlerThread:249 [handler.py:handle_request():146] handle_request: keepalive
172
+ 2024-03-06 16:04:45,350 DEBUG HandlerThread:249 [handler.py:handle_request():146] handle_request: status_report
173
+ 2024-03-06 16:04:46,345 DEBUG SenderThread:249 [sender.py:send():382] send: stats
174
+ 2024-03-06 16:04:47,454 DEBUG HandlerThread:249 [handler.py:handle_request():146] handle_request: keepalive
175
+ 2024-03-06 16:04:51,347 DEBUG HandlerThread:249 [handler.py:handle_request():146] handle_request: status_report
176
+ 2024-03-06 16:04:52,455 DEBUG HandlerThread:249 [handler.py:handle_request():146] handle_request: keepalive
177
+ 2024-03-06 16:04:56,347 DEBUG HandlerThread:249 [handler.py:handle_request():146] handle_request: status_report
178
+ 2024-03-06 16:04:57,462 DEBUG HandlerThread:249 [handler.py:handle_request():146] handle_request: keepalive
179
+ 2024-03-06 16:05:01,348 DEBUG HandlerThread:249 [handler.py:handle_request():146] handle_request: status_report
180
+ 2024-03-06 16:05:02,467 DEBUG HandlerThread:249 [handler.py:handle_request():146] handle_request: keepalive
181
+ 2024-03-06 16:05:06,349 DEBUG HandlerThread:249 [handler.py:handle_request():146] handle_request: status_report
182
+ 2024-03-06 16:05:07,468 DEBUG HandlerThread:249 [handler.py:handle_request():146] handle_request: keepalive
183
+ 2024-03-06 16:05:09,545 DEBUG HandlerThread:249 [handler.py:handle_request():146] handle_request: partial_history
184
+ 2024-03-06 16:05:09,546 DEBUG SenderThread:249 [sender.py:send():382] send: history
185
+ 2024-03-06 16:05:09,547 DEBUG SenderThread:249 [sender.py:send_request():409] send_request: summary_record
186
+ 2024-03-06 16:05:09,549 INFO SenderThread:249 [sender.py:_save_file():1403] saving file wandb-summary.json with policy end
187
+ 2024-03-06 16:05:10,319 INFO Thread-12 :249 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240306_160115-aj5k3nji/files/wandb-summary.json
188
+ 2024-03-06 16:05:11,549 DEBUG HandlerThread:249 [handler.py:handle_request():146] handle_request: status_report
189
+ 2024-03-06 16:05:12,025 DEBUG HandlerThread:249 [handler.py:handle_request():146] handle_request: partial_history
190
+ 2024-03-06 16:05:12,026 DEBUG SenderThread:249 [sender.py:send():382] send: history
191
+ 2024-03-06 16:05:12,026 DEBUG SenderThread:249 [sender.py:send_request():409] send_request: summary_record
192
+ 2024-03-06 16:05:12,027 INFO SenderThread:249 [sender.py:_save_file():1403] saving file wandb-summary.json with policy end
193
+ 2024-03-06 16:05:12,320 INFO Thread-12 :249 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240306_160115-aj5k3nji/files/wandb-summary.json
194
+ 2024-03-06 16:05:12,474 DEBUG HandlerThread:249 [handler.py:handle_request():146] handle_request: keepalive
195
+ 2024-03-06 16:05:13,320 INFO Thread-12 :249 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240306_160115-aj5k3nji/files/output.log
196
+ 2024-03-06 16:05:16,346 DEBUG SenderThread:249 [sender.py:send():382] send: stats
197
+ 2024-03-06 16:05:17,347 DEBUG HandlerThread:249 [handler.py:handle_request():146] handle_request: status_report
198
+ 2024-03-06 16:05:17,512 DEBUG HandlerThread:249 [handler.py:handle_request():146] handle_request: keepalive
199
+ 2024-03-06 16:05:22,348 DEBUG HandlerThread:249 [handler.py:handle_request():146] handle_request: status_report
200
+ 2024-03-06 16:05:22,513 DEBUG HandlerThread:249 [handler.py:handle_request():146] handle_request: keepalive
201
+ 2024-03-06 16:05:27,349 DEBUG HandlerThread:249 [handler.py:handle_request():146] handle_request: status_report
202
+ 2024-03-06 16:05:27,515 DEBUG HandlerThread:249 [handler.py:handle_request():146] handle_request: keepalive
203
+ 2024-03-06 16:05:32,349 DEBUG HandlerThread:249 [handler.py:handle_request():146] handle_request: status_report
204
+ 2024-03-06 16:05:32,516 DEBUG HandlerThread:249 [handler.py:handle_request():146] handle_request: keepalive
wandb/run-20240306_160115-aj5k3nji/run-aj5k3nji.wandb CHANGED
Binary files a/wandb/run-20240306_160115-aj5k3nji/run-aj5k3nji.wandb and b/wandb/run-20240306_160115-aj5k3nji/run-aj5k3nji.wandb differ