nornor02 commited on
Commit
a0382db
·
verified ·
1 Parent(s): c1a89e6

Training in progress, step 2000

Browse files
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ee32357e79d3b677aa66452e0e0d7eb519c263fc834d49316f16c67a1abce823
3
  size 328693404
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ac1cdac2e21cfd15331b65db6a34aafcc29bc6185d99b922e7fb88036058a87b
3
  size 328693404
runs/Jan18_17-18-07_bddbbc3e305c/events.out.tfevents.1705598291.bddbbc3e305c.76.0 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:01f4f562290015d907639a1c10370dea005bb133acf88a2a3b9a645232d90125
3
- size 9455
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2751f5b1264cc591906f034775ab1155ac493382454aa24d7b29d7781e7b38c9
3
+ size 9612
wandb/debug-internal.log CHANGED
@@ -305,3 +305,48 @@
305
  2024-01-18 17:26:18,566 INFO Thread-12 :127 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240118_171829-uvan9htf/files/output.log
306
  2024-01-18 17:26:22,115 DEBUG HandlerThread:127 [handler.py:handle_request():146] handle_request: keepalive
307
  2024-01-18 17:26:22,880 DEBUG HandlerThread:127 [handler.py:handle_request():146] handle_request: status_report
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
305
  2024-01-18 17:26:18,566 INFO Thread-12 :127 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240118_171829-uvan9htf/files/output.log
306
  2024-01-18 17:26:22,115 DEBUG HandlerThread:127 [handler.py:handle_request():146] handle_request: keepalive
307
  2024-01-18 17:26:22,880 DEBUG HandlerThread:127 [handler.py:handle_request():146] handle_request: status_report
308
+ 2024-01-18 17:26:27,116 DEBUG HandlerThread:127 [handler.py:handle_request():146] handle_request: keepalive
309
+ 2024-01-18 17:26:27,881 DEBUG HandlerThread:127 [handler.py:handle_request():146] handle_request: status_report
310
+ 2024-01-18 17:26:32,117 DEBUG HandlerThread:127 [handler.py:handle_request():146] handle_request: keepalive
311
+ 2024-01-18 17:26:32,882 DEBUG HandlerThread:127 [handler.py:handle_request():146] handle_request: status_report
312
+ 2024-01-18 17:26:35,038 DEBUG SenderThread:127 [sender.py:send():382] send: stats
313
+ 2024-01-18 17:26:37,119 DEBUG HandlerThread:127 [handler.py:handle_request():146] handle_request: keepalive
314
+ 2024-01-18 17:26:38,039 DEBUG HandlerThread:127 [handler.py:handle_request():146] handle_request: status_report
315
+ 2024-01-18 17:26:42,120 DEBUG HandlerThread:127 [handler.py:handle_request():146] handle_request: keepalive
316
+ 2024-01-18 17:26:43,040 DEBUG HandlerThread:127 [handler.py:handle_request():146] handle_request: status_report
317
+ 2024-01-18 17:26:47,128 DEBUG HandlerThread:127 [handler.py:handle_request():146] handle_request: keepalive
318
+ 2024-01-18 17:26:48,041 DEBUG HandlerThread:127 [handler.py:handle_request():146] handle_request: status_report
319
+ 2024-01-18 17:26:52,130 DEBUG HandlerThread:127 [handler.py:handle_request():146] handle_request: keepalive
320
+ 2024-01-18 17:26:53,042 DEBUG HandlerThread:127 [handler.py:handle_request():146] handle_request: status_report
321
+ 2024-01-18 17:26:57,133 DEBUG HandlerThread:127 [handler.py:handle_request():146] handle_request: keepalive
322
+ 2024-01-18 17:26:58,043 DEBUG HandlerThread:127 [handler.py:handle_request():146] handle_request: status_report
323
+ 2024-01-18 17:27:02,136 DEBUG HandlerThread:127 [handler.py:handle_request():146] handle_request: keepalive
324
+ 2024-01-18 17:27:03,043 DEBUG HandlerThread:127 [handler.py:handle_request():146] handle_request: status_report
325
+ 2024-01-18 17:27:05,040 DEBUG SenderThread:127 [sender.py:send():382] send: stats
326
+ 2024-01-18 17:27:07,136 DEBUG HandlerThread:127 [handler.py:handle_request():146] handle_request: keepalive
327
+ 2024-01-18 17:27:09,041 DEBUG HandlerThread:127 [handler.py:handle_request():146] handle_request: status_report
328
+ 2024-01-18 17:27:12,137 DEBUG HandlerThread:127 [handler.py:handle_request():146] handle_request: keepalive
329
+ 2024-01-18 17:27:14,042 DEBUG HandlerThread:127 [handler.py:handle_request():146] handle_request: status_report
330
+ 2024-01-18 17:27:17,139 DEBUG HandlerThread:127 [handler.py:handle_request():146] handle_request: keepalive
331
+ 2024-01-18 17:27:19,043 DEBUG HandlerThread:127 [handler.py:handle_request():146] handle_request: status_report
332
+ 2024-01-18 17:27:22,140 DEBUG HandlerThread:127 [handler.py:handle_request():146] handle_request: keepalive
333
+ 2024-01-18 17:27:24,044 DEBUG HandlerThread:127 [handler.py:handle_request():146] handle_request: status_report
334
+ 2024-01-18 17:27:27,140 DEBUG HandlerThread:127 [handler.py:handle_request():146] handle_request: keepalive
335
+ 2024-01-18 17:27:29,045 DEBUG HandlerThread:127 [handler.py:handle_request():146] handle_request: status_report
336
+ 2024-01-18 17:27:32,146 DEBUG HandlerThread:127 [handler.py:handle_request():146] handle_request: keepalive
337
+ 2024-01-18 17:27:34,045 DEBUG HandlerThread:127 [handler.py:handle_request():146] handle_request: status_report
338
+ 2024-01-18 17:27:35,041 DEBUG SenderThread:127 [sender.py:send():382] send: stats
339
+ 2024-01-18 17:27:37,148 DEBUG HandlerThread:127 [handler.py:handle_request():146] handle_request: keepalive
340
+ 2024-01-18 17:27:37,915 DEBUG HandlerThread:127 [handler.py:handle_request():146] handle_request: partial_history
341
+ 2024-01-18 17:27:37,916 DEBUG SenderThread:127 [sender.py:send():382] send: history
342
+ 2024-01-18 17:27:37,917 DEBUG SenderThread:127 [sender.py:send_request():409] send_request: summary_record
343
+ 2024-01-18 17:27:37,917 INFO SenderThread:127 [sender.py:_save_file():1403] saving file wandb-summary.json with policy end
344
+ 2024-01-18 17:27:38,594 INFO Thread-12 :127 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240118_171829-uvan9htf/files/wandb-summary.json
345
+ 2024-01-18 17:27:39,918 DEBUG HandlerThread:127 [handler.py:handle_request():146] handle_request: status_report
346
+ 2024-01-18 17:27:40,595 INFO Thread-12 :127 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240118_171829-uvan9htf/files/output.log
347
+ 2024-01-18 17:27:42,326 DEBUG HandlerThread:127 [handler.py:handle_request():146] handle_request: keepalive
348
+ 2024-01-18 17:27:45,101 DEBUG HandlerThread:127 [handler.py:handle_request():146] handle_request: status_report
349
+ 2024-01-18 17:27:47,327 DEBUG HandlerThread:127 [handler.py:handle_request():146] handle_request: keepalive
350
+ 2024-01-18 17:27:50,102 DEBUG HandlerThread:127 [handler.py:handle_request():146] handle_request: status_report
351
+ 2024-01-18 17:27:52,328 DEBUG HandlerThread:127 [handler.py:handle_request():146] handle_request: keepalive
352
+ 2024-01-18 17:27:55,102 DEBUG HandlerThread:127 [handler.py:handle_request():146] handle_request: status_report
wandb/run-20240118_171829-uvan9htf/files/output.log CHANGED
@@ -9,6 +9,8 @@ Checkpoint destination directory /kaggle/working/checkpoint-500 already exists a
9
  /opt/conda/lib/python3.10/site-packages/torch/nn/parallel/_functions.py:68: UserWarning: Was asked to gather along dimension 0, but all input tensors were scalars; will instead unsqueeze and return a vector.
10
  warnings.warn('Was asked to gather along dimension 0, but all '
11
  Checkpoint destination directory /kaggle/working/checkpoint-1000 already exists and is non-empty.Saving will proceed but saved results may be invalid.
 
 
12
  /opt/conda/lib/python3.10/site-packages/torch/nn/parallel/_functions.py:68: UserWarning: Was asked to gather along dimension 0, but all input tensors were scalars; will instead unsqueeze and return a vector.
13
  warnings.warn('Was asked to gather along dimension 0, but all '
14
  /opt/conda/lib/python3.10/site-packages/torch/nn/parallel/_functions.py:68: UserWarning: Was asked to gather along dimension 0, but all input tensors were scalars; will instead unsqueeze and return a vector.
 
9
  /opt/conda/lib/python3.10/site-packages/torch/nn/parallel/_functions.py:68: UserWarning: Was asked to gather along dimension 0, but all input tensors were scalars; will instead unsqueeze and return a vector.
10
  warnings.warn('Was asked to gather along dimension 0, but all '
11
  Checkpoint destination directory /kaggle/working/checkpoint-1000 already exists and is non-empty.Saving will proceed but saved results may be invalid.
12
+ /opt/conda/lib/python3.10/site-packages/torch/nn/parallel/_functions.py:68: UserWarning: Was asked to gather along dimension 0, but all input tensors were scalars; will instead unsqueeze and return a vector.
13
+ warnings.warn('Was asked to gather along dimension 0, but all '
14
  /opt/conda/lib/python3.10/site-packages/torch/nn/parallel/_functions.py:68: UserWarning: Was asked to gather along dimension 0, but all input tensors were scalars; will instead unsqueeze and return a vector.
15
  warnings.warn('Was asked to gather along dimension 0, but all '
16
  /opt/conda/lib/python3.10/site-packages/torch/nn/parallel/_functions.py:68: UserWarning: Was asked to gather along dimension 0, but all input tensors were scalars; will instead unsqueeze and return a vector.
wandb/run-20240118_171829-uvan9htf/files/wandb-summary.json CHANGED
@@ -1 +1 @@
1
- {"train/loss": 0.8873, "train/learning_rate": 8.461538461538462e-06, "train/epoch": 115.38, "train/global_step": 1500, "_timestamp": 1705598774.695556, "_runtime": 465.36068201065063, "_step": 4}
 
1
+ {"train/loss": 0.706, "train/learning_rate": 4.615384615384616e-06, "train/epoch": 153.85, "train/global_step": 2000, "_timestamp": 1705598857.9153664, "_runtime": 548.5804924964905, "_step": 5}
wandb/run-20240118_171829-uvan9htf/logs/debug-internal.log CHANGED
@@ -305,3 +305,48 @@
305
  2024-01-18 17:26:18,566 INFO Thread-12 :127 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240118_171829-uvan9htf/files/output.log
306
  2024-01-18 17:26:22,115 DEBUG HandlerThread:127 [handler.py:handle_request():146] handle_request: keepalive
307
  2024-01-18 17:26:22,880 DEBUG HandlerThread:127 [handler.py:handle_request():146] handle_request: status_report
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
305
  2024-01-18 17:26:18,566 INFO Thread-12 :127 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240118_171829-uvan9htf/files/output.log
306
  2024-01-18 17:26:22,115 DEBUG HandlerThread:127 [handler.py:handle_request():146] handle_request: keepalive
307
  2024-01-18 17:26:22,880 DEBUG HandlerThread:127 [handler.py:handle_request():146] handle_request: status_report
308
+ 2024-01-18 17:26:27,116 DEBUG HandlerThread:127 [handler.py:handle_request():146] handle_request: keepalive
309
+ 2024-01-18 17:26:27,881 DEBUG HandlerThread:127 [handler.py:handle_request():146] handle_request: status_report
310
+ 2024-01-18 17:26:32,117 DEBUG HandlerThread:127 [handler.py:handle_request():146] handle_request: keepalive
311
+ 2024-01-18 17:26:32,882 DEBUG HandlerThread:127 [handler.py:handle_request():146] handle_request: status_report
312
+ 2024-01-18 17:26:35,038 DEBUG SenderThread:127 [sender.py:send():382] send: stats
313
+ 2024-01-18 17:26:37,119 DEBUG HandlerThread:127 [handler.py:handle_request():146] handle_request: keepalive
314
+ 2024-01-18 17:26:38,039 DEBUG HandlerThread:127 [handler.py:handle_request():146] handle_request: status_report
315
+ 2024-01-18 17:26:42,120 DEBUG HandlerThread:127 [handler.py:handle_request():146] handle_request: keepalive
316
+ 2024-01-18 17:26:43,040 DEBUG HandlerThread:127 [handler.py:handle_request():146] handle_request: status_report
317
+ 2024-01-18 17:26:47,128 DEBUG HandlerThread:127 [handler.py:handle_request():146] handle_request: keepalive
318
+ 2024-01-18 17:26:48,041 DEBUG HandlerThread:127 [handler.py:handle_request():146] handle_request: status_report
319
+ 2024-01-18 17:26:52,130 DEBUG HandlerThread:127 [handler.py:handle_request():146] handle_request: keepalive
320
+ 2024-01-18 17:26:53,042 DEBUG HandlerThread:127 [handler.py:handle_request():146] handle_request: status_report
321
+ 2024-01-18 17:26:57,133 DEBUG HandlerThread:127 [handler.py:handle_request():146] handle_request: keepalive
322
+ 2024-01-18 17:26:58,043 DEBUG HandlerThread:127 [handler.py:handle_request():146] handle_request: status_report
323
+ 2024-01-18 17:27:02,136 DEBUG HandlerThread:127 [handler.py:handle_request():146] handle_request: keepalive
324
+ 2024-01-18 17:27:03,043 DEBUG HandlerThread:127 [handler.py:handle_request():146] handle_request: status_report
325
+ 2024-01-18 17:27:05,040 DEBUG SenderThread:127 [sender.py:send():382] send: stats
326
+ 2024-01-18 17:27:07,136 DEBUG HandlerThread:127 [handler.py:handle_request():146] handle_request: keepalive
327
+ 2024-01-18 17:27:09,041 DEBUG HandlerThread:127 [handler.py:handle_request():146] handle_request: status_report
328
+ 2024-01-18 17:27:12,137 DEBUG HandlerThread:127 [handler.py:handle_request():146] handle_request: keepalive
329
+ 2024-01-18 17:27:14,042 DEBUG HandlerThread:127 [handler.py:handle_request():146] handle_request: status_report
330
+ 2024-01-18 17:27:17,139 DEBUG HandlerThread:127 [handler.py:handle_request():146] handle_request: keepalive
331
+ 2024-01-18 17:27:19,043 DEBUG HandlerThread:127 [handler.py:handle_request():146] handle_request: status_report
332
+ 2024-01-18 17:27:22,140 DEBUG HandlerThread:127 [handler.py:handle_request():146] handle_request: keepalive
333
+ 2024-01-18 17:27:24,044 DEBUG HandlerThread:127 [handler.py:handle_request():146] handle_request: status_report
334
+ 2024-01-18 17:27:27,140 DEBUG HandlerThread:127 [handler.py:handle_request():146] handle_request: keepalive
335
+ 2024-01-18 17:27:29,045 DEBUG HandlerThread:127 [handler.py:handle_request():146] handle_request: status_report
336
+ 2024-01-18 17:27:32,146 DEBUG HandlerThread:127 [handler.py:handle_request():146] handle_request: keepalive
337
+ 2024-01-18 17:27:34,045 DEBUG HandlerThread:127 [handler.py:handle_request():146] handle_request: status_report
338
+ 2024-01-18 17:27:35,041 DEBUG SenderThread:127 [sender.py:send():382] send: stats
339
+ 2024-01-18 17:27:37,148 DEBUG HandlerThread:127 [handler.py:handle_request():146] handle_request: keepalive
340
+ 2024-01-18 17:27:37,915 DEBUG HandlerThread:127 [handler.py:handle_request():146] handle_request: partial_history
341
+ 2024-01-18 17:27:37,916 DEBUG SenderThread:127 [sender.py:send():382] send: history
342
+ 2024-01-18 17:27:37,917 DEBUG SenderThread:127 [sender.py:send_request():409] send_request: summary_record
343
+ 2024-01-18 17:27:37,917 INFO SenderThread:127 [sender.py:_save_file():1403] saving file wandb-summary.json with policy end
344
+ 2024-01-18 17:27:38,594 INFO Thread-12 :127 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240118_171829-uvan9htf/files/wandb-summary.json
345
+ 2024-01-18 17:27:39,918 DEBUG HandlerThread:127 [handler.py:handle_request():146] handle_request: status_report
346
+ 2024-01-18 17:27:40,595 INFO Thread-12 :127 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240118_171829-uvan9htf/files/output.log
347
+ 2024-01-18 17:27:42,326 DEBUG HandlerThread:127 [handler.py:handle_request():146] handle_request: keepalive
348
+ 2024-01-18 17:27:45,101 DEBUG HandlerThread:127 [handler.py:handle_request():146] handle_request: status_report
349
+ 2024-01-18 17:27:47,327 DEBUG HandlerThread:127 [handler.py:handle_request():146] handle_request: keepalive
350
+ 2024-01-18 17:27:50,102 DEBUG HandlerThread:127 [handler.py:handle_request():146] handle_request: status_report
351
+ 2024-01-18 17:27:52,328 DEBUG HandlerThread:127 [handler.py:handle_request():146] handle_request: keepalive
352
+ 2024-01-18 17:27:55,102 DEBUG HandlerThread:127 [handler.py:handle_request():146] handle_request: status_report
wandb/run-20240118_171829-uvan9htf/run-uvan9htf.wandb CHANGED
Binary files a/wandb/run-20240118_171829-uvan9htf/run-uvan9htf.wandb and b/wandb/run-20240118_171829-uvan9htf/run-uvan9htf.wandb differ