Training in progress, step 350
Browse files
model.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 485755120
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:44334c3e2c3b6cdba14ded0fc48ce28517c85303fda85e6a79f00274a2dcd706
|
| 3 |
size 485755120
|
wandb/debug-internal.log
CHANGED
|
@@ -361,3 +361,49 @@ subprocess.TimeoutExpired: Command '['conda', 'env', 'export']' timed out after
|
|
| 361 |
2024-06-02 21:35:16,686 INFO Thread-12 :82 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240602_212342-ypv2rcj7/files/output.log
|
| 362 |
2024-06-02 21:35:18,047 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 363 |
2024-06-02 21:35:23,048 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 361 |
2024-06-02 21:35:16,686 INFO Thread-12 :82 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240602_212342-ypv2rcj7/files/output.log
|
| 362 |
2024-06-02 21:35:18,047 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 363 |
2024-06-02 21:35:23,048 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 364 |
+
2024-06-02 21:35:28,049 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 365 |
+
2024-06-02 21:35:29,881 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: internal_messages
|
| 366 |
+
2024-06-02 21:35:29,931 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: stop_status
|
| 367 |
+
2024-06-02 21:35:29,932 DEBUG SenderThread:82 [sender.py:send_request():406] send_request: stop_status
|
| 368 |
+
2024-06-02 21:35:33,053 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 369 |
+
2024-06-02 21:35:38,055 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 370 |
+
2024-06-02 21:35:43,055 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 371 |
+
2024-06-02 21:35:43,540 DEBUG SenderThread:82 [sender.py:send():379] send: stats
|
| 372 |
+
2024-06-02 21:35:44,879 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: internal_messages
|
| 373 |
+
2024-06-02 21:35:44,932 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: stop_status
|
| 374 |
+
2024-06-02 21:35:44,932 DEBUG SenderThread:82 [sender.py:send_request():406] send_request: stop_status
|
| 375 |
+
2024-06-02 21:35:48,999 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 376 |
+
2024-06-02 21:35:54,000 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 377 |
+
2024-06-02 21:35:59,001 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 378 |
+
2024-06-02 21:35:59,880 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: internal_messages
|
| 379 |
+
2024-06-02 21:35:59,932 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: stop_status
|
| 380 |
+
2024-06-02 21:35:59,932 DEBUG SenderThread:82 [sender.py:send_request():406] send_request: stop_status
|
| 381 |
+
2024-06-02 21:36:04,064 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 382 |
+
2024-06-02 21:36:09,065 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 383 |
+
2024-06-02 21:36:13,541 DEBUG SenderThread:82 [sender.py:send():379] send: stats
|
| 384 |
+
2024-06-02 21:36:14,543 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 385 |
+
2024-06-02 21:36:14,880 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: internal_messages
|
| 386 |
+
2024-06-02 21:36:14,932 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: stop_status
|
| 387 |
+
2024-06-02 21:36:14,932 DEBUG SenderThread:82 [sender.py:send_request():406] send_request: stop_status
|
| 388 |
+
2024-06-02 21:36:20,013 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 389 |
+
2024-06-02 21:36:25,014 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 390 |
+
2024-06-02 21:36:29,880 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: internal_messages
|
| 391 |
+
2024-06-02 21:36:29,932 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: stop_status
|
| 392 |
+
2024-06-02 21:36:29,933 DEBUG SenderThread:82 [sender.py:send_request():406] send_request: stop_status
|
| 393 |
+
2024-06-02 21:36:30,041 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 394 |
+
2024-06-02 21:36:35,041 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 395 |
+
2024-06-02 21:36:40,042 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 396 |
+
2024-06-02 21:36:43,542 DEBUG SenderThread:82 [sender.py:send():379] send: stats
|
| 397 |
+
2024-06-02 21:36:44,880 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: internal_messages
|
| 398 |
+
2024-06-02 21:36:44,932 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: stop_status
|
| 399 |
+
2024-06-02 21:36:44,932 DEBUG SenderThread:82 [sender.py:send_request():406] send_request: stop_status
|
| 400 |
+
2024-06-02 21:36:45,957 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 401 |
+
2024-06-02 21:36:50,958 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 402 |
+
2024-06-02 21:36:55,959 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 403 |
+
2024-06-02 21:37:00,186 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: stop_status
|
| 404 |
+
2024-06-02 21:37:00,186 DEBUG SenderThread:82 [sender.py:send_request():406] send_request: stop_status
|
| 405 |
+
2024-06-02 21:37:00,226 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: internal_messages
|
| 406 |
+
2024-06-02 21:37:01,311 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 407 |
+
2024-06-02 21:37:05,726 INFO Thread-12 :82 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240602_212342-ypv2rcj7/files/output.log
|
| 408 |
+
2024-06-02 21:37:06,713 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 409 |
+
2024-06-02 21:37:11,714 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
wandb/run-20240602_212342-ypv2rcj7/files/output.log
CHANGED
|
@@ -12,4 +12,6 @@
|
|
| 12 |
warnings.warn('Was asked to gather along dimension 0, but all '
|
| 13 |
/opt/conda/lib/python3.10/site-packages/torch/nn/parallel/_functions.py:68: UserWarning: Was asked to gather along dimension 0, but all input tensors were scalars; will instead unsqueeze and return a vector.
|
| 14 |
warnings.warn('Was asked to gather along dimension 0, but all '
|
|
|
|
|
|
|
| 15 |
/opt/conda/lib/python3.10/site-packages/torch/nn/parallel/_functions.py:68: UserWarning: Was asked to gather along dimension 0, but all input tensors were scalars; will instead unsqueeze and return a vector.
|
|
|
|
| 12 |
warnings.warn('Was asked to gather along dimension 0, but all '
|
| 13 |
/opt/conda/lib/python3.10/site-packages/torch/nn/parallel/_functions.py:68: UserWarning: Was asked to gather along dimension 0, but all input tensors were scalars; will instead unsqueeze and return a vector.
|
| 14 |
warnings.warn('Was asked to gather along dimension 0, but all '
|
| 15 |
+
/opt/conda/lib/python3.10/site-packages/torch/nn/parallel/_functions.py:68: UserWarning: Was asked to gather along dimension 0, but all input tensors were scalars; will instead unsqueeze and return a vector.
|
| 16 |
+
warnings.warn('Was asked to gather along dimension 0, but all '
|
| 17 |
/opt/conda/lib/python3.10/site-packages/torch/nn/parallel/_functions.py:68: UserWarning: Was asked to gather along dimension 0, but all input tensors were scalars; will instead unsqueeze and return a vector.
|
wandb/run-20240602_212342-ypv2rcj7/logs/debug-internal.log
CHANGED
|
@@ -361,3 +361,49 @@ subprocess.TimeoutExpired: Command '['conda', 'env', 'export']' timed out after
|
|
| 361 |
2024-06-02 21:35:16,686 INFO Thread-12 :82 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240602_212342-ypv2rcj7/files/output.log
|
| 362 |
2024-06-02 21:35:18,047 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 363 |
2024-06-02 21:35:23,048 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 361 |
2024-06-02 21:35:16,686 INFO Thread-12 :82 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240602_212342-ypv2rcj7/files/output.log
|
| 362 |
2024-06-02 21:35:18,047 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 363 |
2024-06-02 21:35:23,048 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 364 |
+
2024-06-02 21:35:28,049 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 365 |
+
2024-06-02 21:35:29,881 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: internal_messages
|
| 366 |
+
2024-06-02 21:35:29,931 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: stop_status
|
| 367 |
+
2024-06-02 21:35:29,932 DEBUG SenderThread:82 [sender.py:send_request():406] send_request: stop_status
|
| 368 |
+
2024-06-02 21:35:33,053 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 369 |
+
2024-06-02 21:35:38,055 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 370 |
+
2024-06-02 21:35:43,055 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 371 |
+
2024-06-02 21:35:43,540 DEBUG SenderThread:82 [sender.py:send():379] send: stats
|
| 372 |
+
2024-06-02 21:35:44,879 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: internal_messages
|
| 373 |
+
2024-06-02 21:35:44,932 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: stop_status
|
| 374 |
+
2024-06-02 21:35:44,932 DEBUG SenderThread:82 [sender.py:send_request():406] send_request: stop_status
|
| 375 |
+
2024-06-02 21:35:48,999 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 376 |
+
2024-06-02 21:35:54,000 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 377 |
+
2024-06-02 21:35:59,001 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 378 |
+
2024-06-02 21:35:59,880 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: internal_messages
|
| 379 |
+
2024-06-02 21:35:59,932 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: stop_status
|
| 380 |
+
2024-06-02 21:35:59,932 DEBUG SenderThread:82 [sender.py:send_request():406] send_request: stop_status
|
| 381 |
+
2024-06-02 21:36:04,064 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 382 |
+
2024-06-02 21:36:09,065 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 383 |
+
2024-06-02 21:36:13,541 DEBUG SenderThread:82 [sender.py:send():379] send: stats
|
| 384 |
+
2024-06-02 21:36:14,543 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 385 |
+
2024-06-02 21:36:14,880 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: internal_messages
|
| 386 |
+
2024-06-02 21:36:14,932 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: stop_status
|
| 387 |
+
2024-06-02 21:36:14,932 DEBUG SenderThread:82 [sender.py:send_request():406] send_request: stop_status
|
| 388 |
+
2024-06-02 21:36:20,013 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 389 |
+
2024-06-02 21:36:25,014 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 390 |
+
2024-06-02 21:36:29,880 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: internal_messages
|
| 391 |
+
2024-06-02 21:36:29,932 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: stop_status
|
| 392 |
+
2024-06-02 21:36:29,933 DEBUG SenderThread:82 [sender.py:send_request():406] send_request: stop_status
|
| 393 |
+
2024-06-02 21:36:30,041 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 394 |
+
2024-06-02 21:36:35,041 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 395 |
+
2024-06-02 21:36:40,042 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 396 |
+
2024-06-02 21:36:43,542 DEBUG SenderThread:82 [sender.py:send():379] send: stats
|
| 397 |
+
2024-06-02 21:36:44,880 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: internal_messages
|
| 398 |
+
2024-06-02 21:36:44,932 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: stop_status
|
| 399 |
+
2024-06-02 21:36:44,932 DEBUG SenderThread:82 [sender.py:send_request():406] send_request: stop_status
|
| 400 |
+
2024-06-02 21:36:45,957 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 401 |
+
2024-06-02 21:36:50,958 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 402 |
+
2024-06-02 21:36:55,959 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 403 |
+
2024-06-02 21:37:00,186 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: stop_status
|
| 404 |
+
2024-06-02 21:37:00,186 DEBUG SenderThread:82 [sender.py:send_request():406] send_request: stop_status
|
| 405 |
+
2024-06-02 21:37:00,226 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: internal_messages
|
| 406 |
+
2024-06-02 21:37:01,311 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 407 |
+
2024-06-02 21:37:05,726 INFO Thread-12 :82 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240602_212342-ypv2rcj7/files/output.log
|
| 408 |
+
2024-06-02 21:37:06,713 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 409 |
+
2024-06-02 21:37:11,714 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
wandb/run-20240602_212342-ypv2rcj7/run-ypv2rcj7.wandb
CHANGED
|
Binary files a/wandb/run-20240602_212342-ypv2rcj7/run-ypv2rcj7.wandb and b/wandb/run-20240602_212342-ypv2rcj7/run-ypv2rcj7.wandb differ
|
|
|