Training in progress, step 1600
Browse files
model.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 485755120
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:4627f2a3e70c5a77e2c04f0ea5d9b2e06973ab627ca6923e5da2f158af28f7e7
|
| 3 |
size 485755120
|
wandb/debug-internal.log
CHANGED
|
@@ -1509,3 +1509,47 @@ subprocess.TimeoutExpired: Command '['conda', 'env', 'export']' timed out after
|
|
| 1509 |
2024-06-02 22:18:36,050 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 1510 |
2024-06-02 22:18:41,051 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 1511 |
2024-06-02 22:18:43,628 DEBUG SenderThread:82 [sender.py:send():379] send: stats
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1509 |
2024-06-02 22:18:36,050 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 1510 |
2024-06-02 22:18:41,051 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 1511 |
2024-06-02 22:18:43,628 DEBUG SenderThread:82 [sender.py:send():379] send: stats
|
| 1512 |
+
2024-06-02 22:18:44,972 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: internal_messages
|
| 1513 |
+
2024-06-02 22:18:45,652 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: stop_status
|
| 1514 |
+
2024-06-02 22:18:45,652 DEBUG SenderThread:82 [sender.py:send_request():406] send_request: stop_status
|
| 1515 |
+
2024-06-02 22:18:46,753 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 1516 |
+
2024-06-02 22:18:51,755 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 1517 |
+
2024-06-02 22:18:56,756 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 1518 |
+
2024-06-02 22:18:59,972 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: internal_messages
|
| 1519 |
+
2024-06-02 22:19:00,652 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: stop_status
|
| 1520 |
+
2024-06-02 22:19:00,653 DEBUG SenderThread:82 [sender.py:send_request():406] send_request: stop_status
|
| 1521 |
+
2024-06-02 22:19:01,785 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 1522 |
+
2024-06-02 22:19:06,786 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 1523 |
+
2024-06-02 22:19:11,787 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 1524 |
+
2024-06-02 22:19:13,629 DEBUG SenderThread:82 [sender.py:send():379] send: stats
|
| 1525 |
+
2024-06-02 22:19:14,972 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: internal_messages
|
| 1526 |
+
2024-06-02 22:19:15,652 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: stop_status
|
| 1527 |
+
2024-06-02 22:19:15,653 DEBUG SenderThread:82 [sender.py:send_request():406] send_request: stop_status
|
| 1528 |
+
2024-06-02 22:19:17,693 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 1529 |
+
2024-06-02 22:19:22,694 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 1530 |
+
2024-06-02 22:19:27,695 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 1531 |
+
2024-06-02 22:19:29,973 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: internal_messages
|
| 1532 |
+
2024-06-02 22:19:30,652 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: stop_status
|
| 1533 |
+
2024-06-02 22:19:30,653 DEBUG SenderThread:82 [sender.py:send_request():406] send_request: stop_status
|
| 1534 |
+
2024-06-02 22:19:32,731 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 1535 |
+
2024-06-02 22:19:37,732 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 1536 |
+
2024-06-02 22:19:42,733 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 1537 |
+
2024-06-02 22:19:43,630 DEBUG SenderThread:82 [sender.py:send():379] send: stats
|
| 1538 |
+
2024-06-02 22:19:44,973 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: internal_messages
|
| 1539 |
+
2024-06-02 22:19:45,653 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: stop_status
|
| 1540 |
+
2024-06-02 22:19:45,654 DEBUG SenderThread:82 [sender.py:send_request():406] send_request: stop_status
|
| 1541 |
+
2024-06-02 22:19:48,727 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 1542 |
+
2024-06-02 22:19:53,728 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 1543 |
+
2024-06-02 22:19:58,729 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 1544 |
+
2024-06-02 22:19:59,973 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: internal_messages
|
| 1545 |
+
2024-06-02 22:20:00,653 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: stop_status
|
| 1546 |
+
2024-06-02 22:20:00,653 DEBUG SenderThread:82 [sender.py:send_request():406] send_request: stop_status
|
| 1547 |
+
2024-06-02 22:20:04,709 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 1548 |
+
2024-06-02 22:20:09,710 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 1549 |
+
2024-06-02 22:20:13,631 DEBUG SenderThread:82 [sender.py:send():379] send: stats
|
| 1550 |
+
2024-06-02 22:20:14,973 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: internal_messages
|
| 1551 |
+
2024-06-02 22:20:15,075 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 1552 |
+
2024-06-02 22:20:15,653 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: stop_status
|
| 1553 |
+
2024-06-02 22:20:15,653 DEBUG SenderThread:82 [sender.py:send_request():406] send_request: stop_status
|
| 1554 |
+
2024-06-02 22:20:15,804 INFO Thread-12 :82 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240602_212342-ypv2rcj7/files/output.log
|
| 1555 |
+
2024-06-02 22:20:20,716 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
wandb/run-20240602_212342-ypv2rcj7/files/output.log
CHANGED
|
@@ -62,4 +62,6 @@
|
|
| 62 |
warnings.warn('Was asked to gather along dimension 0, but all '
|
| 63 |
/opt/conda/lib/python3.10/site-packages/torch/nn/parallel/_functions.py:68: UserWarning: Was asked to gather along dimension 0, but all input tensors were scalars; will instead unsqueeze and return a vector.
|
| 64 |
warnings.warn('Was asked to gather along dimension 0, but all '
|
|
|
|
|
|
|
| 65 |
/opt/conda/lib/python3.10/site-packages/torch/nn/parallel/_functions.py:68: UserWarning: Was asked to gather along dimension 0, but all input tensors were scalars; will instead unsqueeze and return a vector.
|
|
|
|
| 62 |
warnings.warn('Was asked to gather along dimension 0, but all '
|
| 63 |
/opt/conda/lib/python3.10/site-packages/torch/nn/parallel/_functions.py:68: UserWarning: Was asked to gather along dimension 0, but all input tensors were scalars; will instead unsqueeze and return a vector.
|
| 64 |
warnings.warn('Was asked to gather along dimension 0, but all '
|
| 65 |
+
/opt/conda/lib/python3.10/site-packages/torch/nn/parallel/_functions.py:68: UserWarning: Was asked to gather along dimension 0, but all input tensors were scalars; will instead unsqueeze and return a vector.
|
| 66 |
+
warnings.warn('Was asked to gather along dimension 0, but all '
|
| 67 |
/opt/conda/lib/python3.10/site-packages/torch/nn/parallel/_functions.py:68: UserWarning: Was asked to gather along dimension 0, but all input tensors were scalars; will instead unsqueeze and return a vector.
|
wandb/run-20240602_212342-ypv2rcj7/logs/debug-internal.log
CHANGED
|
@@ -1509,3 +1509,47 @@ subprocess.TimeoutExpired: Command '['conda', 'env', 'export']' timed out after
|
|
| 1509 |
2024-06-02 22:18:36,050 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 1510 |
2024-06-02 22:18:41,051 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 1511 |
2024-06-02 22:18:43,628 DEBUG SenderThread:82 [sender.py:send():379] send: stats
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1509 |
2024-06-02 22:18:36,050 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 1510 |
2024-06-02 22:18:41,051 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 1511 |
2024-06-02 22:18:43,628 DEBUG SenderThread:82 [sender.py:send():379] send: stats
|
| 1512 |
+
2024-06-02 22:18:44,972 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: internal_messages
|
| 1513 |
+
2024-06-02 22:18:45,652 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: stop_status
|
| 1514 |
+
2024-06-02 22:18:45,652 DEBUG SenderThread:82 [sender.py:send_request():406] send_request: stop_status
|
| 1515 |
+
2024-06-02 22:18:46,753 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 1516 |
+
2024-06-02 22:18:51,755 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 1517 |
+
2024-06-02 22:18:56,756 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 1518 |
+
2024-06-02 22:18:59,972 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: internal_messages
|
| 1519 |
+
2024-06-02 22:19:00,652 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: stop_status
|
| 1520 |
+
2024-06-02 22:19:00,653 DEBUG SenderThread:82 [sender.py:send_request():406] send_request: stop_status
|
| 1521 |
+
2024-06-02 22:19:01,785 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 1522 |
+
2024-06-02 22:19:06,786 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 1523 |
+
2024-06-02 22:19:11,787 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 1524 |
+
2024-06-02 22:19:13,629 DEBUG SenderThread:82 [sender.py:send():379] send: stats
|
| 1525 |
+
2024-06-02 22:19:14,972 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: internal_messages
|
| 1526 |
+
2024-06-02 22:19:15,652 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: stop_status
|
| 1527 |
+
2024-06-02 22:19:15,653 DEBUG SenderThread:82 [sender.py:send_request():406] send_request: stop_status
|
| 1528 |
+
2024-06-02 22:19:17,693 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 1529 |
+
2024-06-02 22:19:22,694 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 1530 |
+
2024-06-02 22:19:27,695 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 1531 |
+
2024-06-02 22:19:29,973 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: internal_messages
|
| 1532 |
+
2024-06-02 22:19:30,652 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: stop_status
|
| 1533 |
+
2024-06-02 22:19:30,653 DEBUG SenderThread:82 [sender.py:send_request():406] send_request: stop_status
|
| 1534 |
+
2024-06-02 22:19:32,731 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 1535 |
+
2024-06-02 22:19:37,732 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 1536 |
+
2024-06-02 22:19:42,733 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 1537 |
+
2024-06-02 22:19:43,630 DEBUG SenderThread:82 [sender.py:send():379] send: stats
|
| 1538 |
+
2024-06-02 22:19:44,973 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: internal_messages
|
| 1539 |
+
2024-06-02 22:19:45,653 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: stop_status
|
| 1540 |
+
2024-06-02 22:19:45,654 DEBUG SenderThread:82 [sender.py:send_request():406] send_request: stop_status
|
| 1541 |
+
2024-06-02 22:19:48,727 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 1542 |
+
2024-06-02 22:19:53,728 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 1543 |
+
2024-06-02 22:19:58,729 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 1544 |
+
2024-06-02 22:19:59,973 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: internal_messages
|
| 1545 |
+
2024-06-02 22:20:00,653 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: stop_status
|
| 1546 |
+
2024-06-02 22:20:00,653 DEBUG SenderThread:82 [sender.py:send_request():406] send_request: stop_status
|
| 1547 |
+
2024-06-02 22:20:04,709 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 1548 |
+
2024-06-02 22:20:09,710 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 1549 |
+
2024-06-02 22:20:13,631 DEBUG SenderThread:82 [sender.py:send():379] send: stats
|
| 1550 |
+
2024-06-02 22:20:14,973 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: internal_messages
|
| 1551 |
+
2024-06-02 22:20:15,075 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 1552 |
+
2024-06-02 22:20:15,653 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: stop_status
|
| 1553 |
+
2024-06-02 22:20:15,653 DEBUG SenderThread:82 [sender.py:send_request():406] send_request: stop_status
|
| 1554 |
+
2024-06-02 22:20:15,804 INFO Thread-12 :82 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240602_212342-ypv2rcj7/files/output.log
|
| 1555 |
+
2024-06-02 22:20:20,716 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
wandb/run-20240602_212342-ypv2rcj7/run-ypv2rcj7.wandb
CHANGED
|
Binary files a/wandb/run-20240602_212342-ypv2rcj7/run-ypv2rcj7.wandb and b/wandb/run-20240602_212342-ypv2rcj7/run-ypv2rcj7.wandb differ
|
|
|