ahcene-ikram commited on
Commit
b7e17a3
·
verified ·
1 Parent(s): bae516b

Training in progress, step 1600

Browse files
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:49fd7276d34c1d6dcf1ded77b933d284841f9656787e37c6783b89772f3e4692
3
  size 485755120
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4627f2a3e70c5a77e2c04f0ea5d9b2e06973ab627ca6923e5da2f158af28f7e7
3
  size 485755120
wandb/debug-internal.log CHANGED
@@ -1509,3 +1509,47 @@ subprocess.TimeoutExpired: Command '['conda', 'env', 'export']' timed out after
1509
  2024-06-02 22:18:36,050 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
1510
  2024-06-02 22:18:41,051 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
1511
  2024-06-02 22:18:43,628 DEBUG SenderThread:82 [sender.py:send():379] send: stats
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1509
  2024-06-02 22:18:36,050 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
1510
  2024-06-02 22:18:41,051 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
1511
  2024-06-02 22:18:43,628 DEBUG SenderThread:82 [sender.py:send():379] send: stats
1512
+ 2024-06-02 22:18:44,972 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: internal_messages
1513
+ 2024-06-02 22:18:45,652 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: stop_status
1514
+ 2024-06-02 22:18:45,652 DEBUG SenderThread:82 [sender.py:send_request():406] send_request: stop_status
1515
+ 2024-06-02 22:18:46,753 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
1516
+ 2024-06-02 22:18:51,755 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
1517
+ 2024-06-02 22:18:56,756 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
1518
+ 2024-06-02 22:18:59,972 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: internal_messages
1519
+ 2024-06-02 22:19:00,652 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: stop_status
1520
+ 2024-06-02 22:19:00,653 DEBUG SenderThread:82 [sender.py:send_request():406] send_request: stop_status
1521
+ 2024-06-02 22:19:01,785 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
1522
+ 2024-06-02 22:19:06,786 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
1523
+ 2024-06-02 22:19:11,787 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
1524
+ 2024-06-02 22:19:13,629 DEBUG SenderThread:82 [sender.py:send():379] send: stats
1525
+ 2024-06-02 22:19:14,972 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: internal_messages
1526
+ 2024-06-02 22:19:15,652 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: stop_status
1527
+ 2024-06-02 22:19:15,653 DEBUG SenderThread:82 [sender.py:send_request():406] send_request: stop_status
1528
+ 2024-06-02 22:19:17,693 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
1529
+ 2024-06-02 22:19:22,694 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
1530
+ 2024-06-02 22:19:27,695 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
1531
+ 2024-06-02 22:19:29,973 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: internal_messages
1532
+ 2024-06-02 22:19:30,652 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: stop_status
1533
+ 2024-06-02 22:19:30,653 DEBUG SenderThread:82 [sender.py:send_request():406] send_request: stop_status
1534
+ 2024-06-02 22:19:32,731 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
1535
+ 2024-06-02 22:19:37,732 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
1536
+ 2024-06-02 22:19:42,733 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
1537
+ 2024-06-02 22:19:43,630 DEBUG SenderThread:82 [sender.py:send():379] send: stats
1538
+ 2024-06-02 22:19:44,973 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: internal_messages
1539
+ 2024-06-02 22:19:45,653 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: stop_status
1540
+ 2024-06-02 22:19:45,654 DEBUG SenderThread:82 [sender.py:send_request():406] send_request: stop_status
1541
+ 2024-06-02 22:19:48,727 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
1542
+ 2024-06-02 22:19:53,728 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
1543
+ 2024-06-02 22:19:58,729 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
1544
+ 2024-06-02 22:19:59,973 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: internal_messages
1545
+ 2024-06-02 22:20:00,653 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: stop_status
1546
+ 2024-06-02 22:20:00,653 DEBUG SenderThread:82 [sender.py:send_request():406] send_request: stop_status
1547
+ 2024-06-02 22:20:04,709 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
1548
+ 2024-06-02 22:20:09,710 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
1549
+ 2024-06-02 22:20:13,631 DEBUG SenderThread:82 [sender.py:send():379] send: stats
1550
+ 2024-06-02 22:20:14,973 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: internal_messages
1551
+ 2024-06-02 22:20:15,075 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
1552
+ 2024-06-02 22:20:15,653 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: stop_status
1553
+ 2024-06-02 22:20:15,653 DEBUG SenderThread:82 [sender.py:send_request():406] send_request: stop_status
1554
+ 2024-06-02 22:20:15,804 INFO Thread-12 :82 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240602_212342-ypv2rcj7/files/output.log
1555
+ 2024-06-02 22:20:20,716 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
wandb/run-20240602_212342-ypv2rcj7/files/output.log CHANGED
@@ -62,4 +62,6 @@
62
  warnings.warn('Was asked to gather along dimension 0, but all '
63
  /opt/conda/lib/python3.10/site-packages/torch/nn/parallel/_functions.py:68: UserWarning: Was asked to gather along dimension 0, but all input tensors were scalars; will instead unsqueeze and return a vector.
64
  warnings.warn('Was asked to gather along dimension 0, but all '
 
 
65
  /opt/conda/lib/python3.10/site-packages/torch/nn/parallel/_functions.py:68: UserWarning: Was asked to gather along dimension 0, but all input tensors were scalars; will instead unsqueeze and return a vector.
 
62
  warnings.warn('Was asked to gather along dimension 0, but all '
63
  /opt/conda/lib/python3.10/site-packages/torch/nn/parallel/_functions.py:68: UserWarning: Was asked to gather along dimension 0, but all input tensors were scalars; will instead unsqueeze and return a vector.
64
  warnings.warn('Was asked to gather along dimension 0, but all '
65
+ /opt/conda/lib/python3.10/site-packages/torch/nn/parallel/_functions.py:68: UserWarning: Was asked to gather along dimension 0, but all input tensors were scalars; will instead unsqueeze and return a vector.
66
+ warnings.warn('Was asked to gather along dimension 0, but all '
67
  /opt/conda/lib/python3.10/site-packages/torch/nn/parallel/_functions.py:68: UserWarning: Was asked to gather along dimension 0, but all input tensors were scalars; will instead unsqueeze and return a vector.
wandb/run-20240602_212342-ypv2rcj7/logs/debug-internal.log CHANGED
@@ -1509,3 +1509,47 @@ subprocess.TimeoutExpired: Command '['conda', 'env', 'export']' timed out after
1509
  2024-06-02 22:18:36,050 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
1510
  2024-06-02 22:18:41,051 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
1511
  2024-06-02 22:18:43,628 DEBUG SenderThread:82 [sender.py:send():379] send: stats
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1509
  2024-06-02 22:18:36,050 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
1510
  2024-06-02 22:18:41,051 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
1511
  2024-06-02 22:18:43,628 DEBUG SenderThread:82 [sender.py:send():379] send: stats
1512
+ 2024-06-02 22:18:44,972 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: internal_messages
1513
+ 2024-06-02 22:18:45,652 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: stop_status
1514
+ 2024-06-02 22:18:45,652 DEBUG SenderThread:82 [sender.py:send_request():406] send_request: stop_status
1515
+ 2024-06-02 22:18:46,753 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
1516
+ 2024-06-02 22:18:51,755 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
1517
+ 2024-06-02 22:18:56,756 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
1518
+ 2024-06-02 22:18:59,972 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: internal_messages
1519
+ 2024-06-02 22:19:00,652 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: stop_status
1520
+ 2024-06-02 22:19:00,653 DEBUG SenderThread:82 [sender.py:send_request():406] send_request: stop_status
1521
+ 2024-06-02 22:19:01,785 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
1522
+ 2024-06-02 22:19:06,786 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
1523
+ 2024-06-02 22:19:11,787 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
1524
+ 2024-06-02 22:19:13,629 DEBUG SenderThread:82 [sender.py:send():379] send: stats
1525
+ 2024-06-02 22:19:14,972 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: internal_messages
1526
+ 2024-06-02 22:19:15,652 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: stop_status
1527
+ 2024-06-02 22:19:15,653 DEBUG SenderThread:82 [sender.py:send_request():406] send_request: stop_status
1528
+ 2024-06-02 22:19:17,693 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
1529
+ 2024-06-02 22:19:22,694 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
1530
+ 2024-06-02 22:19:27,695 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
1531
+ 2024-06-02 22:19:29,973 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: internal_messages
1532
+ 2024-06-02 22:19:30,652 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: stop_status
1533
+ 2024-06-02 22:19:30,653 DEBUG SenderThread:82 [sender.py:send_request():406] send_request: stop_status
1534
+ 2024-06-02 22:19:32,731 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
1535
+ 2024-06-02 22:19:37,732 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
1536
+ 2024-06-02 22:19:42,733 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
1537
+ 2024-06-02 22:19:43,630 DEBUG SenderThread:82 [sender.py:send():379] send: stats
1538
+ 2024-06-02 22:19:44,973 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: internal_messages
1539
+ 2024-06-02 22:19:45,653 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: stop_status
1540
+ 2024-06-02 22:19:45,654 DEBUG SenderThread:82 [sender.py:send_request():406] send_request: stop_status
1541
+ 2024-06-02 22:19:48,727 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
1542
+ 2024-06-02 22:19:53,728 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
1543
+ 2024-06-02 22:19:58,729 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
1544
+ 2024-06-02 22:19:59,973 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: internal_messages
1545
+ 2024-06-02 22:20:00,653 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: stop_status
1546
+ 2024-06-02 22:20:00,653 DEBUG SenderThread:82 [sender.py:send_request():406] send_request: stop_status
1547
+ 2024-06-02 22:20:04,709 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
1548
+ 2024-06-02 22:20:09,710 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
1549
+ 2024-06-02 22:20:13,631 DEBUG SenderThread:82 [sender.py:send():379] send: stats
1550
+ 2024-06-02 22:20:14,973 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: internal_messages
1551
+ 2024-06-02 22:20:15,075 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
1552
+ 2024-06-02 22:20:15,653 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: stop_status
1553
+ 2024-06-02 22:20:15,653 DEBUG SenderThread:82 [sender.py:send_request():406] send_request: stop_status
1554
+ 2024-06-02 22:20:15,804 INFO Thread-12 :82 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240602_212342-ypv2rcj7/files/output.log
1555
+ 2024-06-02 22:20:20,716 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
wandb/run-20240602_212342-ypv2rcj7/run-ypv2rcj7.wandb CHANGED
Binary files a/wandb/run-20240602_212342-ypv2rcj7/run-ypv2rcj7.wandb and b/wandb/run-20240602_212342-ypv2rcj7/run-ypv2rcj7.wandb differ