Training in progress, step 100
Browse files
model.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 485755120
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:0014b4ab5245e23175b0440ff8577de974506d8d13ba922708b0d40756be4ff7
|
| 3 |
size 485755120
|
wandb/debug-internal.log
CHANGED
|
@@ -120,3 +120,54 @@ subprocess.TimeoutExpired: Command '['conda', 'env', 'export']' timed out after
|
|
| 120 |
2024-06-02 21:26:00,482 INFO Thread-12 :82 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240602_212342-ypv2rcj7/files/output.log
|
| 121 |
2024-06-02 21:26:03,944 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 122 |
2024-06-02 21:26:08,945 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 120 |
2024-06-02 21:26:00,482 INFO Thread-12 :82 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240602_212342-ypv2rcj7/files/output.log
|
| 121 |
2024-06-02 21:26:03,944 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 122 |
2024-06-02 21:26:08,945 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 123 |
+
2024-06-02 21:26:13,521 DEBUG SenderThread:82 [sender.py:send():379] send: stats
|
| 124 |
+
2024-06-02 21:26:14,522 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 125 |
+
2024-06-02 21:26:14,838 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: stop_status
|
| 126 |
+
2024-06-02 21:26:14,839 DEBUG SenderThread:82 [sender.py:send_request():406] send_request: stop_status
|
| 127 |
+
2024-06-02 21:26:14,858 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: internal_messages
|
| 128 |
+
2024-06-02 21:26:19,859 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 129 |
+
2024-06-02 21:26:24,860 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 130 |
+
2024-06-02 21:26:29,841 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: internal_messages
|
| 131 |
+
2024-06-02 21:26:29,842 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: stop_status
|
| 132 |
+
2024-06-02 21:26:29,842 DEBUG SenderThread:82 [sender.py:send_request():406] send_request: stop_status
|
| 133 |
+
2024-06-02 21:26:29,960 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 134 |
+
2024-06-02 21:26:34,961 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 135 |
+
2024-06-02 21:26:39,962 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 136 |
+
2024-06-02 21:26:43,522 DEBUG SenderThread:82 [sender.py:send():379] send: stats
|
| 137 |
+
2024-06-02 21:26:44,838 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: stop_status
|
| 138 |
+
2024-06-02 21:26:44,839 DEBUG SenderThread:82 [sender.py:send_request():406] send_request: stop_status
|
| 139 |
+
2024-06-02 21:26:44,878 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: internal_messages
|
| 140 |
+
2024-06-02 21:26:45,936 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 141 |
+
2024-06-02 21:26:50,937 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 142 |
+
2024-06-02 21:26:55,937 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 143 |
+
2024-06-02 21:26:59,838 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: stop_status
|
| 144 |
+
2024-06-02 21:26:59,839 DEBUG SenderThread:82 [sender.py:send_request():406] send_request: stop_status
|
| 145 |
+
2024-06-02 21:26:59,874 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: internal_messages
|
| 146 |
+
2024-06-02 21:27:01,875 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 147 |
+
2024-06-02 21:27:06,876 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 148 |
+
2024-06-02 21:27:11,877 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 149 |
+
2024-06-02 21:27:13,523 DEBUG SenderThread:82 [sender.py:send():379] send: stats
|
| 150 |
+
2024-06-02 21:27:14,838 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: stop_status
|
| 151 |
+
2024-06-02 21:27:14,839 DEBUG SenderThread:82 [sender.py:send_request():406] send_request: stop_status
|
| 152 |
+
2024-06-02 21:27:14,879 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: internal_messages
|
| 153 |
+
2024-06-02 21:27:16,884 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 154 |
+
2024-06-02 21:27:21,885 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 155 |
+
2024-06-02 21:27:26,886 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 156 |
+
2024-06-02 21:27:29,839 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: stop_status
|
| 157 |
+
2024-06-02 21:27:29,839 DEBUG SenderThread:82 [sender.py:send_request():406] send_request: stop_status
|
| 158 |
+
2024-06-02 21:27:29,879 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: internal_messages
|
| 159 |
+
2024-06-02 21:27:31,955 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 160 |
+
2024-06-02 21:27:36,957 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 161 |
+
2024-06-02 21:27:41,958 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 162 |
+
2024-06-02 21:27:43,524 DEBUG SenderThread:82 [sender.py:send():379] send: stats
|
| 163 |
+
2024-06-02 21:27:44,843 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: internal_messages
|
| 164 |
+
2024-06-02 21:27:44,845 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: stop_status
|
| 165 |
+
2024-06-02 21:27:44,845 DEBUG SenderThread:82 [sender.py:send_request():406] send_request: stop_status
|
| 166 |
+
2024-06-02 21:27:47,922 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 167 |
+
2024-06-02 21:27:52,522 INFO Thread-12 :82 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240602_212342-ypv2rcj7/files/output.log
|
| 168 |
+
2024-06-02 21:27:53,243 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 169 |
+
2024-06-02 21:27:58,244 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 170 |
+
2024-06-02 21:27:59,839 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: stop_status
|
| 171 |
+
2024-06-02 21:27:59,839 DEBUG SenderThread:82 [sender.py:send_request():406] send_request: stop_status
|
| 172 |
+
2024-06-02 21:27:59,842 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: internal_messages
|
| 173 |
+
2024-06-02 21:28:03,930 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
wandb/run-20240602_212342-ypv2rcj7/files/output.log
CHANGED
|
@@ -1,5 +1,7 @@
|
|
| 1 |
[34m[1mwandb[39m[22m: [33mWARNING[39m Serializing object of type dict that is 295000 bytes
|
| 2 |
[34m[1mwandb[39m[22m: [33mWARNING[39m Serializing object of type dict that is 147552 bytes
|
|
|
|
|
|
|
| 3 |
/opt/conda/lib/python3.10/site-packages/torch/nn/parallel/_functions.py:68: UserWarning: Was asked to gather along dimension 0, but all input tensors were scalars; will instead unsqueeze and return a vector.
|
| 4 |
warnings.warn('Was asked to gather along dimension 0, but all '
|
| 5 |
/opt/conda/lib/python3.10/site-packages/torch/nn/parallel/_functions.py:68: UserWarning: Was asked to gather along dimension 0, but all input tensors were scalars; will instead unsqueeze and return a vector.
|
|
|
|
| 1 |
[34m[1mwandb[39m[22m: [33mWARNING[39m Serializing object of type dict that is 295000 bytes
|
| 2 |
[34m[1mwandb[39m[22m: [33mWARNING[39m Serializing object of type dict that is 147552 bytes
|
| 3 |
+
/opt/conda/lib/python3.10/site-packages/torch/nn/parallel/_functions.py:68: UserWarning: Was asked to gather along dimension 0, but all input tensors were scalars; will instead unsqueeze and return a vector.
|
| 4 |
+
warnings.warn('Was asked to gather along dimension 0, but all '
|
| 5 |
/opt/conda/lib/python3.10/site-packages/torch/nn/parallel/_functions.py:68: UserWarning: Was asked to gather along dimension 0, but all input tensors were scalars; will instead unsqueeze and return a vector.
|
| 6 |
warnings.warn('Was asked to gather along dimension 0, but all '
|
| 7 |
/opt/conda/lib/python3.10/site-packages/torch/nn/parallel/_functions.py:68: UserWarning: Was asked to gather along dimension 0, but all input tensors were scalars; will instead unsqueeze and return a vector.
|
wandb/run-20240602_212342-ypv2rcj7/logs/debug-internal.log
CHANGED
|
@@ -120,3 +120,54 @@ subprocess.TimeoutExpired: Command '['conda', 'env', 'export']' timed out after
|
|
| 120 |
2024-06-02 21:26:00,482 INFO Thread-12 :82 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240602_212342-ypv2rcj7/files/output.log
|
| 121 |
2024-06-02 21:26:03,944 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 122 |
2024-06-02 21:26:08,945 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 120 |
2024-06-02 21:26:00,482 INFO Thread-12 :82 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240602_212342-ypv2rcj7/files/output.log
|
| 121 |
2024-06-02 21:26:03,944 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 122 |
2024-06-02 21:26:08,945 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 123 |
+
2024-06-02 21:26:13,521 DEBUG SenderThread:82 [sender.py:send():379] send: stats
|
| 124 |
+
2024-06-02 21:26:14,522 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 125 |
+
2024-06-02 21:26:14,838 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: stop_status
|
| 126 |
+
2024-06-02 21:26:14,839 DEBUG SenderThread:82 [sender.py:send_request():406] send_request: stop_status
|
| 127 |
+
2024-06-02 21:26:14,858 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: internal_messages
|
| 128 |
+
2024-06-02 21:26:19,859 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 129 |
+
2024-06-02 21:26:24,860 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 130 |
+
2024-06-02 21:26:29,841 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: internal_messages
|
| 131 |
+
2024-06-02 21:26:29,842 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: stop_status
|
| 132 |
+
2024-06-02 21:26:29,842 DEBUG SenderThread:82 [sender.py:send_request():406] send_request: stop_status
|
| 133 |
+
2024-06-02 21:26:29,960 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 134 |
+
2024-06-02 21:26:34,961 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 135 |
+
2024-06-02 21:26:39,962 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 136 |
+
2024-06-02 21:26:43,522 DEBUG SenderThread:82 [sender.py:send():379] send: stats
|
| 137 |
+
2024-06-02 21:26:44,838 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: stop_status
|
| 138 |
+
2024-06-02 21:26:44,839 DEBUG SenderThread:82 [sender.py:send_request():406] send_request: stop_status
|
| 139 |
+
2024-06-02 21:26:44,878 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: internal_messages
|
| 140 |
+
2024-06-02 21:26:45,936 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 141 |
+
2024-06-02 21:26:50,937 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 142 |
+
2024-06-02 21:26:55,937 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 143 |
+
2024-06-02 21:26:59,838 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: stop_status
|
| 144 |
+
2024-06-02 21:26:59,839 DEBUG SenderThread:82 [sender.py:send_request():406] send_request: stop_status
|
| 145 |
+
2024-06-02 21:26:59,874 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: internal_messages
|
| 146 |
+
2024-06-02 21:27:01,875 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 147 |
+
2024-06-02 21:27:06,876 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 148 |
+
2024-06-02 21:27:11,877 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 149 |
+
2024-06-02 21:27:13,523 DEBUG SenderThread:82 [sender.py:send():379] send: stats
|
| 150 |
+
2024-06-02 21:27:14,838 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: stop_status
|
| 151 |
+
2024-06-02 21:27:14,839 DEBUG SenderThread:82 [sender.py:send_request():406] send_request: stop_status
|
| 152 |
+
2024-06-02 21:27:14,879 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: internal_messages
|
| 153 |
+
2024-06-02 21:27:16,884 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 154 |
+
2024-06-02 21:27:21,885 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 155 |
+
2024-06-02 21:27:26,886 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 156 |
+
2024-06-02 21:27:29,839 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: stop_status
|
| 157 |
+
2024-06-02 21:27:29,839 DEBUG SenderThread:82 [sender.py:send_request():406] send_request: stop_status
|
| 158 |
+
2024-06-02 21:27:29,879 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: internal_messages
|
| 159 |
+
2024-06-02 21:27:31,955 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 160 |
+
2024-06-02 21:27:36,957 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 161 |
+
2024-06-02 21:27:41,958 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 162 |
+
2024-06-02 21:27:43,524 DEBUG SenderThread:82 [sender.py:send():379] send: stats
|
| 163 |
+
2024-06-02 21:27:44,843 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: internal_messages
|
| 164 |
+
2024-06-02 21:27:44,845 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: stop_status
|
| 165 |
+
2024-06-02 21:27:44,845 DEBUG SenderThread:82 [sender.py:send_request():406] send_request: stop_status
|
| 166 |
+
2024-06-02 21:27:47,922 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 167 |
+
2024-06-02 21:27:52,522 INFO Thread-12 :82 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240602_212342-ypv2rcj7/files/output.log
|
| 168 |
+
2024-06-02 21:27:53,243 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 169 |
+
2024-06-02 21:27:58,244 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 170 |
+
2024-06-02 21:27:59,839 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: stop_status
|
| 171 |
+
2024-06-02 21:27:59,839 DEBUG SenderThread:82 [sender.py:send_request():406] send_request: stop_status
|
| 172 |
+
2024-06-02 21:27:59,842 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: internal_messages
|
| 173 |
+
2024-06-02 21:28:03,930 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
wandb/run-20240602_212342-ypv2rcj7/run-ypv2rcj7.wandb
CHANGED
|
Binary files a/wandb/run-20240602_212342-ypv2rcj7/run-ypv2rcj7.wandb and b/wandb/run-20240602_212342-ypv2rcj7/run-ypv2rcj7.wandb differ
|
|
|